I’ve been building an interactive 3d and 2d visualization of GPT-2 with Codex. You can check it out at llm-visualized.com The goal is to provide an immersive learning experience for people who want to learn about how LLMs work. The visualization depicts real attention scores and activations extracted from GPT-2 (specifcally, the smallest 124 million parameter version) during a forward pass. The 3D part was built with Three.js and the 2d part was built with plain HTML/CSS/JS. Would love to get your thoughts and feedback! Thank you :) submitted by /u/Greedy-Argument-4699
Originally posted by u/Greedy-Argument-4699 on r/ArtificialInteligence
You must log in or # to comment.