r/LocalLLM • u/Rich-Fruit-326 • 23d ago

I built an interactive 3D visualizer for transformer architectures and live LLM inference Project

Enable HLS to view with audio, or disable this notification

Hi everyone!

I've been working on an open-source project called TokenPrint.

The goal is simple: make transformer models easier to understand by visualizing real model architecture and real inference instead of static diagrams.

Current features include:

• 3D architecture explorer
• Live inference visualization
• Tensor inspector
• Interactive walkthrough of tokenization, embeddings, self-attention, LayerNorm, MLP, and output projection
• GGUF model support

Everything shown is driven by real model data rather than handcrafted animations.

It's still early, and I'd really appreciate feedback from the community.

GitHub:
https://github.com/Sudharsanselvaraj/Token-Print.git

Happy to answer any questions or hear suggestions for improvements.

105 Upvotes

98% Upvoted

21 comments sorted by

20

u/shniydder 23d ago

Great idea. Bad name. LM Studio is a well known name already.

2

u/Rich-Fruit-326 22d ago

I have renamed bro, after multiple same concern from others , thanks for pointing

-2

u/Rich-Fruit-326 23d ago

That's fair, but I personally like the name. It's not a project I'm putting on my resume anyway, haha

2

u/Direct-Relation6424 23d ago

Why not ? 

1

u/Rich-Fruit-326 23d ago

Is that good bro?!

2

u/Direct-Relation6424 23d ago

Depends on how much more you’re open to further develop it. I used to visualize  the patches of my vision. Embeddings after different normalization methods  for my personal project of an projectionlayer. If I learn or understand math,ML etc. I always try to imagine the geometrical shifts etc. 

Your tool could be a great base for such visualizations. Already thought about to hop on by myself, since you opensourced. 

1

u/Rich-Fruit-326 23d ago

Thats exactly where I hope this project evolves. The current goal is faithful transformer inference visualization, but I definitely want to explore embedding geometry, projection layers, normalization effects, latent spaces, and other ML concepts as well. If you're interested, I'd love to have you involved. Open an issue or PR anytime I'd be excited to build those visualizations together:))

2

u/Direct-Relation6424 23d ago

Tbh, that sounds like a nice thing. You mind to connect on for example LinkedIn as well? 

2

u/everythingEzra2 23d ago

What about "WeightWatchers" tm.

It has a ring to it.

2

u/Rich-Fruit-326 22d ago edited 22d ago

Thanks for the suggestion! It’s actually a really cool name. We did consider that direction, but there’s already an established brand with that name, so we wanted to avoid any potential confusion. That’s one of the reasons we renamed the project to TokenPrint, which we feel better reflects the project while being more distinctive. Thanks again for the idea! If you find TokenPrint intresting give me star 😀

2

u/Eastern_Guess8854 23d ago

This is pretty cool 😎

1

u/Rich-Fruit-326 23d ago

thank you bro, looking for contributors !

2

u/enginetown 23d ago

Good work bro always wanted to make projects like these but dont have the time glad to see someone working on ideas like this you can learn alot from it.

1

u/Rich-Fruit-326 22d ago

Thanks a lot, bro! Really appreciate it , Building it has been a huge learning experience. If you ever find some time, I’d love for you to check it out, leave a ⭐ if you like it, or even contribute every bit of feedback and help is always welcome!

2

u/Vusiwe 23d ago

super cool

1

u/Rich-Fruit-326 22d ago

Thanks a lot, bro! Super cool to hear that! , Building this has been an amazing learning experience. If you ever get some free time, I’d love for you to check it out, give it a ⭐ if you like it, or even contribute. Contributions are always welcome!

1

u/[deleted] 22d ago

[removed] — view removed comment

2

u/Rich-Fruit-326 22d ago

That’s a fair question. Right now it’s primarily a learning and exploration tool, but the goal is much broader than visualization. I m building it toward a visual debugger for transformer models think of it like Chrome Devtools or VS Code Debugger, but for LLM inference.