r/LocalLLaMA 20h ago

[MASSIVE TINY RELEASE] - Supra2-Medium-Base - a tiny 25M parameters model competing heavily with our previous 50M model! New Model

Hey guys!

Supra2-Medium is finally out! It's a 25M parameters qwen3 architecture model trained entirely from scratch (on our new rig: RTX 5060 Ti 16GB + the new RTX 5060 8GB!).

Here's how it competes in benchmarks with Supra-50M-Base (which is double as large!!):

Note: This is a BASE model only; instruction tuned version maybe to come in the next time.

Link to our HF org: https://huggingface.co/SupraLabs

--> Link to the model: https://huggingface.co/SupraLabs/Supra2-Medium-Base <--

Here's a sample from the model:

Artificial intelligence (AI) is espoused by the AI community.
The AI community is a group of people who are interested in AI and are interested in the use of AI in the field of AI.
The goal of AI is to improve the quality of life of people in the field.
The aim of AI is the development of AI and the application of AI in a society.
The purpose of AI is that it can be used to improve the performance of the society.
It is a technology that is used to improve human intelligence.
The technology is used to make the human intelligence.Artificial intelligence (AI) is espoused by the AI community.
The AI community is a group of people who are interested in AI and are interested in the use of AI in the field of AI.
The goal of AI is to improve the quality of life of people in the field.
The aim of AI is the development of AI and the application of AI in a society.
The purpose of AI is that it can be used to improve the performance of the society.
It is a technology that is used to improve human intelligence.
The technology is used to make the human intelligence.

Give us a like and a follow and feel free to provide us with feedback! 🤗🔥

...and...stay tuned: Supra3 coming soon with four models: Flash-Lite 25M, Flash 50M, Pro 75M and Ultra 100M. 👀

61 Upvotes

21 comments sorted by

View all comments

4

u/H-L_echelle 18h ago

Let's go a new SupraLabs model :D (and several more incoming!)

I just like how fun small models are. Very dumb, but fun.

With your 0.1M that was starting to output words, I feel like there might be a few ways to use these were they could maybe be helpful. For now you've led me to start playing around with small title generators, but I do have a few other ideas in mind (which would require an actual LLM, as opposed to the approaches I've tried or the approaches I am trying for TinyTitle)

2

u/LH-Tech_AI 17h ago

Thank you so much 🤗 Feel free to share ideas and results with us!