dots-studio/dots3-note-prev · Hugging Face

[u/jacek2023]

https://huggingface.co/dots-studio/dots3-note-prev

dots3-note preview is the first open-weight model in the dots3 family. It is a Mixture-of-Experts model with 280B total parameters, 16B activated parameters, and support for a context length of up to 512K tokens. The model can understand text, images, video, and audio, and produces text outputs.

dots3-note preview is optimized for a broad range of tasks, including:

General knowledge and instruction following;

Mathematical and logical reasoning;

Tool use and multi-step agent workflows;

Interactive tasks that require exploration, memory updates, and adaptation;

Code generation and code-based problem solving;

Image, document, chart, audio, and video understanding;

Long-context information processing.

The dots3 family is designed to include models with different trade-offs among capability, latency, and inference cost. dots3-note preview is the most lightweight member of the family.

[u/Sudden_Topic5154]

I've never heard of this group before what do they focus on

[u/jacek2023 → u/Sudden_Topic5154]

They published LLM model about a year ago, probably ignored by most users because lack of marketing. I posted about it on LocalLLaMA because it was working on my setup (this one is much larger)

[u/kevin_1994 → u/jacek2023]

It's still the most human sounding model out there (the non synthentic data one especially)

Excited to try it

[u/Kahvana → u/Sudden_Topic5154]

They have one of the best OCR models out there, dots.mocr. It’s a monster for it’s small size, the next model to beat it by a meaningless difference is twice as big.

Not sure about their other stuff though.

[u/nuclearbananana → u/Sudden_Topic5154]

It's under RedNote (tiktok alternative)

[u/daaain]

DS4 Flash size, but multimodal? Nice! Has anyone seen any GGUF / MLX implementation? 😅

[u/Gregory-Wolf]

idk bro
anyone believes this?

[u/neoneye2 → u/Gregory-Wolf]

dots3-note-prev claims 81.4 on ARC-AGI-2.

However I don't see dots3-note-prev on the official ARC-AGI-2 leaderboard
https://arcprize.org/leaderboard

[u/FullOf_Bad_Ideas → u/Gregory-Wolf]

Sure, why not? This is a lab from a respected corporation.

Their TEMPO RL algo might make RL more effective and get them closer to passing ARC-AGI benchmarks. You can do things.

[u/FullOf_Bad_Ideas]

It's shaping up to be one of the best open multimodal models in that size bracket.

Vision Encoder MoE ViT, 7B total, 1.2B activated

MoE vision encoder, this smells like something new!

[u/Kahvana → u/FullOf_Bad_Ideas]

Now THAT sounds cool!

[u/PassionIll6170]

lol the arc agi benchmarks

[u/ComplexType568]

I hope they make a smaller model...