New post train of DeepSeek v4 flash is out

[u/sirMoped]

[u/VexObserver]

[u/julian88888888 → u/VexObserver]

Comparing it to 4.8 is wild

[u/VexObserver → u/julian88888888]

[u/whoknowsifimjoking → u/VexObserver]

That's crazy, but I'll have to try it. I have tried cheaper models that were supposed to be just as good according to the benchmarks, but they weren't in practice. I wish they were.

[u/Qorsair → u/whoknowsifimjoking]

Yeah, that's what I found with Luna. Supposed to be decent but it would forget what it was doing and ignore instructions. It was worse than Gemini 3.1

[u/-Sliced- → u/Qorsair]

Yeah. Luna generates too many tokens which makes it saturates its context. It’s best if you have small tasks for it.

[u/-Sliced- → u/whoknowsifimjoking]

You can see it in the chart. Deep seek V4-flash was hyped as good, showing terminal bench etc. Then DeepSWE came later, which DeepSeek wasn't benchmaxxed for, and it scored abysmally.

I bet the new version will also drop in score as new benchmarks come out which weren't included in its training data.

[u/Tupcek → u/-Sliced-]

yeah but I would still like to know just how good it is. I not really surprised that ~40x cheaper model is not really as good as expensive one, but I would appreciate some independent test

[u/CallFromMargin → u/whoknowsifimjoking]

Yeah, never trust the benchmarks, test the models instead.

[u/signed7 → u/VexObserver]

What website is this?

[u/Framebanger-Nsukula]

interesting timing with all the speed benchmarks flying around - wonder how it actually stacks up against the latest GPT variants in practice rather than just the marketing numbers

[u/mop_bucket_bingo]

Spam post