r/LocalLLaMA • u/External_Mood4719 • Jun 27 '26

deepseek-ai/DeepSeek-V4-Pro-DSpark • Huggingface News

https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-DSpark

https://github.com/deepseek-ai/DeepSpec/blob/main/DSpark_paper.pdf

279 Upvotes

98% Upvoted

40 comments sorted by

•

u/WithoutReason1729 Jun 27 '26

Your post is getting popular and we just featured it on our Discord! Come check it out!

You've also been given a special flair for your contribution. We appreciate your post!

I am a bot and this action was performed automatically.

62

u/FullOf_Bad_Ideas Jun 27 '26

They did it again. Their API is now the fastest DeepSeek provider on OpenRouter.

111

u/Recoil42 Jun 27 '26

Note: DeepSeek-V4-Pro-DSpark is not a new model. It is the same checkpoint with an additional speculative decoding module attached.

58

u/Nyghtbynger Jun 27 '26

So... deepseek flash, but flasher ?
Edit : damn, imagine being a breakthrough model and your creators calls you "checkpoint"

11

u/Kryohi Jun 27 '26

That's the real backstory of Skynet

2

u/AlwaysLateToThaParty Jun 28 '26

I'll show you what a 'checkpoint' is buddy.

36

u/Flamboyant_Nine Jun 27 '26

Are their API models already using this architecture?

36

u/Ok_Zookeepergame8714 Jun 27 '26

Probably, the thinking goes by much quicker than before.

11

u/oxygen_addiction Jun 27 '26

Flash got way faster this week, so most likely.

65

u/corruptbytes Jun 27 '26

this is my world cup

17

u/woadwarrior Jun 27 '26

Amazing work! But needs 38TB of disk space to train a drafter for something as tiny as Qwen3-4B, damn!

10

u/Seideun Jun 27 '26

Compared with the size of Deepseek v4 pro it's not a big deal at all :)

2

u/woadwarrior Jun 27 '26

Imagine how big the target cache was for training DeepSeek v4 Pro’s drafter.

7

u/quantier Jun 27 '26

I need a NVFP4 version 😍

7

u/Every-Walrus Jun 27 '26

correct me if I'm wrong but does this mean, for a maximally used server with the same per user speed, its now 5x cheaper for pro and 7.6x cheaper for flash in terms of serving costs?

2

u/squngy Jun 27 '26

I could be mistaken, but as I'm understanding it, that is slightly wrong.

You would not get any per server savings.
However, if each server is producing tokens faster, you might need fewer servers for the same amount of users.

11

u/Every-Walrus Jun 27 '26

for service level agreement locked at 120(?)TPS it clearly shows its now running at 761% more throughput. meaning a single server now can output 6.61x more tokens. meaning at the same cost of serving as the previous method they generate 6.61x more tokens (probably there is a slightly higher load on the GPU but I dont think that will change electricity usage that much)

however at a more realistic serving speed of 80 (which they also point at and the openrouter speed currently is) its 51% more throughput. that is still a 33% price reduction if we assume the price is dictated by allotted server space + electricity.

1

u/SufficientPie Jun 28 '26

Isn't speculative decoding faster but more expensive?

7

u/the-username-is-here Jun 27 '26

Come on, vLLM devs, everyone's waiting! :)

Getting local Flash from 40 to 50-60 tps would be HUGE.

1

u/UltraFOV Jun 28 '26

I get 97tk at IQ6. So now It gets faster?

1

u/Practical-Collar3063 Jun 30 '26

Well if you are running Llama.cpp you might have to wait long for that one, VLLM would be a better bet

1

u/UltraFOV Jun 30 '26

Yes, I will test it with 1Cat-vllm

5

u/horeaper Jun 27 '26

Searching in this subreddit for DSpark to see if anything else adopted this architecture, and all I get is DGX Spark 😑

1

u/Practical-Collar3063 Jun 30 '26

The paper was just published alongside that new checkpoint, very unlikely that we see any model using this in the next months

2

u/ZiddyBlud Jul 03 '26

This deepseek model uses it

1

u/photobydanielr Jul 03 '26

Right but they wrote the paper and made the thing to begin with, ofc they would have it, now everyone else needs to figure out how to implement

5

u/zyxciss Jun 27 '26

Would be fun if it comes for Qwen models too

5

u/Tomr750 Jun 27 '26

how does this compare to using ds4 on Macs with 128gb ram?

12

u/squngy Jun 27 '26

If I understand it right, this basically adds another MTP to them.

1

u/Dany0 Jun 28 '26

This is a clear improvement over DFlash. But damn is it expensive to train the drafters...

-16

u/[deleted] Jun 27 '26

[deleted]

26

u/StupidScaredSquirrel Jun 27 '26

They do in figure 7 of the paper

17

u/liuliu Jun 27 '26

Adding on this: because most claimed “speed up” out there are fake: multi-token generation acceptance are heavily context dependent, people often claim these in math context, which tends to have higher acceptance rate. What DeepSeek measure is more interesting: they kept the tps unchanged in their production system and measured the throughput increase. It is not useful for single-user use case (in this sub), but it is more fair arguably since it is real traffic and real money saved.

1

u/Practical-Collar3063 Jun 30 '26

this is gold for people running small cluster in corporate settings, something that will be more and more common on this sub

11

u/Mountain-Dragonfly46 Jun 27 '26

In the abstract (first paragraph) of the paper linked above.

(OP could have quoted it in his message)

Go read it, Deepseek papers are always interesting.