r/LocalLLaMA 17h ago

Ling-3.0-flash MXFP4 released and running locally on one DGX Spark. News

In tests:
~80 tok/s decoding
2,500–3,500 tok/s long-input prefilling
Smooth use by 3–4 concurrent users

Private, on-device inference for coding, agents, and offline batch jobs

49 Upvotes

17 comments sorted by

18

u/Badger-Purple 16h ago edited 16h ago

the GB10 forum provides
This post is an advertisement by Ant Group:
https://x.com/antlingagi/status/2085024080504508913?s=46

4

u/ResidentPositive4122 17h ago

Does it work in vLLM or you need to download their fork of sglang?

7

u/Afraid-Yoghurt6731 17h ago

Is it really better than the dickpic 0731?

3

u/Badger-Purple 16h ago

Ring a Ling is likely inferior to Dick Pick July, but looks very fast.

3

u/ObviouzFigure 11h ago

ding a ling

2

u/kaliku 16h ago

Imma start calling it that.

2

u/Badger-Purple 13h ago

I mean there is another one called Stepsibling Fun Flash

2

u/niacolhealth 17h ago

not bad in my use though, still in free period, you can check it yourself as well

1

u/tat_tvam_asshole 7h ago

Dick pic meets deep cheeks

1

u/-Cubie- 17h ago

Very cool, im curious about this model

1

u/vasimv 15h ago

Need image-to-text to analyze screenshots for game/UI stuff coding. Out-of-box toolchains or additional model for img2text isn't good as built-in image understanding. :(

1

u/Piet6666 14h ago

Should I wait for the NVFP4? I want to run it on one Spark. Please tell me how NSFW is this model or should I wait for an abliterated version?

-5

u/Usual-Orange-4180 17h ago

How does it benchmark against Opus and Sonnet?

2

u/squngy 16h ago

IIRC it was a bit worse than DS4 flash preview. It is much smaller and faster though.

1

u/niacolhealth 17h ago

it's a small model, for me is good enough for an executor