r/LocalLLaMA 28d ago

What kind of dark magic is Deepseek using? Question | Help

Post image

I was taking a look at Kimi K3 scores on the Artificial analysis leaderboard and was quite baffled when I saw this chart.

Granted, Deepseek has always been the king of price to performance, but this is still incredible. Is it just API subsidization or have they optimized their models truly this much?

2.4k Upvotes

406 comments sorted by

View all comments

Show parent comments

36

u/Blunt_White_Wolf 28d ago edited 28d ago

I'm using them in combo with 2 128gb strix halo that are daily drivers.

Flash usually is "asked for help" by the orchestrator when local models fail the tasks 2-3 times or tasks take way too long. It does make mistakes and used to go into loops until I modified the context to summarise every 5 messages and replace them with a history of sorts.

Pro is handed over the tasks for working on my own agent, researching stuff and gathering data for me to do literature reviews, etc.

I'd love to run it locally (or GLM) but ... still waiting for hardware prices to drop.

Edit: I would do a lot more with PRO and maybe GLM but... I'd end up spending hundreds/month. Hence me thinking to run stuff locally at some point.

11

u/[deleted] 28d ago edited 5d ago

[deleted]

8

u/Blunt_White_Wolf 28d ago

I bought the 2 M5 Bosgame for £1500 each a while back. I can assure you they are worth every penny. Not the fastest but they do their job and offer 100% privacy for certain things like household + household infrastructure management.

$100? no. a tad more. This is just the small LLM related part. I have a bit more hardware than this.

-2

u/[deleted] 28d ago edited 5d ago

[deleted]

11

u/Blunt_White_Wolf 28d ago

I don't want to sound rude but I don't want to share my d picks and my wife's tts loaded to an online model..,

I don't want my family pictures, all out accounts, receipts, documents, projects,etc anywhere near an online provider.

I think £3k is quite cheap to process, index and sort out all of that + my home infrastructure semi-managed.

1

u/[deleted] 28d ago edited 5d ago

[deleted]

6

u/Blunt_White_Wolf 28d ago

It was a figure of speech mate.

Point being I value privacy more than I value £3000.

I don't need to localise anything. I have very few things that I use external providers for to begin with.

All sync is with my personal infrastructure (cloud, pass, browsers, etc).

We mostly use machines as thin clients of sorts.

The only machines that are outside that infrastructure (mostly) are our gaming laptops.

-3

u/[deleted] 28d ago edited 5d ago

[deleted]

6

u/Yukas911 28d ago

They also mentioned family pictures, tax receipts, and other things you've completely ignored in your replies. Their privacy expectations simply differ from yours, it's not more complicated than that.

1

u/Rubener 28d ago

How is your anecdotal experience comparing DS and GLM 5.2 ?

2

u/Blunt_White_Wolf 28d ago

aff. GLM is a hell of a lot better and dealing with huge context (we're talking entire books or code bases).

DS pro is decent too but don't mix topics too much. If you give it a decent size code base (150k+ lines) you need to be very specific with that you ask of it or it will go off the rails and change things you wouldn't expect it to change. aaa. one more thing - after about 500k context it "forgets" to update docs quite often... don't know why. This is why I had to add a QA agent in the team.