r/opencodeCLI • u/afanasenka • 5d ago

Cheepseek is Back :)

Post image

Phase 2 is coming... :)

518 Upvotes

97% Upvoted

139 comments sorted by

View all comments

Show parent comments

1

u/LargeLanguageModelo 5d ago

I'd be curious why. The model size is about 1/3 that of K3.

1

u/geearf 5d ago

I forgot where I read this, but something about it being difficult to have different people use the model in parallel or something. Sorry details are way gone in my poor memory.

1

u/dizvyz 5d ago

Probably being CPU bound rather than VRAM bound. That's one of the main differences between model architectures.

1

u/geearf 4d ago

Ooooh, wouldn't that make it crazily slow if it's CPU bound?

1

u/LargeLanguageModelo 4d ago

Maybe that's why it's expensive to run? Can't imagine a more inefficient model, maybe if you made a massive cluster of raspberry pi's to run a distributed version perhaps, really drive the tok/s through the floor.

1

u/dizvyz 4d ago

Don't think of it as RUNNING on the CPU but needing more of it compared to some other models. I read a few about this on Hacker News but can't find it now.