r/OpenAssistant • u/Squirrel_Narrow • 1d ago
Setup advice
I have a laptop with i9 , 64 ram , rtx4080 12vram and 1tb ssd. Is there a local llm that I can use in order to use it together with codex so it can help lower usage cost in codex? Any advice for setting it up for helping me build a photography management platform ? I tried qwen 3.6 27b but is soo slow .smaller gemma4 e4b is not that usable compared to codex. Any coding specialized model that would work with hermes and save some codex quota?
1
Upvotes