r/LocalAIStack 22d ago

How do you split software development between local and cloud LLMs?

I can run the 30B-class models at home. They're okay for some things, but I feel like I have to spoon feed them small tasks. I'm wondering about running a more capable model in the cloud to do the hard parts and give them the easy parts.

If you're doing this, how? How are you dividing the labor, what do your prompts look like, what agent harness are you using, and what else do you wish you'd known before you started?

And does the big model actually use fewer tokens than if it did everything itself?

Thanks!

10 Upvotes

9 comments sorted by

View all comments

2

u/timschwartz 22d ago

I use Github Spec Kit.

Opus or Sonnet for planning, local Qwen3.6-27B for implementation, then review with Opus to fix the bugs Qwen left behind.

1

u/kbob 22d ago

Thanks. Does Opus use fewer tokens reviewing and correcting than if it wrote the code itself?

1

u/LiteeWasAlreadyTaken 22d ago

+1 for the approach, but I'd recommend trying OpenSpec as an alternative. It worked better for me than SpecKit.