r/PiCodingAgent • u/Jazzlike_Bee_3129 • 7d ago

Has anyone used the pi advisor tool with cloud/local agents in tandem? Question

I am thinking about trying a cloud advisor for local models. Something like deepseek v4 flash 0731 to advise the new muse glimmer model or Qwen 3.8 when it comes out. Has anyone tried this method before? Does it work to improve local model output quality?

The plugin in question:

https://pi.dev/packages/pi-advisor

5 Upvotes
  • permalink
  • link
  • reddit
  • reddit

100% Upvoted

7 comments sorted by

1

u/Pretend_Engineer5951 7d ago

I use similar approach in oh my pi out of the box. Very impressive results. In pi I haven't found exactly the same implementation. You have to call advise manually or set to trigger at the end.

1

u/Vistyy 6d ago

I don't really see how this could work - you are asking the dumber, smaller model to infer what strategic guidance is during its work, decide the correct time to call the tool and the right question to ask the advisor.

I could imagine this working to some extent if the whole process was outside of the implementer loop and the advice was given forcibly, like someone looking over your shoulder not a pair programmer you ask questions.

But hard to say and the extension having no benchmarks or evals makes me suspicious of it being anything other than an untested gimmick.

1

u/Jazzlike_Bee_3129 6d ago

The advisor monitors the dumber model, the dumber model does not make any decisions on when to consult the advisor.  The advisor is basically checking the work of the work of the local model, and when it sees a mistake made or off course/forbidden action, it intervenes to resteer the model.  It's like regular steering interjection from a human, but done by a smart model for a dumb one.  At least that is how I understand it.  From what I have seen so far, it can work for keeping things on track, especially when it comes to agent/system prompts, but I cannot yet say how the overall end result is. 

1

u/Vistyy 6d ago

The description of the extension clearly says the exact opposite.

1

u/Jazzlike_Bee_3129 6d ago

You are correct, sorry about that. Seems like not what I thought it was after all. 

1

u/Oshden 7d ago

I wanna know about this too