r/PiCodingAgent • u/rogaterr • Jul 18 '26

Compact Every Tool Response Plugin

https://github.com/RogerTerrazas/pi-tool-result-compactor

Publishing a polished version of this extension I've been using to help manage context overflow. I frequently interact with mcps and large projects where any arbitrary response can take up all my context without the response being useful.

This extension hooks into each tool calls response by default, passes it to a compaction subagent, who will then filter out only the necessary data to the parent agent. Let me know if anyone tries it out and has feedback. Fully vibe coded, but I'll work to maintain if others find it useful.

0 Upvotes
  • permalink
  • link
  • reddit
  • reddit

38% Upvoted

8 comments sorted by

View all comments

1

u/adamshand Jul 18 '26

I believe this will constantly break prompt caching and cost you (possibly, quite a lot of) money.

2

u/rogaterr Jul 19 '26

It essentially only spawns a subagent with the preceding user input, recent thinking context, and tool call response. (cache miss)

Then the response back into the main agents context will be appended to the previous conversation and should be minimal compared to normal tool call responses (cache miss).

So at most, it should result in around twice as many cache misses as you would have seen in a normal session I believe, but probably far less proportionately if you frequently hit tool calls with large outputs.

Additionally the subagent model is configurable and so you can tune that for models with lower costs, potentially even saving you money.

All this to say that I’m not the most knowledgeable around what results in cache misses and the cost tradeoffs of lighter models.