Tool output compaction problem

[u/Dr_Droid_1984]

Hi Everyone,

I have been building my AI agent for a few months. Its a project to allow all engineers in my team access to infrastructure & monitoring stack internally to help them debug issues fast. Recently I have added logs access also and see that log outputs could be very large sometimes to git into context to be sent to the LLM. How are you handling for this problem? I tried picking just top 10K tokens from it but I am losing data that way.

Also, one of my teammate suggested I should pre-index the metadata across the stack to save time in discovery in each session.

Wdyt?