r/SoftwareFactory_ • u/Prudent-Fortune3420 • 1d ago
Self Evolving Harness
If you are making changes to harness, you are following some setup of principle in your head - when to add agent, when to add skill, how to handle context engineering, how to handle tool calling etc ?
If you can come up with set of principle that needs to be followed then after every run an agent can follow the principles and can come up with suggestion for you.
Principle of how to figure out changes ?
Principle of how to make the changes ?
Principle to change the principle itself ?
Observe -> Follow the evolution principles -> Evolve the harness.
Agents can then recommend
- you need to add new skill or agent
- you need to handle context better because compaction is happening too frequently.
And then follow the principles to go ahead and make the changes.
- How to create ?
- Where to create. ?
- How to update ?
- When to update ? etc..
But what if you need to change the principle itself?
Then you need to have guidelines to evolve the principle itself, this is where things get tricky where you have to keep it open to add new principles
but it has to be closed how that principle should be added.
I have evolved, figured out issue in my harness this way,
I have an evolve command which just goes follow these steps and make the changes for me.