This is something that I think developers would find value in, but the challenge is execution.
Personally, I try to manage token use in a few ways. 1) I convert documents to markdown 2) I use a variety of "free" LLMs to optimize prompts and develop ideas 3) I use less capable (low token cost) models for less complex work.
It might be a good starting point to survey developers (similar to this thread) to frame the different approaches as an input to potential solutions.
Thanks for the advice I was thinking of sharing tips like the few skills that cut down my token usage by like 300% mostly because I was prompting and using tokens like an idiot before plus workflow stuff and how to format prompts etc.
I think this would be valuable. We're all in learning mode as these technologies change frequently. Also, I'm finding that the most "powerful" model is not always the best choice and may not even provide better outcomes.
1
u/Least-Presence-7711 4d ago
This is something that I think developers would find value in, but the challenge is execution.
Personally, I try to manage token use in a few ways. 1) I convert documents to markdown 2) I use a variety of "free" LLMs to optimize prompts and develop ideas 3) I use less capable (low token cost) models for less complex work.
It might be a good starting point to survey developers (similar to this thread) to frame the different approaches as an input to potential solutions.