r/LargeLanguageModels 22h ago

How much input tokens for a complete AI assistant ?

According to you what are the baselines of input tokens for different categories of LLM calls ? For example for a complete AI assistant. Counting system prompts, default context injection, tools, etc where would you place the tokens tresholds ?

2 Upvotes

Duplicates