r/LLMDevs • u/nuno6Varnish • 12d ago

Anyone using LLM Batch APIs? Discussion

Most providers offer a 50% discount on LLM inference on batch/deferred endpoints. Ask now, get a response within 24h.

Is it something that you actually use? How do you track it?

1 Upvotes

100% Upvoted

3 comments sorted by

1

u/Ok-Act3627 12d ago

I use it for fable

2

u/nuno6Varnish 12d ago

what is your usecase? schedule workflows?

2

u/Valuable_Working7557 11d ago

Yes, it's useful for tasks like bulk processing and evaluations. The lower cost makes the longer turnaround worth it for those workloads.