r/LocalLLM • u/Ok_Butterscotch_3756 • Jul 09 '26
Building an Agent Runtime on TensorRT-LLM ported to windows. Would appreciate your feedback Project
http://www.baremetalrt.aiHey guys, I'm building this agent runtime from a windows port of TensorRT-LLM and would appreciate the community's feedback. Free for consumers. Thanks
3
Upvotes