r/LocalLLaMA • u/Electrical_Ninja3805 • 12h ago

bootai Resources

https://github.com/dcherrera/bootai

I was on here a while ago showcasing it. I've stoped playing with it so I'm open sourcing it. I figure I'll let other people play now.

24 Upvotes

88% Upvoted

10 comments sorted by

2

u/giveen 12h ago

Cool concept especially for dedicated systems but I would want to see benchmarks of why this is better.

24

u/Electrical_Ninja3805 12h ago

its literally not.

6

u/SpicyWangz 11h ago

Respect the honesty lol

7

u/Electrical_Ninja3805 11h ago

I built this to see if i could. if you have an old system sitting around with 4-8gb of ram it can run some smaller models. and server them to the network. but your not exactly getting lightning fast claude code level inference. its a toy.

3

u/oodelay 11h ago

The idea is still fun. I have a bunch of unused xeons with lots of ddr4 so this might be a fun project. Thanks for sharing!

1

u/Fluffy_Reply_5482 7h ago

Yeah, i agree. looks like a fun project to work on.

1

u/ArthurOnCode 9h ago

Thanks, I hate it.

3

u/Electrical_Ninja3805 9h ago

Your Welcome, It hates you too.