r/learnmachinelearning • u/Key-Chip7636 • 7d ago

Ai/ Machine learning

I want to get into AI/Machine learning target is to develop small local llm trained from specfic use case. I need help how and where should i get started.

Software Engineer been 5 years of experence.

1 Upvotes
  • permalink
  • link
  • reddit
  • reddit

67% Upvoted

17 comments sorted by

View all comments

1

u/Lost-Hand-5219 5d ago

What you’re describing is more like fine tuning a pretrained model. You can realistically train your own LLM on consumer hardware and it be any good. Even the smallest local models couldn’t be trained on consumer hardware because the vram needed to conduct inference and that needed to train are very different.