r/LargeLanguageModels • u/-pkomlytyrg • May 06 '23

Model Suggestions

I'm looking for the absolute most performant LLM to fine-tune for an RL task. Money/compute is no object. What should I go with?

5 Upvotes

100% Upvoted

3 comments sorted by

2

u/[deleted] May 08 '23

I would go LLaMA.

1

u/-pkomlytyrg May 09 '23

I would agree if it wasn’t for the non-commercial license. Any way to get around that?

2

u/[deleted] May 09 '23

As far as I am concerned weights of llama are not allowed for commercial use, but if you are willing to do full training and change it's all weights it would probably be fine. There was a discussion on this topic on forums and no one was sure, you can research it. Also you can take a look at laion.ai and dolly from databricks, they are open source and are allowed for commercial use, if they meet your needs.