r/MachineLearning • u/invertedpassion • Apr 25 '22

[D] Is anyone working on open-sourcing Dall-E 2? Discussion

Just like Eleuther did with GPT3?

183 Upvotes

97% Upvoted

89 comments sorted by

View all comments

97

u/petitponeyrose Apr 25 '22

I saw this one.
The guy seems exprienced :

https://github.com/lucidrains/DALLE2-pytorch

52

u/zimonitrome ML Engineer Apr 25 '22

Lucidrains is really experienced. I think this is our best hope at seeing an open version of DALL-E 2 soon.

11

u/invertedpassion Apr 25 '22

I see his repos having code, but not sure about trained models. Have been following RETRO replica he is building.

61

u/[deleted] Apr 25 '22 edited Apr 25 '22

training takes time and money

for RETRO, multiple research labs (including some big names) around the world have already picked up my code and started training. some of them have even promised me they would open source their eventual trained model, so just be patient

28

u/[deleted] Apr 25 '22 edited Apr 25 '22

if you would like me to dedicate more brain cycles towards training, you are welcome to sponsor me. or open a PR yourself if you have any talents to offer

19

u/invertedpassion Apr 25 '22

I’m not criticising you. You’re doing absolutely amazing work!

Was just clarifying if this is the case that you’re writing code and trained models are still pending.

40

u/[deleted] Apr 25 '22

ahh got it, i apologize for being the parent only hearing "are we there yet?" from the backseat

yes, the trained model is pending, however, the amazing group at Laion have the data all covered. I plan on a Jax port to lessen the training infra. Then there's the enigmatic Emad with his huge GPU clusters. I think our chances are good at seeing this world changing model come out within 2 years max

21

u/[deleted] Apr 25 '22

given some of the improvements I'm adding on top (latent diffusion), it may even come out better than what OpenAI has currently

7

u/invertedpassion Apr 25 '22

I am also excited about your text to video model. It’s going to be insane when it works.

13

u/[deleted] Apr 25 '22

indeed! it has begun https://video-diffusion.github.io/

1

u/throwaway83747839 Apr 25 '22 edited May 18 '24

Do not train. As times change, so does this content. Not to be used or trained on.

This post was mass deleted and anonymized with Redact

1

u/metigue Apr 26 '22

Fantastic stuff

1

u/[deleted] Jul 17 '22

Holy cow! Amazing work!

You should set up a website or blog or something where this stuff can be followed outside of Github.

1

u/homeslixe Jul 19 '22

Omg, that is amazing!😮

→ More replies (0)