That may be true, but it's largely irrelevant. The ML framework in use has no bearing on whether or not you have the data required to reproduce the model being trained with that framework.
back
1 comments
Do you and the GP have 350K GPUs and quality data to reproduce 1:1 whatever Facebook releases in their repos?
Even if you want to reproduce the model and they give you the data, you would need to do this at Facebook scale, so you and the GP are just making moot points all around.
https://about.fb.com/news/2023/05/metas-infrastructure-for-a...
https://www.theregister.com/2024/01/20/metas_ai_plans/
The fact that these models are coming from Meta in the open rather than Google which releases only papers with no model tell's me that Meta's models is open enough for everyone to use.
Besides, everyone using the Pytorch framework benefits Meta in the same way they were originally founded as a company:
Network effects
It's relevant.
There are organisations that are capable of reproduction (e.g. EleutherAI), but yes, you're right, not having the data is largely irrelevant for most users.
The thing that bothers me more is that it's not actually an open-source licence; there are restrictions on what you can do with it, and whatever you do with the model is subject to those restrictions. It's still very useful and I'm not opposed to them releasing it under that licence (they need to recoup the costs somehow), but "open-source" (or even "open") it is not.
If you don’t have a machine powerful enough to compile some heavy AAA game, does that make the game open source?