Can't we use kiclstarter or other fund raising sites to train a gpt-4 like powerful model?
back
3 comments
I would avoid kickstarter for any AI related work, they made it clear after banning a few projects that they want to push their flavor of AI ethics on creators (e.g. https://updates.kickstarter.com/ai-current-thinking/). IMO we need an alternative infrastructure for organizing and funding these things, since it's clear Big Tech sees AI as a threat and wants to desperately shut it down.
Corporations are raising billions (with a B) of dollars to create and develop AI models. With that money they are buying up every bit of compute they possibly can. I'm not sure what level of funding you're going to get in your actions, but it's not going to be anywhere close to the levels needed.
Which corporations? There were some estimates that GPT-3 cost under 5M$ to train[0].
Anthropic plans to spend $1B on compute to train Claud-Next-10X (10x the size of GPT-4 according to their own leaked documents) over the next 18 months. They also plan to raise $5B over the next 5 years. OpenAI has secured over $10B in funding.
GPT-3 is not GPT-3.5 or GPT-4. Each costs exponentially more than the last in compute and dollars.
This shouldn't be a one-time affair