nvrbegan
Major
★★★
- Joined
- Jan 5, 2024
- Posts
- 2,271
First reason: hardware is overpriced right now, it could be 7x cheaper and would still be profitable. Nvidia is milking their customers until their competitors catch up.
Second: There are a lot of software optimizations possible. In 10 years nobody will do AI like now. A lot of papers and effort engage with this topic.
Third: Current AI is undertrained in relation to their model size, so just by training more (which will become cheaper automatically with better hardware) the models will get better, without raising VRAM or computing requirement.
Fifth: Datasets will become more abundant and easier to obtain and higher quality, just because more people will work on this issue.
Companies used to use whatever they scraped from the web, now they actively create high-quality content specifically intended for AI training, too.
Sixth: specialized AI-hardware. Right now, AI-chips are essentially modified GPUs. GPUs are good at rendering graphic and due to their parallelization they can be used fir linear algebra/vector math too, but if the entire chip were designed from beginning to end with AI and not graphics in mind, a speed-up of maybe 4x or more in the same chip size were possible.
Seventh: other random improvements and fierce competition will drive the development rapidly forward.
Second: There are a lot of software optimizations possible. In 10 years nobody will do AI like now. A lot of papers and effort engage with this topic.
Third: Current AI is undertrained in relation to their model size, so just by training more (which will become cheaper automatically with better hardware) the models will get better, without raising VRAM or computing requirement.
Fifth: Datasets will become more abundant and easier to obtain and higher quality, just because more people will work on this issue.
Companies used to use whatever they scraped from the web, now they actively create high-quality content specifically intended for AI training, too.
Sixth: specialized AI-hardware. Right now, AI-chips are essentially modified GPUs. GPUs are good at rendering graphic and due to their parallelization they can be used fir linear algebra/vector math too, but if the entire chip were designed from beginning to end with AI and not graphics in mind, a speed-up of maybe 4x or more in the same chip size were possible.
Seventh: other random improvements and fierce competition will drive the development rapidly forward.





