AI Inception for Lower Costs and Compressed Models

The Stanford Alpaca AI demonstrated the use of a larger and more expensive AI model to train a smaller and cheaper model. The cheaper model was as good and in come cases better than the more expensive model. The more expensive AI model generated vast amounts of better training data to improve the smaller model.…
AI Inception for Lower Costs and Compressed Models


The Stanford Alpaca AI demonstrated the use of a larger and more expensive AI model to train a smaller and cheaper model. The cheaper model was as good and in come cases better than the more expensive model. The more expensive AI model generated vast amounts of better training data to improve the smaller model. This lowered the cost of training by about one thousand times. This could be a form of AI compression. A smaller AI model could, for example, use twenty times less parameters to fit onto cheaper hardware.

This might allow superior Tesla FSD (Full Self Driving) performance on hardware 3 delaying the need for customers to upgrade to more costly hardware 4 or hardware 5 to achieve acceptable robotaxi performance.

Read More

Total
0
Shares
Leave a Reply

Your email address will not be published.

Related Posts
Tesla Will Have Abundant 4680 Batteries in a Few Years
Read More

Tesla Will Have Abundant 4680 Batteries in a Few Years

Elon Musk told his Tesla Nevada team that the new $3.6 billion Semi truck and 4680 factory will start with a 100 GWh/year production target but in the long term will expand to 500 GWh/year. This will be part of Tesla producting 1000-3000 GWh/year of 4680 batteries in total from Austin, Berlin, Shanghai and Nevada.…
Super Technology of the 2020s: Narrow Super AI, Molecular Electronics, Atom Technology
Read More

Super Technology of the 2020s: Narrow Super AI, Molecular Electronics, Atom Technology

There has and will be substantial development of major super technologies this decade. There have been several major things with AI. We are in the age of narrow superintelligence. Here are some definitions for different categorizations of AI. Artificial narrow intelligence (ANI) has a narrow range of abilities. Artificial narrow superintelligence (ANSI) has a narrow…
IonQ Quantum Computers Versus Skeptics
Read More

IonQ Quantum Computers Versus Skeptics

IonQ has received over $400 million in funding from Venture capitalists and an IPO. They presented their work at the 2021 QBWare conference. I, Brian Wang, will go going to the 2022 QBWare conference. IonQ indicates that their near term quantum computing systems can reach qubit fidelity of 99.98%. This means they are close to…
4 Cybersecurity Predictions For 2030
Read More

4 Cybersecurity Predictions For 2030

In the last couple of years, companies have started to pay more attention to cybersecurity. Allocated budgets have increased, and that is reflected in the overall cyber market. By 2030, the market is expected to reach around 538 billion U.S. dollars. The way cyber risks are perceived has taken a new shape as well. Namely,…