Meta’s New AI Chips Explained: What are MTIA 300, 450, and 500?
Recently, Meta has introduced an expansive plan for the growth of four AI chips that are designed for in-house use. The new silicon plans would further the company‘s use of artificial intelligence. These in-house chips will increase the performance and intelligence of the AI usage within Meta. From social network sites to virtual reality, Meta will take these assets and use the custom designed chips to improve the performance and efficiency of the chips. As Meta proves to be a major company in the application of artificial intelligence, especially with these four upcoming chips, they may be the forerunners in this growing tech segment of the future.
1. The “What”: A Custom Brain for Apps
Imagine that a computer has a “brain”. The vast majority of companies purchase their brains from a shop (a company named Nvidia). Meta has decided to produce its own bespoke brains called MTIA.
MTIA 300:. First version. It‘s already running at Facebook now.
MTIA 450 & 500: These are the “next-gen” brains coming and they are going to be a lot faster and smarter.
2. The “How”: Training vs. Inference
This is the most important part to understand. AI has two stages:
Training (The School Phase): the stage when the AI “studies” by scrolling billions of of images or books. It takes huge power and months of time.
Inference (The Working Phase): This is when the AI is applying what it has learned. When you ask the chatbot a question or when Instagram recommends a video, this is Inference.
Meta‘s Trick: They‘ve designed their new chips designed to be Inference specialists so they‘d like the working phase to be super fast and very low cost to run.
3. The “Why”: Saving Money and Gaining Control
For what purpose would you bother to make your own?
It‘s Cheaper: By renting an all in one packaging for your chips, it‘s like you are putting rental payments on the car. Building your own, is like buying the car, an expensive way to start, but more economical in the long term.
It‘s Faster: Meta made these chips just to run Facebook and Instgram, so they “know” precisely how to treat that set of applications better than a “general” chip you can buy at a store.
No Waiting in Line: Since AIs chips currently are scarce worldwide, Meta won‘t have to wait for other companies to ship them some, as they will produce them in house.
4. The “Where”: Secret Data Centers
Don‘t look for these chips in your phone or PC. They reside in huge, football-field-sized buildings called Data Centers. There are many of these MTIA chips in each of these buildings.
They are working 24/7 behind the scenes to determine what ad you see, what Reel plays next and how the Meta AI chatbot responds to your questions.
Check out our resources!
Free E-Books: Download your Free E-Books here.
Bootstrap Templates: Explore our Bootstrap Projects section.
