Despite intense AI arms race, we’re in for a multi-modal future

Share This Post


Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


Every week — sometimes every day—a new state-of-the-art AI model is born to the world. As we move into 2025, the pace at which new models are being released is dizzying, if not exhausting. The curve of the rollercoaster is continuing to grow exponentially, and fatigue and wonder have become constant companions. Each release highlights why this particular model is better than all others, with endless collections of benchmarks and bar charts filling our feeds as we scramble to keep up.

The number of large foundation models released each year has been exploding since 2020
Charlie Giattino, Edouard Mathieu, Veronika Samborska and Max Roser (2023) – “Artificial Intelligence” Published online at OurWorldinData.org.

Eighteen months ago, the vast majority of developers and businesses were using a single AI model. Today, the opposite is true. It is rare to find a business of significant scale that is confining itself to the capabilities of a single model. Companies are wary of vendor lock-in, particularly for a technology which has quickly become a core part of both long-term corporate strategy and short-term bottom-line revenue. It is increasingly risky for teams to put all their bets on a single large language model (LLM).

But despite this fragmentation, many model providers still champion the view that AI will be a winner-takes-all market. They claim that the expertise and compute required to train best-in-class models is scarce, defensible and self-reinforcing. From their perspective, the hype bubble for building AI models will eventually collapse, leaving behind a single, giant artificial general intelligence (AGI) model that will be used for anything and everything. To exclusively own such a model would mean to be the most powerful company in the world. The size of this prize has kicked off an arms race for more and more GPUs, with a new zero added to the number of training parameters every few months. 

Deep Thought, the monolithic AGI from the Hitchhiker’s Guide to the Universe
BBC, Hitchhiker’s Guide to the Galaxy, television series (1981). Still image retrieved for commentary purposes.

We believe this view is mistaken. There will be no single model that will rule the universe, neither next year nor next decade. Instead, the future of AI will be multi-model. 

Language models are fuzzy commodities 

The Oxford Dictionary of Economics defines a commodity as a “standardized good which is bought and sold at scale and whose units are interchangeable.” Language models are commodities in two important senses: 

  1. The models themselves are becoming more interchangeable on a wider set of tasks; 
  2. The research expertise required to produce these models is becoming more distributed and accessible, with frontier labs barely outpacing each other and independent researchers in the open-source community nipping at their heels. 
Commodities describing commodities (Credit: Not Diamond)

But while language models are commoditizing, they are doing so unevenly. There is a large core of capabilities for which any model, from GPT-4 all the way down to Mistral Small, is perfectly suited to handle. At the same time, as we move towards the margins and edge cases, we see greater and greater differentiation, with some model providers explicitly specializing in code generation, reasoning, retrieval-augmented generation (RAG) or math. This leads to endless handwringing, reddit-searching, evaluation and fine-tuning to find the right model for each job. 

AI models are commoditizing around core capabilities and specializing at the edges. Credit: Not Diamond

And so while language models are commodities, they are more accurately described as fuzzy commodities. For many use cases, AI models will be nearly interchangeable, with metrics like price and latency determining which model to use. But at the edge of capabilities, the opposite will happen: Models will continue to specialize, becoming more and more differentiated. As an example, Deepseek-V2.5 is stronger than GPT-4o on coding in C#, despite being a fraction of the size and 50 times cheaper. 

Both of these dynamics — commoditization and specialization — uproot the thesis that a single model will be best-suited to handle every possible use case. Rather, they point towards a progressively fragmented landscape for AI. 

Multi-modal orchestration and routing

There is an apt analogy for the market dynamics of language models: The human brain. The structure of our brains has remained unchanged for 100,000 years, and brains are far more similar than they are dissimilar. For the vast majority of our time on Earth, most people learned the same things and had similar capabilities. 

But then something changed. We developed the ability to communicate in language — first in speech, then in writing. Communication protocols facilitate networks, and as humans began to network with each other, we also began to specialize to greater and greater degrees. We became freed from the burden of needing to be generalists across all domains, to be self-sufficient islands. Paradoxically, the collective riches of specialization have also meant that the average human today is a far stronger generalist than any of our ancestors. 

On a sufficiently wide enough input space, the universe always tends towards specialization. This is true all the way from molecular chemistry, to biology, to human society. Given sufficient variety, distributed systems will always be more computationally efficient than monoliths. We believe the same will be true of AI. The more we can leverage the strengths of multiple models instead of relying on just one, the more those models can specialize, expanding the frontier for capabilities. 

 Multi-model systems can allow for greater specialization, capability and efficiency. Source: Not Diamond

An increasingly important pattern for leveraging the strengths of diverse models is routing — dynamically sending queries to the best-suited model, while also leveraging cheaper, faster models when doing so doesn’t degrade quality. Routing allows us to take advantage of all the benefits of specialization — higher accuracy with lower costs and latency — without giving up any of the robustness of generalization.

A simple demonstration of the power of routing can be seen in the fact that most of the world’s top models are themselves routers: They are built using Mixture of Expert architectures that route each next-token generation to a few dozen expert sub-models. If it’s true that LLMs are exponentially proliferating fuzzy commodities, then routing must become an essential part of every AI stack. 

There is a view that LLMs will plateau as they reach human intelligence — that as we fully saturate capabilities, we will coalesce around a single general model in the same way that we have coalesced around AWS, or the iPhone. Neither of those platforms (or their competitors) have 10X’d their capabilities in the past couple years — so we might as well get comfortable in their ecosystems. We believe, however, that AI will not stop at human-level intelligence; it will carry on far past any limits we might even imagine. As it does so, it will become increasingly fragmented and specialized, just as any other natural system would. 

We cannot overstate how much AI model fragmentation is a very good thing. Fragmented markets are efficient markets: They give power to buyers, maximize innovation and minimize costs. And to the extent that we can leverage networks of smaller, more specialized models rather than send everything through the internals of a single giant model, we move towards a much safer, more interpretable and more steerable future for AI. 

The greatest inventions have no owners. Ben Franklin’s heirs do not own electricity. Turing’s estate does not own all computers. AI is undoubtedly one of humanity’s greatest inventions; we believe its future will be — and should be — multi-model. 

Zack Kass is the former head of go-to-market at OpenAI.

Tomás Hernando Kofman is the co-Founder and CEO of Not Diamond. 

DataDecisionMakers

Welcome to the VentureBeat community!

DataDecisionMakers is where experts, including the technical people doing data work, can share data-related insights and innovation.

If you want to read about cutting-edge ideas and up-to-date information, best practices, and the future of data and data tech, join us at DataDecisionMakers.

You might even consider contributing an article of your own!

Read More From DataDecisionMakers



Source link

Related Posts

- Advertisement -spot_img
pola maxwin mahjong ways 2maxwin gates of gatot kacacara baca rtp mahjong ways 2jackpot scatter hitam mahjong winssabung ayam onlinesabung ayam onlinesabung ayam onlinejudi bola onlinesabung ayam onlinetrik rahasia mahjong ways 2 modal spin manual 200 perak scatter turun selayar bro auto cuan puluhan jutamain santai pakai pola ini sweet bonanza pecahkan bom x1000 scater warna warni kasih cuan gede brostrategi tak terduga spin mahjong wins 3 cuma modal depo 50k scatter hitam pecah joko dapat cuan besar claim wede rp.210.220.115 langsung cair ke rekeningpanen cuan pakai trik ini bocoran pola gates of olympus ala admin wahanabet bikin geger semua serverkupas tuntas kombinasi maut pola mahjong ways 3 viral cuan puluhan jutatrik ini bikin mahjong ways jadi viral bro vina nekat spin turbo raup cuan puluhan juta dalam semalamSV388SBOBET88CASINO ONLINEZEUS SLOTSABUNG AYAM ONLINEMIX PARLAY SBOBETLIVE CASINO ONLINESCATTER HITAMsabung ayam onlinesabung ayam onlinesabung ayam onlinesabung ayam onlineMix parlaySabung Ayam OnlineSabung Ayam OnlineSabung Ayam OnlineSabung Ayam OnlineSabung Ayam OnlineSabung Ayam Onlineいきがい活動ステーション Accesscara pemain cerdas menang stabil di mahjong wayscara pemain mahjong ways 3 dapat scatter tanpa ribetpola ampuh pahami trik kuasai rtp agar menang
SV388SV388JUDI BOLA ONLINESBOBET88sabung ayam onlinejudi bola onlinelive casino onlinejudi bola onlinesabung ayam onlinelive casino onlineungkap pola misterius mahjong ways jarwo dikasih menang rp.221.330.110 cuma spin manual x10trik nekat modal 55 ribu login mahjong ways 2 stella menang rp.110.500.300 saldo langsung cair via danawahanabet ungkap trik dapat cuan besar disemua game online hingga bocoran pola & rtp tinggistrategi ampuh candy pops sweet bonanza kombinasi pola & rtp 98.21% trik ledakan bom x1000 auto cuanhokimu tiba hari ini budi main wild bandito hanya modal 100 ribu abaikan rtp cukup pakai trik ini 15x putaran langsung wedepola klasik gates of olympus trik jitu yang satu ini gak ada matinya depo 45 ribu masih worth it brosabung ayam onlinesabung ayam onlinesabung ayam onlineSBOBET88sabung ayam onlineindopromaxindopromaxindopromaxindopromaxindopromaxindopromaxindopromaxindopromaxSabung Ayam OnlineSabung Ayam OnlineSabung Ayam Onlinejudi bola onlinejudi bolajudi bolasabung ayam onlinesabung ayam onlinesabung ayam onlinelive casino online sabung ayam slot mahjong judi bola SV388jUDI BOLASBOBET88SBOBET88WS168LIVE CASINO ONLINESBOBET88SV388SEXYGAMINGINDOBALI88SABA SPORTSV388LIVE CASINOSV388Mahjong WaysSABUNG AYAM ONLINELive Casino OnlineSabung Ayam onlinemahjong ways 2sabung ayam onlinejudi bola onlinelive casino onlineslot gacor mahjongslot gacor mahjongslot gacor mahjongslot gacor mahjongLIVE CASINO ONLINESBOBETSABUNG AYAM ONLINESABUNG AYAM ONLINECASINO ONLINECASINO ONLINELIVE CASINO ONLINEJUDI BOLALIVE CASINO ONLINEMAHJONGSABUNG AYAM ONLINESITUS JUDI BOLASABUNG AYAM ONLINELIVE CASINO ONLINESLOT MAHJONGlive casinomix parlaymix parlaysabung ayam onlinelive casinomix parlaysabung ayam onlinesabung ayam onlinemix parlaysabung ayam onlinemix parlaysabung ayam onlinemix parlayparlaysitus live casinojudi bolaSabung Ayam OnlineSabung Ayam OnlineSabung Ayam OnlineSABUNG AYAMJUDI BOLALIVE CASINOSLOT MAHJONGMAHJONG WAYSJUDI BOLA ONLINESABUNG AYAM ONLINESWEET BONANZASLOT ZEUSSV388JUDI BOLA ONLINEJUDI BOLA ONLINEJUDI BOLA ONLINESABUNG AYAM ONLINELIVE CASINO ONLINESITUS SLOT ONLINEPRAGMATIC PLAYMAHJONG WAYSJudi BolaLive Casino OnlineSabung Ayam onlinemahjong ways 2Judi Bolamahjong ways 2mahjong wins 3gates of olympussweet bonanzastarlight princesssbobetsv388agen baccaratsabung ayam onlinejudi bola onlinejudi bola onlinesabung ayam onlinemahjong ways 2mahjong wins 3lucky nekosweet bonanzastarlight princessjudi bola onlinesabung ayam onlineagen casino onlinecasino onlinejudi bola onlinesabung ayam onlinecasino onlinejudi bola onlinejudi bola onlinesabung ayam onlinecasino onlineslot gacor mahjonglive casino onlinesabung ayam onlinesabung ayam onlinecasino onlineslot gacor mahjongsabung ayam onlinejudi bola onlinejudi bolasabung ayam onlineindobit88live casino onlinesv388sabung ayam onlineCasino Onlinesabung ayam onlineMix Parlaycasino onlineMahjong Wayssabung ayam onlinejudi bola onlinesabung ayam onlinemix parlay
analisis pola spin mahjong ways untuk menang konsistenwild mahjong ways 3 ajarkan cara hadapi tantangan hidupputaran maxwin mahjong ways 2mengenal pola sukses mahjong wins 3strategi maxwin pemain mahjong wayspola campuran gate of olympusmenang pragmatic play pakai pola indojawa88strategi ammar menang mahjong ways 2bangkit dari kerugian berkat mahjong wins 3strategi Jackpot main clover goldJUDI BOLA ONLINESABUNG AYAM ONLINELIVE CASINO ONLINESLOT MAHJONGMAHJONG WAYS 2judi bola onlinejudi bola onlineslot mahjong wayssv388sbobet88live baccarat onlinesbobet mix parlaycara spin mahjong ways ala admin wahanabet tips mantul cuan tipis tapi lancar tanpa hambatanmenang rp.142.250.331 pakai kombinasi duo maut denny spill trik dapat cuan dari treasures of aztec modal bet cuma 400 perakSabung Ayam Onlinejudi bola onlinemahjong wayssabung ayam onlinesabung ayam onlinesabung ayam onlinesabung ayam onlinejudi bolaslot mahjongsv388judi bolasabung ayam onlineungkap rahasia scatter mahjong wayskiat sukses pemain gates of olympustrik dan strategi kuasai rtp mahjong winspola lonceng emas queen of bountystrategi scatter hitam mahjong ways 2maxwin scatter hitam indojawa88
slot mahjong wayssabung ayam onlinejudi bola onlinesabung ayam onlinelive casino onlinejudi bola onlinesabung ayam onlinelive casino onlineSABUNG AYAM ONLINESBOBET88LIVE CASINO ONLINEMAHJONG WAYS 2JUDI BOLA ONLINESBOBET88SBOBETsv388sbobet88ws168sbobet mobilemahjong waysmodal nekat cuan dahsyat pakai pola ini spin sweet bonanza bisa menang puluhan jutajangan salah langkah main mahjong ways pakai trik ini scatter hitam pasti pecah terusSabung Ayam OnlineSabung Ayam OnlineSabung Ayam OnlineSabung Ayam OnlineSabung Ayam OnlineLAB Official Work PageGalleria Pallesi Official SitePITAC Official ContactSOBER ICT Official Contactsabung ayam onlinesabung ayam onlinesabung ayam onlinesabung ayam onlinesabung ayam onlinesabung ayam onlineSBOBETLIVE CASINO ONLINESBOBET88LIVE CASINO ONLINEJUDI BOLASABUNG AYAM ONLINESLOT MAHJONGLIVE CASINO ONLINESABUNG AYAM ONLINEMIX PARLAYCASINO ONLINESLOT MAHJONGSABUNG AYAM ONLINESBOBET88SABUNG AYAM ONLINELIVE CASINO ONLINELIVE CASINO ONLINESABUNG AYAM ONLINESABUNG AYAM ONLINELIVE CASINO ONLINELIVE CASINO ONLINEAGEN JUDI BOLACASINO ONLINESLOT MAHJONGsabung ayam onlinemix parlaymix parlaymix parlaysabung ayam onlinemix parlaymix parlaysabung ayam onlinelive casinoSV388SBOBET88CASINO ONLINEPG SOFTSLOT GACORJUDI BOLA ONLINESITUS JUDI BOLASITUS JUDI BOLASABUNG AYAM ONLINEJUDI BOLA ONLINECASINO ONLINESLOT MAXWINSLOT GACORSBOBETSLOT MAHJONG WAYSSLOT KAKEK ZEUSSLOT SPACEMANBANDAR BOLAJUDI BOLASABUNG AYAMMEGA WHEELSLOT 4DSV388MAHJONG WAYSsabung ayam onlinejudi bola onlinelive casino onlineslot mahjonglive casino onlineslot mahjongsabung ayam onlinejudi bola onlinelive casino onlineslot mahjongJudi BolaLive Casino OnlineSabung Ayam onlineSlot Mahjong Gacorjudi bolaslot mahjonglive casinoindobit88slot onlineagen judi bolasabung ayam onlinejudi bolatogel onlinesbobet88sbobet88Mix Parlaycasino onlineMix ParlaySV388Judi Bola OnlineMahjong WaysSabung Ayam Onlinesabung ayam onlinejudi bola onlinemahjong ways 2slot mahjong waysmahjong ways 2mahjong wins 3lucky nekosweet bonanzastarlight princesssbobetsabung ayam onlineagen casinosabung ayam onlinejudi bola onlinesabung ayam onlinejudi bola onlinemahjong ways 2mahjong wins 3starlight princesssweet bonanzagates of olympussabung ayam onlinesbobetagen casinoSLOT ZEUSSABUNG AYAM ONLINESABUNG AYAM ONLINELIVE CASINOSLOT MAHJONGcasino onlineslot zeusjudi bola onlinesabung ayam onlinesabung ayam onlinecasino onlineMIX PARLAYSV388INDOBALI88SABUNG AYAM ONLINESBOBET88WS168CASINO ONLINESBOBET88MIX PARLAYJUDI BOLAMAHJONG WAYS 2MAHJONG WAYSMAHJONG WINS 3POLA MAHJONG WAYSSITUS MAHJONG WAYS 2
Nusa Islands Bali Official PackagesTrinidad and Tobago Pilots’ Association Official About Pagemaxwin mahjong wins 3strategi main gates of olympuskuasai pola rtp pragmatic playlangkah mendapatkan scatter emaspola rtp pg soft indojawa88Green Gold Mountain Official SiteKomite SMKN 1 Tanjung Jabung Barat Official Sitetutorial maxwin mahjong waysstrategi rtp mahjong waysEIKON Official Policieskontak situs pecinta ayamNusa Islands Bali Official ContactCitraLand Surabaya Official NewsLenterakita About PageVinayak Group Official SiteI Think An Idea Official SitePITAC Official SitePortfolioSitez Official SiteMedical LTD Official SiteCapworks Official SiteMartino & Luth Official SiteTech With Mike First Official SiteSahabat Tiopan Official SiteE-Sekolah CBT Official SiteBDF Ventura Official SiteOcean E Soft Official SiteArab DMC Official SiteBBC Noun Official SiteCang Vu Hai Phong Official SiteThe Flat Official SiteThe Black Sheep Official SiteCEM Argentina Official SiteSlot MahjongTop Dawg Tavern Official SiteKelas Nesfatin Official SiteDuhoc Interlink Official SiteKarunia Inda Med Mandiri Official SiteJFV Pulm Official SiteRatiohead Official SiteAskona Official SiteMAN Surabaya E-Learning Official SiteShaker Group Official SiteTakaKawa Shoten Official SiteBrydan Solutions Official SiteConcursos Rodin Official SiteEHOB Official SiteConmou Official SiteCareer Wings Official SiteMontero Espinosa Official SiteBDF Ventura Official SiteDesa Sangginora Official SiteBDF Ventura Official SiteTaruna Akademia Official SiteAkura Official SiteMUI Ciamis Official SiteNamulanda Technical Institute Official Site