Centralization of Compute and Data: Difference between revisions
Paul Stein (talk | contribs) No edit summary |
|||
| (21 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
<div> | <div> | ||
== | |||
<p>Advanced AI currently depends on a narrow group of tech giants and semiconductor oligopolies controlling microchips and software, hyperscale cloud infrastructure, large datasets, frontier models, and distribution platforms. This presents a governance problem where this narrow group exercises control over foundational digital infrastructure. This directly affects consumers, businesses, and academia out of AI. Legally and institutionally, this matters because it creates a profound democratic deficit: this neutralizes antitrust frameworks designed for traditional markets, often bypassing conventional copyright and data privacy protections through unchecked data harvesting thereby complicating enforcement.This ultimately might affect national sovereignty as the countries that host the buildout will shape the future of AI: who controls it, what values it contains, how it is used.</p> | == The current governance issue == | ||
<p>Advanced AI currently depends on a narrow group of tech giants<sup>1</sup> and semiconductor oligopolies controlling microchips and software, hyperscale cloud infrastructure, large datasets, frontier models, and distribution platforms. This presents a governance problem where this narrow group exercises control over foundational digital infrastructure. This directly affects consumers, businesses, and academia out of AI. Legally and institutionally, this matters because it creates a profound democratic deficit: this neutralizes antitrust frameworks designed for traditional markets, often bypassing conventional copyright and data privacy protections through unchecked data harvesting thereby complicating enforcement.This ultimately might affect national sovereignty as the countries that host the buildout will shape the future of AI: who controls it, what values it contains, how it is used<sup>2</sup>.</p> | |||
<br> | <br> | ||
== | |||
== Historical lineage == | |||
<p>In 1987, Taiwan Semiconductor Manufacturing Company (TSMC) was founded, establishing the world’s first semiconductor fab. Instead of designing and making its own chips, TSMC only manufactured chips designed by other companies. Today, nearly 100% of the world's most advanced AI processors are manufactured by TSMC, leaving the entire global AI compute supply chain centralized under one company.</p> | <p>In 1987, Taiwan Semiconductor Manufacturing Company (TSMC) was founded, establishing the world’s first semiconductor fab. Instead of designing and making its own chips, TSMC only manufactured chips designed by other companies. Today, nearly 100% of the world's most advanced AI processors are manufactured by TSMC, leaving the entire global AI compute supply chain centralized under one company.</p> | ||
<br><p>In 2006, Nvidia launched CUDA (Compute Unified Device Architecture), a free software layer that allowed developers to use Nvidia's graphics chips (GPUs) which later became perfect for training deep neural networks. Today, this creates a near-monopoly on AI compute hardware.</p> | <br><p>In 2006, Nvidia launched CUDA (Compute Unified Device Architecture), a free software layer that allowed developers to use Nvidia's graphics chips (GPUs) which later became perfect for training deep neural networks. Today, this creates a near-monopoly on AI compute hardware.</p> | ||
<br><p>Soon after Amazon launched AWS, Microsoft and Google launched their own cloud platforms marking the structural pivot to the cloud service provider model, shifting computing from a distributed architecture (where companies bought and managed their own physical servers) to a centralized infrastructure. As training modern AI models requires tens of thousands of GPUs, today’s frontier AI companies are entirely dependent on the extremely expensive physical infrastructure of a handful of cloud hyper-scalers (Microsoft, Google, AWS, and Meta).</p> | |||
<br><p>Soon after Amazon launched AWS<sup>3</sup>, Microsoft and Google launched their own cloud platforms marking the structural pivot to the cloud service provider model, shifting computing from a distributed architecture (where companies bought and managed their own physical servers) to a centralized infrastructure. As training modern AI models requires tens of thousands of GPUs, today’s frontier AI companies are entirely dependent on the extremely expensive physical infrastructure of a handful of cloud hyper-scalers (Microsoft, Google, AWS, and Meta).</p> | |||
<br><p>In 2009, Fei-Fei Li launched ImageNet, a massive database of over 14 million images, which proved that AI model performance scales directly with data volume. This created an immediate institutional advantage for consumer internet platforms (like Google and Meta), because they were already architected to collect, centralize, and store masses of user data through search engines and social networks, they possessed the unique data stack required to train high-performing AI.</p> | <br><p>In 2009, Fei-Fei Li launched ImageNet, a massive database of over 14 million images, which proved that AI model performance scales directly with data volume. This created an immediate institutional advantage for consumer internet platforms (like Google and Meta), because they were already architected to collect, centralize, and store masses of user data through search engines and social networks, they possessed the unique data stack required to train high-performing AI.</p> | ||
<br> | <br> | ||
== Mechanism of path dependence == | |||
<p>The centralization of AI compute and data is a classic case of technological lock-in. When structural choices were made decades ago, they triggered powerful, self-reinforcing loops. One such loop is the switching costs and software standardisation. As developers have spent more than a decade working with CUDA, moving to a rival hardware provider (or a decentralized compute network) requires an enterprise to completely rewrite its foundational software stack. The cost of code migration, developer retraining, and potential hardware downtime force companies to stay tied to dominant hardware monopolies such as Nvidia’s CUDA. Commitments, licensing conditions, and exclusivity provisions add contractual costs. Fewer than 1% of cloud customers switch provider annually, identifying technical differentiation and data-transfer charges as important barriers<sup>4</sup>.</p> | |||
<br><p>Network effects also matter for computing power. More customers generate more revenue, usage information, and opportunities to improve infrastructure and models. Better services attract additional users and developers, whose applications make the platform more valuable. In cloud–AI partnerships, providers may additionally obtain information about model performance and future infrastructure demand. These feedback loops strengthen firms already operating across cloud, models, software, and distribution.</p> | <br><p>Network effects also matter for computing power. More customers generate more revenue, usage information, and opportunities to improve infrastructure and models. Better services attract additional users and developers, whose applications make the platform more valuable. In cloud–AI partnerships, providers may additionally obtain information about model performance and future infrastructure demand. These feedback loops strengthen firms already operating across cloud, models, software, and distribution.</p> | ||
<br> | <br> | ||
== | |||
== Politics and distribution == | |||
<br><p>The specific choice of location may itself be a deliberate preference on account of Texas’ unique approach to water usage rights. Juxtaposition of this unequal and even exploitative balance of interests with the pontificating rhetoric of the urban, information rich, beneficiaries is evocative of the internal contradictions of the Californian Ideology - the virtual artisans existence and privileged position is still based on the exploitation of a vulnerable out-group, the "information-rich" consuming the output, the "information-poor" hosting the extraction.</p> | <p>According to Langdon Winner's definition, modern AI computing infrastructure may qualify as an "inherently political technology" because its large scale and significant financial requirements not only lend themselves to, but necessitate,<sup>5</sup> centralized, hierarchical control. The physical siting of this infrastructure shows evidence of Winner’s second category of politicization of technologies, the ‘political arrangement’:<sup>6</sup> Of the five largest U.S. AI firms, four are headquartered in California,<sup>7</sup> while just one is (partially) domiciled in Texas. Texas, however, hosts twice the GPU clusters.<sup>8</sup> This placement geographically insulates beneficiaries of the data infrastructure boom from its negative externalities.</p> | ||
<br><p>The specific choice of location may itself be a deliberate preference on account of Texas’ unique approach to water usage rights.<sup>9</sup> Juxtaposition of this unequal and even exploitative balance of interests with the pontificating rhetoric of the urban, information rich, beneficiaries is evocative of the internal contradictions of the Californian Ideology - the virtual artisans existence and privileged position is still based on the exploitation of a vulnerable out-group, the "information-rich" consuming the output, the "information-poor" hosting the extraction.<sup>10</sup></p> | |||
<br> | <br> | ||
== Contingency and Alternatives == | == Contingency and Alternatives == | ||
<p>Profit motive and economies of scale now concentrate investment among a few hyperscalers,<sup>11</sup> but this reflects policy choice, not government incapacity: Compute infrastructure may be inherently political, but the technology is agnostic as to where the organizing authority originates, and states have historically funded infrastructure of comparable or greater scale, while facing less pressure to show short-term returns. </p> | |||
<br><p>The clearest turning point was 1995, when the National Science Foundation retired NSFNET, the publicly funded backbone that had connected U.S. research and supercomputing centers since the mid-1980s, handing internet infrastructure to commercial providers with no conditions attached. This was a deliberate policy decision made amid the deregulatory push of the Clinton era. The privatization that followed ushered in the private industrial dominance that persists today in the form of hyperscalers. Had a publicly governed backbone instead been scaled up, today's compute infrastructure might rest on a different foundation entirely.</p> | <br><p>The clearest turning point was 1995, when the National Science Foundation retired NSFNET, the publicly funded backbone that had connected U.S. research and supercomputing centers since the mid-1980s,<sup>12</sup> handing internet infrastructure to commercial providers with no conditions attached. This was a deliberate policy decision made amid the deregulatory push of the Clinton era. The privatization that followed ushered in the private industrial dominance that persists today in the form of hyperscalers. Had a publicly governed backbone instead been scaled up, today's compute infrastructure might rest on a different foundation entirely.</p> | ||
<br> | <br> | ||
== Governance implication == | == Governance implication == | ||
<p>Despite private hyperscaler dominance, the U.S. does have a nominal public alternative: the National AI Research Resource (NAIRR), established following the National AI Initiative Act of 2020 and piloted from January 2024, which explicitly aims to democratize access to the computational resources essential to AI research.<sup>13</sup></p> | |||
<br><p>In Europe, a comparable program is the EuroHPCJU, an initiative intended to pool resources to build supercomputing capacity. The undertaking’s legislative basis has since been extended to include networked ‘AI factories', as well as the so-called “Gigafactories”. The framing in language of sovereignty indicates intent to at least compete with private infrastructure initiatives. </p> | <br><p>In Europe, a comparable program is the EuroHPCJU,<sup>14</sup> an initiative intended to pool resources to build supercomputing capacity. The undertaking’s legislative basis has since been extended to include networked ‘AI factories', as well as the so-called “Gigafactories”.<sup>15</sup> The framing in language of sovereignty indicates intent to at least compete with private infrastructure initiatives. </p> | ||
<br><p>Though government-led measures cannot reverse the centralization of compute, they can democratize access - provided they are intensified. The European Commission has “set a goal of investing more than €1 billion per year in AI research and innovation”. While | <br><p>Though government-led measures cannot reverse the centralization of compute, they can democratize access - provided they are intensified. The European Commission has “set a goal of investing more than €1 billion per year in AI research and innovation”.<sup>16</sup> While laudable in its own right, it pales in comparison to the investments of industry leaders, which are approaching, if not exceeding, trillions of Dollars.</p> | ||
<p> | |||
== References & Notes == | |||
1.Amazon, Google, Meta, Microsoft, and Oracle collectively hold an estimated 71% of the world’s cumulative AI compute as of Q4 2025, measured in H100-equivalents of computing power. <p>Luke Emberson, Josh You and Venkat Somala (2026), "Five hyperscalers now own over two-thirds of global AI compute". Published online at epoch.ai. Retrieved from 'https://epoch.ai/data-insights/hyperscalers-control-most-compute' [online resource]. Accessed 7 Sept 2026.</p> | |||
2. Alasdair Phillips-Robins, Teddy Tawil and Sam Winter-Levy, ‘The Compute Coalition: How to Build the Future of AI in the Free World’ (Carnegie Endowment for International Peace, 8 June 2026) https://carnegieendowment.org/research/2026/06/the-compute-coalition-how-to-build-the-future-of-ai-in-the-free-world accessed 7 September 2026. | |||
3. Amazon Web Services (AWS), a cloud computing platform | |||
4. Competition and Markets Authority, Cloud Infrastructure Services: Final Decision Report (31 July 2025) https://assets.publishing.service.gov.uk/media/688b8891fdde2b8f73469544/final_decision_report.pdf accessed 7 September 2026. | |||
5. Langdon Winner, 'Do Artifacts Have Politics?' (1980) 109(1) ''Daedalus'' 121, 128. | |||
6. Ibid. 123. | |||
7. OpenAI, Anthropic, Google DeepMind, Meta AI. xAI is an exception to the rule, domiciled between Palo Alto, CA and San Antonio, TX. | |||
8. Texas’ 17 to California’s 8, cf. Texas Royalty Brokers, 'AI Clusters by State' (''Texas Royalty Brokers'', 2025) https://texasroyaltybrokers.com/ai-clusters-by-state/ accessed 7 September 2026. | |||
9. The ‘rule of capture’, established in Houston & TC Railway Co v East (Tex 1904), permits landowners to extract groundwater beneath their land without liability for depleting adjacent wells or aquifers, a doctrine now exploited by hyperscale AI data centres to draw large cooling-water volumes with minimal regulatory constraint. | |||
10. Richard Barbrook and Andy Cameron, 'The Californian Ideology' (1996) 6(1) ''Science as Culture'' 44. | |||
11. Goldman Sachs, 'Global AI Investment Is Forecast to Exceed $1 Trillion in 2026' (''Goldman Sachs Insights'', 7 August 2026) https://www.goldmansachs.com/insights/articles/global-investment-is-forecast-to-exceed-1-trillion-in-2026 accessed 7 September 2026. | |||
12. National Science Foundation, 'Birth of the Commercial Internet' (''NSF Impacts'') https://www.nsf.gov/impacts/internet accessed 7 September 2026. | |||
13. CASRAI, 'NAIRR: National AI Research Resource, Explained' (''CASRAI'') https://casrai.org/dictionary/term/national-ai-research-resource-nairr accessed 7 September 2026. | |||
14. Council Regulation (EU) 2021/1173 of 13 July 2021 on establishing the European High Performance Computing Joint Undertaking and repealing Regulation (EU) 2018/1488 [2021] OJ L256/1. | |||
15. Council Regulation (EU) 2026/150 of 16 January 2026 amending Regulation (EU) 2021/1173 on establishing the European High Performance Computing Joint Undertaking [2026] OJ L 2026/150. | |||
16. European Commission, 'Realising Europe's Digital Decade' (''European Commission'', 11 October 2024) https://commission.europa.eu/strategy-and-policy/priorities-2019-2024/story-von-der-leyen-commission/realising-europes-digital-decade_en accessed 7 September 2026. | |||
Latest revision as of 19:49, 8 September 2026
The current governance issue
Advanced AI currently depends on a narrow group of tech giants1 and semiconductor oligopolies controlling microchips and software, hyperscale cloud infrastructure, large datasets, frontier models, and distribution platforms. This presents a governance problem where this narrow group exercises control over foundational digital infrastructure. This directly affects consumers, businesses, and academia out of AI. Legally and institutionally, this matters because it creates a profound democratic deficit: this neutralizes antitrust frameworks designed for traditional markets, often bypassing conventional copyright and data privacy protections through unchecked data harvesting thereby complicating enforcement.This ultimately might affect national sovereignty as the countries that host the buildout will shape the future of AI: who controls it, what values it contains, how it is used2.
Historical lineage
In 1987, Taiwan Semiconductor Manufacturing Company (TSMC) was founded, establishing the world’s first semiconductor fab. Instead of designing and making its own chips, TSMC only manufactured chips designed by other companies. Today, nearly 100% of the world's most advanced AI processors are manufactured by TSMC, leaving the entire global AI compute supply chain centralized under one company.
In 2006, Nvidia launched CUDA (Compute Unified Device Architecture), a free software layer that allowed developers to use Nvidia's graphics chips (GPUs) which later became perfect for training deep neural networks. Today, this creates a near-monopoly on AI compute hardware.
Soon after Amazon launched AWS3, Microsoft and Google launched their own cloud platforms marking the structural pivot to the cloud service provider model, shifting computing from a distributed architecture (where companies bought and managed their own physical servers) to a centralized infrastructure. As training modern AI models requires tens of thousands of GPUs, today’s frontier AI companies are entirely dependent on the extremely expensive physical infrastructure of a handful of cloud hyper-scalers (Microsoft, Google, AWS, and Meta).
In 2009, Fei-Fei Li launched ImageNet, a massive database of over 14 million images, which proved that AI model performance scales directly with data volume. This created an immediate institutional advantage for consumer internet platforms (like Google and Meta), because they were already architected to collect, centralize, and store masses of user data through search engines and social networks, they possessed the unique data stack required to train high-performing AI.
Mechanism of path dependence
The centralization of AI compute and data is a classic case of technological lock-in. When structural choices were made decades ago, they triggered powerful, self-reinforcing loops. One such loop is the switching costs and software standardisation. As developers have spent more than a decade working with CUDA, moving to a rival hardware provider (or a decentralized compute network) requires an enterprise to completely rewrite its foundational software stack. The cost of code migration, developer retraining, and potential hardware downtime force companies to stay tied to dominant hardware monopolies such as Nvidia’s CUDA. Commitments, licensing conditions, and exclusivity provisions add contractual costs. Fewer than 1% of cloud customers switch provider annually, identifying technical differentiation and data-transfer charges as important barriers4.
Network effects also matter for computing power. More customers generate more revenue, usage information, and opportunities to improve infrastructure and models. Better services attract additional users and developers, whose applications make the platform more valuable. In cloud–AI partnerships, providers may additionally obtain information about model performance and future infrastructure demand. These feedback loops strengthen firms already operating across cloud, models, software, and distribution.
Politics and distribution
According to Langdon Winner's definition, modern AI computing infrastructure may qualify as an "inherently political technology" because its large scale and significant financial requirements not only lend themselves to, but necessitate,5 centralized, hierarchical control. The physical siting of this infrastructure shows evidence of Winner’s second category of politicization of technologies, the ‘political arrangement’:6 Of the five largest U.S. AI firms, four are headquartered in California,7 while just one is (partially) domiciled in Texas. Texas, however, hosts twice the GPU clusters.8 This placement geographically insulates beneficiaries of the data infrastructure boom from its negative externalities.
The specific choice of location may itself be a deliberate preference on account of Texas’ unique approach to water usage rights.9 Juxtaposition of this unequal and even exploitative balance of interests with the pontificating rhetoric of the urban, information rich, beneficiaries is evocative of the internal contradictions of the Californian Ideology - the virtual artisans existence and privileged position is still based on the exploitation of a vulnerable out-group, the "information-rich" consuming the output, the "information-poor" hosting the extraction.10
Contingency and Alternatives
Profit motive and economies of scale now concentrate investment among a few hyperscalers,11 but this reflects policy choice, not government incapacity: Compute infrastructure may be inherently political, but the technology is agnostic as to where the organizing authority originates, and states have historically funded infrastructure of comparable or greater scale, while facing less pressure to show short-term returns.
The clearest turning point was 1995, when the National Science Foundation retired NSFNET, the publicly funded backbone that had connected U.S. research and supercomputing centers since the mid-1980s,12 handing internet infrastructure to commercial providers with no conditions attached. This was a deliberate policy decision made amid the deregulatory push of the Clinton era. The privatization that followed ushered in the private industrial dominance that persists today in the form of hyperscalers. Had a publicly governed backbone instead been scaled up, today's compute infrastructure might rest on a different foundation entirely.
Governance implication
Despite private hyperscaler dominance, the U.S. does have a nominal public alternative: the National AI Research Resource (NAIRR), established following the National AI Initiative Act of 2020 and piloted from January 2024, which explicitly aims to democratize access to the computational resources essential to AI research.13
In Europe, a comparable program is the EuroHPCJU,14 an initiative intended to pool resources to build supercomputing capacity. The undertaking’s legislative basis has since been extended to include networked ‘AI factories', as well as the so-called “Gigafactories”.15 The framing in language of sovereignty indicates intent to at least compete with private infrastructure initiatives.
Though government-led measures cannot reverse the centralization of compute, they can democratize access - provided they are intensified. The European Commission has “set a goal of investing more than €1 billion per year in AI research and innovation”.16 While laudable in its own right, it pales in comparison to the investments of industry leaders, which are approaching, if not exceeding, trillions of Dollars.
References & Notes
Luke Emberson, Josh You and Venkat Somala (2026), "Five hyperscalers now own over two-thirds of global AI compute". Published online at epoch.ai. Retrieved from 'https://epoch.ai/data-insights/hyperscalers-control-most-compute' [online resource]. Accessed 7 Sept 2026.
2. Alasdair Phillips-Robins, Teddy Tawil and Sam Winter-Levy, ‘The Compute Coalition: How to Build the Future of AI in the Free World’ (Carnegie Endowment for International Peace, 8 June 2026) https://carnegieendowment.org/research/2026/06/the-compute-coalition-how-to-build-the-future-of-ai-in-the-free-world accessed 7 September 2026.
3. Amazon Web Services (AWS), a cloud computing platform
4. Competition and Markets Authority, Cloud Infrastructure Services: Final Decision Report (31 July 2025) https://assets.publishing.service.gov.uk/media/688b8891fdde2b8f73469544/final_decision_report.pdf accessed 7 September 2026.
5. Langdon Winner, 'Do Artifacts Have Politics?' (1980) 109(1) Daedalus 121, 128.
6. Ibid. 123.
7. OpenAI, Anthropic, Google DeepMind, Meta AI. xAI is an exception to the rule, domiciled between Palo Alto, CA and San Antonio, TX.
8. Texas’ 17 to California’s 8, cf. Texas Royalty Brokers, 'AI Clusters by State' (Texas Royalty Brokers, 2025) https://texasroyaltybrokers.com/ai-clusters-by-state/ accessed 7 September 2026.
9. The ‘rule of capture’, established in Houston & TC Railway Co v East (Tex 1904), permits landowners to extract groundwater beneath their land without liability for depleting adjacent wells or aquifers, a doctrine now exploited by hyperscale AI data centres to draw large cooling-water volumes with minimal regulatory constraint.
10. Richard Barbrook and Andy Cameron, 'The Californian Ideology' (1996) 6(1) Science as Culture 44.
11. Goldman Sachs, 'Global AI Investment Is Forecast to Exceed $1 Trillion in 2026' (Goldman Sachs Insights, 7 August 2026) https://www.goldmansachs.com/insights/articles/global-investment-is-forecast-to-exceed-1-trillion-in-2026 accessed 7 September 2026.
12. National Science Foundation, 'Birth of the Commercial Internet' (NSF Impacts) https://www.nsf.gov/impacts/internet accessed 7 September 2026.
13. CASRAI, 'NAIRR: National AI Research Resource, Explained' (CASRAI) https://casrai.org/dictionary/term/national-ai-research-resource-nairr accessed 7 September 2026.
14. Council Regulation (EU) 2021/1173 of 13 July 2021 on establishing the European High Performance Computing Joint Undertaking and repealing Regulation (EU) 2018/1488 [2021] OJ L256/1.
15. Council Regulation (EU) 2026/150 of 16 January 2026 amending Regulation (EU) 2021/1173 on establishing the European High Performance Computing Joint Undertaking [2026] OJ L 2026/150.
16. European Commission, 'Realising Europe's Digital Decade' (European Commission, 11 October 2024) https://commission.europa.eu/strategy-and-policy/priorities-2019-2024/story-von-der-leyen-commission/realising-europes-digital-decade_en accessed 7 September 2026.