Infrastructure and hardware comprise the physical compute systems, specialized chips, and data center components that power artificial intelligence workloads. Truncated covers chip architectures, supply chains, energy requirements, and the hardware deployments that enable large scale computing.
AI-generated summary Unite.AI reports that AI agents face a near-term infrastructure constraint involving serving costs and memory usage rather than a limit in model intelligence. The source discusses how concurrent agent sessions hold state in GPU memory during wait times, creating economic and hardware challenges for large-scale deployment.
AI-generated summary Cerebras released an engineering documentary detailing the creation of the CS-4 wafer-scale AI system. The film covers lab footage and discussions with engineers regarding topics such as wafer-scale history, cooling, and performance comparisons.
AI-generated summary Intersect360 Research reports that national sovereign AI data centers grew from 1.6 billion dollars in 2023 to 7.2 billion dollars in 2024, with a projected market size of 122.8 billion dollars by 2026. Intersect360 Research found that 56.3 percent of sites keep active HPC-AI compute entirely on-premises while 68.2 percent do the same for their storage.
AI-generated summary HPE and AMD published an architectural white paper outlining eight critical considerations for planning and building an AI gigafactory. The European Commission is working to establish multiple facilities dedicated to training next-generation AI models with trillions of parameters.
AI-generated summary ROCm Blogs reports the release of MONAILabel 0.8.5 as an Early Access release for AMD Instinct GPUs, bringing interactive medical-image annotation support. ROCm Blogs says the implementation enables model inference to run up to 131 times faster than on a host CPU during spleen CT segmentation workloads.
AI-generated summary Rafay Systems offers an orchestration and workflow automation platform that acts as an operational control plane for neoclouds and other compute infrastructure. Mohan Atreya explains that Rafay helps these emerging GPU players move beyond simply selling infrastructure to provide enterprise-grade capabilities.
AI-generated summary McKinsey and Company expects inference models to overtake training by 2030, representing more than half of all artificial intelligence compute. Ciena reports that 81 percent of surveyed decision-makers expect artificial intelligence training to run across distributed facilities.
AI-generated summary AMD has announced the availability of Microsoft's Project Zenith on its Ryzen AI Halo developer platform to bring a preconfigured Windows 11 environment to mini PCs. The hardware features the Ryzen AI Max+ PRO 495 and supports 192GB of LPDDR5X unified memory for local artificial intelligence workloads.
AI-generated summary Expedera announced on November 9, 2026, that it paired its Origin Evolution NPU IP with Cadence’s Tensilica NeuroEdge 130 AI Co-Processor in a pre-silicon simulation. Expedera says the integration is designed to improve performance and efficiency while reducing latency, cost, and complexity across edge nodes, smartphones, automotive systems, and data centers.
AI-generated summary Riot Platforms has signed a 15-year lease agreement with an artificial intelligence lab for capacity at its data center in Corsicana, Texas. Riot Platforms states that the 910MW contract is valued at $28 billion and could expand to $54 billion if extension options are exercised.
AI-generated summary Digital Realty launched a liquid cooling lab in São Paulo, Brazil, to help customers test and validate multi-vendor artificial intelligence infrastructure. The facility is designed for high-density artificial intelligence workloads and features liquid-cooled racks supporting cabinet densities of 150kW and above.
AI-generated summary Photonic chip company Q.ANT has partnered with Ionos to launch a pilot program that lets participants test AI models on Q.ANT hardware. Approved applicants can access the second-generation Native Processing Unit via the Ionos website to run their own workloads.
AI-generated summary Running local AI models requires varying amounts of hardware memory and processing power depending on model size. OpenAI says its gpt-oss-20b model runs with 16 GB of memory, while larger models need significantly more resources.
AI-generated summary A lawyer built a private artificial intelligence server using eight used Nvidia V100 graphics processing units to keep case files offline. The system runs the DeepSeek V4.1 Flash model at up to 215 tokens per second while costing about $2,400 per four-board setup.
AI-generated summary AMD announced an expanded collaboration with Google Cloud utilizing 5th Gen AMD EPYC processors. AMD says these processors power host infrastructure for Google Cloud TPU 8tx and help protect sensitive AI models.
AI-generated summary CoreWeave announced a multi-year agreement with Wayve to power its artificial intelligence driver training using CoreWeave Cloud with NVIDIA Blackwell GPUs. Wayve says the cloud infrastructure helps accelerate the commercial deployment of its artificial intelligence driver by providing reliability and observability.
AI-generated summary Google Cloud says dynamic slicing is generally available on Google Kubernetes Engine to run large-scale AI workloads on TPU infrastructure. Google Cloud says the feature reduces AI workload startup times by up to 5x and workload recovery by 4.5x.
AI-generated summary The Nvidia GeForce RTX 3090 offers 24 GB of VRAM, making it a capable hardware choice for running local large language models and other AI workloads. While the Nvidia GeForce RTX 3090 is no longer in production, it provides an alternative for users seeking memory capacity comparable to newer cards like the RTX 5070 Ti, RTX 5080, and RTX 5090.
AI-generated summary Alphabet Inc.'s Google is releasing new versions of its custom tensor processing units to compete with Nvidia Corp. in the artificial intelligence market. The latest chips are designed to support confidential computing and help models access a wider range of information for handling user queries.
AI-generated summary Microsoft is reportedly exiting a 2023 compute capacity agreement with Oracle that utilized older Nvidia hardware to power an AI-assisted version of the Bing search engine. According to Bloomberg, Microsoft declined to renew the contract because the older hardware did not meet its current specifications.
The top AI news in your email delivered each morning. Choose categories