GPUs are specialized microprocessors used to train and run artificial intelligence models efficiently. Truncated covers hardware supply chains, production capacities, allocation strategies and industry demand.
AI-generated summary Moonshot AI accessed a collection of Nvidia Corp. chips this summer according to regulatory filings in Beijing. The startup signed an agreement in August to rent servers featuring Nvidia accelerators from Super Micro Computer Inc.
AI-generated summary Microsoft has filed a patent detailing a system that would enable PC gamers to share idle GPU processing power for artificial intelligence training. The patent application describes monitoring hardware resources to distribute tasks and potentially compensating participating users with credits or money.
AI-generated summary ROCm Blogs reports the release of MONAILabel 0.8.5 as an Early Access release for AMD Instinct GPUs, bringing interactive medical-image annotation support. ROCm Blogs says the implementation enables model inference to run up to 131 times faster than on a host CPU during spleen CT segmentation workloads.
AI-generated summary Red Hat Developer Hub 2.1 introduces AI-assisted workflows and renames Red Hat Developer Lightspeed for Developer Hub to the context-aware Red Hat Developer Hub intelligent assistant. Red Hat OpenShift 5 introduces Model Context Protocol capabilities to provide AI agents safe access to platform resources.
AI-generated summary A lawyer built a private artificial intelligence server using eight used Nvidia V100 graphics processing units to keep case files offline. The system runs the DeepSeek V4.1 Flash model at up to 215 tokens per second while costing about $2,400 per four-board setup.
AI-generated summary CoreWeave announced a multi-year agreement with Wayve to power its artificial intelligence driver training using CoreWeave Cloud with NVIDIA Blackwell GPUs. Wayve says the cloud infrastructure helps accelerate the commercial deployment of its artificial intelligence driver by providing reliability and observability.
AI-generated summary China's Foreign Ministry repeated its denial of a reported spy allegation involving Nvidia chief executive Jensen Huang and called it a smear against China. Nvidia shares dropped 5.0% to $177.32 in premarket trading following reports regarding national security concerns and chip import restrictions.
AI-generated summary The Nvidia GeForce RTX 3090 offers 24 GB of VRAM, making it a capable hardware choice for running local large language models and other AI workloads. While the Nvidia GeForce RTX 3090 is no longer in production, it provides an alternative for users seeking memory capacity comparable to newer cards like the RTX 5070 Ti, RTX 5080, and RTX 5090.
AI-generated summary Microsoft is reportedly exiting a 2023 compute capacity agreement with Oracle that utilized older Nvidia hardware to power an AI-assisted version of the Bing search engine. According to Bloomberg, Microsoft declined to renew the contract because the older hardware did not meet its current specifications.
AI-generated summary InfoQ reports on optimizing distributed AI inference using llm-d and vLLM on Kubernetes to manage cache locality and batch inference. Edoardo Vacchi discusses running Java workloads on GPUs using TornadoVM and the evolving landscape of WebAssembly on the backend.
AI-generated summary Israel plans to build its own artificial intelligence infrastructure to reduce its dependence on foreign technology companies. The strategy includes establishing a base of around 300,000 graphics processing units and developing a domestic foundation model.
AI-generated summary The author argues that Apple designed the 2,899 dollar MacBook PROLED as a luxury device with a unified memory bottleneck rather than a computer built for local artificial intelligence. The reviewer suggests that power users focused on local workloads should instead consider Windows alternatives featuring Nvidia RTX Spark and AMD Strix Halo chips.
AI-generated summary SK hynix Inc. plans to expand its U.S. workforce to strengthen relationships with key clients including Nvidia Corp., according to its parent company. The chipmaker appointed Ahn Hyun to oversee U.S. operations as part of changes following an executive reshuffle at SK Group.
AI-generated summary A new analysis measures how much instruction-level speedup survives across layers like libraries and shared devices on AMD hardware including the MI300A and MI250X. The research traces metrics from ISA microbenchmarks through hipBLASLt and hipSPARSELt to large language model inference and mixed-precision HPL.
AI-generated summary A report evaluating the Locality Domain feature introduced in CUDA 13.4 examines multi-die scaling, data placement, and cross-die communication on NVIDIA Blackwell GPUs. The study demonstrates that die-aware adaptations achieve significant speedups for tools including NCCL 2.32.3, nvbandwidth, and DeepGEMM, while also identifying memory allocation overheads.
AI-generated summary AI data centers are consuming memory supplies and driving up costs for consumer graphics processing units. JP Morgan reports that dynamic random access memory prices will rise by 400 percent by the end of 2026 compared to 2024 levels.
AI-generated summary Police suspect that sophisticated thieves stole $11.4 million worth of Nvidia equipment that was supposed to ship from Oakland to Fort Worth, Texas. The theft follows several incidents over the past year involving Nvidia and other companies connected to the artificial intelligence data center buildout.
AI-generated summary The 2.15 release of PyTorch introduces a rewritten backend for Nvidia's Collective Communications Library to improve fault diagnosis and recovery when multiple GPUs work together. The updated software includes a flight recorder to capture operations after failures occur, along with support for Nvidia's next-generation Blackwell GPUs and parallel processing improvements for Apple gear.
AI-generated summary Black Forest Labs offers the FLUX 3 Image Klein model trained on NVIDIA GB200 NVL72 and optimized for NVIDIA GPUs. NVIDIA says combined optimizations delivered up to 3.46x faster text-to-image generation and 4.45x faster image-to-image generation for FLUX 3 Image Klein Base.
AI-generated summary Taiwanese manufacturer King Slide Works commands an estimated 70 to 90 percent market share in precision slide rails used for high-end AI server racks. The company holds approximately 3,750 patents and has approved more than 600 million dollars in capital expenditure to build a new manufacturing plant.
The top AI news in your email delivered each morning. Choose categories