GPUs are specialized microprocessors used to train and run artificial intelligence models efficiently. Truncated covers hardware supply chains, production capacities, allocation strategies and industry demand.
AI-generated summary Microsoft has filed a patent detailing a system that would enable PC gamers to share idle GPU processing power for artificial intelligence training. The patent application describes monitoring hardware resources to distribute tasks and potentially compensating participating users with credits or money.
AI-generated summary ROCm Blogs reports the release of MONAILabel 0.8.5 as an Early Access release for AMD Instinct GPUs, bringing interactive medical-image annotation support. ROCm Blogs says the implementation enables model inference to run up to 131 times faster than on a host CPU during spleen CT segmentation workloads.
AI-generated summary Red Hat Developer Hub 2.1 introduces AI-assisted workflows and renames Red Hat Developer Lightspeed for Developer Hub to the context-aware Red Hat Developer Hub intelligent assistant. Red Hat OpenShift 5 introduces Model Context Protocol capabilities to provide AI agents safe access to platform resources.
AI-generated summary A lawyer built a private artificial intelligence server using eight used Nvidia V100 graphics processing units to keep case files offline. The system runs the DeepSeek V4.1 Flash model at up to 215 tokens per second while costing about $2,400 per four-board setup.
AI-generated summary CoreWeave announced a multi-year agreement with Wayve to power its artificial intelligence driver training using CoreWeave Cloud with NVIDIA Blackwell GPUs. Wayve says the cloud infrastructure helps accelerate the commercial deployment of its artificial intelligence driver by providing reliability and observability.
AI-generated summary China's Foreign Ministry repeated its denial of a reported spy allegation involving Nvidia chief executive Jensen Huang and called it a smear against China. Nvidia shares dropped 5.0% to $177.32 in premarket trading following reports regarding national security concerns and chip import restrictions.
AI-generated summary The Nvidia GeForce RTX 3090 offers 24 GB of VRAM, making it a capable hardware choice for running local large language models and other AI workloads. While the Nvidia GeForce RTX 3090 is no longer in production, it provides an alternative for users seeking memory capacity comparable to newer cards like the RTX 5070 Ti, RTX 5080, and RTX 5090.
AI-generated summary Microsoft is reportedly exiting a 2023 compute capacity agreement with Oracle that utilized older Nvidia hardware to power an AI-assisted version of the Bing search engine. According to Bloomberg, Microsoft declined to renew the contract because the older hardware did not meet its current specifications.
AI-generated summary InfoQ reports on optimizing distributed AI inference using llm-d and vLLM on Kubernetes to manage cache locality and batch inference. Edoardo Vacchi discusses running Java workloads on GPUs using TornadoVM and the evolving landscape of WebAssembly on the backend.
AI-generated summary Israel plans to build its own artificial intelligence infrastructure to reduce its dependence on foreign technology companies. The strategy includes establishing a base of around 300,000 graphics processing units and developing a domestic foundation model.
AI-generated summary The author argues that Apple designed the 2,899 dollar MacBook PROLED as a luxury device with a unified memory bottleneck rather than a computer built for local artificial intelligence. The reviewer suggests that power users focused on local workloads should instead consider Windows alternatives featuring Nvidia RTX Spark and AMD Strix Halo chips.
The top AI news in your email delivered each morning. Choose categories