AI Infrastructure
AI infrastructure is the compute, networking, and software used to train and serve models.
Follow training and inference stacks from cluster scheduling and networks to model serving. Coverage focuses on deployment, throughput, reliability, and operating cost.
Latest coverage
Articles
NewsThe distributed computing framework Ray is now hosted by the PyTorch Foundation
NewsAWS announces the general availability of Trainium2 instances at re:Invent 2024
NewsSupercharge your AI infrastructure with a complimentary consultation from HPE
NewsDeploying LLMs to any cloud or on-pre, with NIM and dstack
NewsAmazon's "Build on Trainium" will allocate up to $110M in credits for a new research cluster
- News
Andreessen Horowitz shared how its Oxygen program helps AI startups 'breathe easier'
Newsdstack introduced Fleets, a new way to manage cloud and on-prem clusters
NewsDevelopers now have the option to use Amazon SageMaker's fully managed MLflow
NewsCoreWeave plans a $2.2B investment in its European expansion
NewsNVIDIA at Computex 2024: NVIDIA NIM unlocks generative AI for millions of developers
NewsAmpere is collaborating with Qualcomm on an Arm-based AI server
NewsRed Hat announced Red Hat Enterprise Linux AI and Podman AI Lab