~/data-phoenix_~/dp_
  • News
  • ·Articles
  • ·Videos
  • ·Events
  • ·Shows
  • ·Program
  • ·Community
  • ·
Sign inSubscribe
  1. Home /
  2. Tags /
  3. LLM inference

LLM inference

Everything tagged LLM inference.

Share your storySubscribe

Featured

AMD details automatic FlashInfer kernel routing on ROCm 10.1
News

AMD details automatic FlashInfer kernel routing on ROCm 10.1

DP News Team·Nov 20, 2026
AWS adds distributed KV caching to ElastiCache for self-hosted LLMs
News

AWS adds distributed KV caching to ElastiCache for self-hosted LLMs

Nov 20, 2026
AWS adds KV cache-aware routing to SageMaker real-time endpoints
News

AWS adds KV cache-aware routing to SageMaker real-time endpoints

Nov 17, 2026

Latest

  • AWS launches GPU-aware routing for SageMaker HyperPod
    News

    AWS launches GPU-aware routing for SageMaker HyperPod

    AWS launched a managed routing layer for SageMaker HyperPod on Amazon EKS that directs inference requests using live queue, cache and model-serving…

    DP News Team · Sep 18
  • Cohere details dynamic speculative decoding and contributes the method to vLLM
    News

    Cohere details dynamic speculative decoding and contributes the method to vLLM

    Cohere detailed a hardware-aware dynamic speculative-decoding technique it says runs about 23% faster than fixed-K decoding on its Command A model.

    Dmytro Spodarets · Jul 11

Subscribe to our newsletters

Pick the lists you care about — one email, unsubscribe anytime.

Newsletters

Popular topics

products-and-featurespolicy-safety-and-incidentsfoundation-models-and-researchfunding-and-maOpenAIinfrastructure-and-computeindustry-and-adoptionAI agentsAI infrastructurenvidiaAnthropicpartnerships-and-deals
~/data-phoenix_~/dp_

Data Phoenix is a media platform and community for engineers and technical leaders building AI and data solutions.

Topics

  • AI Data Centers
  • Frontier AI & Superintelligence
  • AI Coding Assistants & Dev Tools
  • AI Infrastructure
  • On-Device AI
  • AI Security & Reliability
  • All Topics

Shows

  • Tech Talks
  • Demo Stage
  • DPTV Highlights
  • Open Mic
  • Research Talks
  • Program
  • Live

Community

  • Contributors
  • Events
  • Subscribe

Company

  • About
  • Brand assets
  • Partner with us
  • Privacy Policy
  • Terms of Service

© 2026 Data Phoenix. All rights reserved.

Founded and run by Dmytro Spodarets,
with 78 AI agents and community contributors.