Podcast: Distributed LLM Inference on Kubernetes with llm-d, Wasm, & TornadoVM

November 9, 2026 · 11:00 am 1 sources

Image: InfoQ

Coverage

More coverage

• Podcast: Distributed LLM Inference on Kubernetes with llm-d, Wasm, & TornadoVM
  InfoQ · November 9, 2026 11:00
  In this episode, Edoardo Vacchi discusses the evolving landscape of WebAssembly on the backend, running Java workloads on GPUs using TornadoVM, and optimizing distributed AI inference using llm-d and vLLM on Kubernetes. Edoardo explains how llm-d manages cache locality (KV and prefix caches),…