Skip to main content

13 posts tagged with "kubernetes"

View All Tags

Introducing Kthena: Redefining LLM Inference for the Cloud-Native Era

· 9 min read
Volcano
Volcano

Today, the Volcano community is proud to announce the launch of Kthena, a new sub-project designed for global developers and MLOps engineers.

Kthena is a cloud-native, high-performance system for LLM inference routing, orchestration, and scheduling, tailored specifically for Kubernetes. Engineered to address the complexity of serving LLMs at production scale, Kthena delivers granular control and enhanced flexibility. Through features like topology-aware scheduling, KV Cache-aware routing, and Prefill-Decode (PD) disaggregation, it significantly improves GPU/NPU utilization and throughput while minimizing latency.

As a sub-project of Volcano, Kthena extends Volcano’s capabilities beyond AI training, creating a unified, end-to-end solution for the entire AI lifecycle.

Volcano v1.12.0 Available Now

· 19 min read
Volcano
Volcano

Volcano v1.12 released: Advancing Cloud-Native AI and Batch Computing​

As AI large model technology rapidly evolves, enterprises are placing higher demands on computing resource efficiency and application performance. For complex application scenarios such as AI, big data, and high-performance computing (HPC), efficiently utilizing accelerators like GPUs, ensuring high system availability, and managing resources with fine granularity are the core areas of focus for the Volcano community's continuous innovation.

Volcano v1.11.0 Available Now

· 19 min read
Volcano
Volcano

As the de facto standard in cloud-native batch computing, Volcano has been widely adopted across various scenarios, including AI, Big Data, and High-Performance Computing (HPC). With over 800 contributors from more than 30 countries and tens of thousands of code commits, Volcano has been deployed in production environments by over 60 enterprises worldwide. It provides the industry with excellent practical standards and solutions for cloud native batch computing.

Volcano 1.7.0 Available Now

· 6 min read
Volcano
Volcano

Volcano 1.7.0 is now available with the following new features:

  • enhanced plugin for PyTorch Jobs
  • Ray on Volcano
  • enhanced scheduling for general Kubernetes services
  • multi-architecture images of Volcano
  • optimized queue status info

volcano_logo.png

Volcano is the industry-first cloud native batch computing project. Open-sourced at KubeCon Shanghai in June 2019, it became an official CNCF project in April 2020. In April 2022, Volcano was promoted to a CNCF incubating project. By now, more than 490 global developers have committed code to the project. The community is seeing growing popularity among developers, partners, and users.