Skip to main content

Meet Cloud Native Batch Computing with Volcano in AI & Big Data Scenarios

· 3 min read
Volcano
Volcano

Cloud native batch computing engine Volcano is designed for high-performance computing applications such as AI, big data, gene sequencing, and rendering, and supports mainstream general computing frameworks. More than 58,000 global developers joined us, among whom the in-house ones come from companies such as Huawei, AWS, Baidu, Tencent, JD, and Xiaohongshu. There are 3.7k+ Stars and 800+ Forks for the project. Volcano has been proven feasible for mass data computing and analytics, such as AI, big data, and gene sequencing. Supported frameworks include Spark, Flink, TensorFlow, PyTorch, Argo, MindSpore, Paddlepaddle, Kubeflow, MPI, Horovod, MXNet, KubeGene, and Ray. The ecosystem is thriving with more developers and use cases coming up.

Volcano 1.7.0 Available Now

· 6 min read
Volcano
Volcano

Volcano 1.7.0 is now available with the following new features:

  • enhanced plugin for PyTorch Jobs
  • Ray on Volcano
  • enhanced scheduling for general Kubernetes services
  • multi-architecture images of Volcano
  • optimized queue status info

volcano_logo.png

Volcano is the industry-first cloud native batch computing project. Open-sourced at KubeCon Shanghai in June 2019, it became an official CNCF project in April 2020. In April 2022, Volcano was promoted to a CNCF incubating project. By now, more than 490 global developers have committed code to the project. The community is seeing growing popularity among developers, partners, and users.

ING Bank: How Volcano Empowers Their Big Data Analytics Platform

· 7 min read
Volcano
Volcano

On October 26, 2022, Krzysztof Adamski and Tinco Boekestijn from ING Group delivered a keynote speech "Efficient Scheduling Of High Performance Batch Computing For Analytics Workloads With Volcano" at KubeCon North America. The speech focused on how Volcano, a cloud native batch computing project, supports high-performance scheduling for big data analytics jobs on ING's data management platform. More details: KubeCon + CloudNativeCon North America

Volcano v1.4 (Beta) Release Note

· 3 min read
Volcano
Volcano

This article was firstly released at Container Cube on September 6th, 2021, refer to Volcano v1.4.0-Beta发布，支持NUMA-Aware等多个重要特性

Volcano, CNCF's first batch computing project, is now available with a new version, v1.4 (Beta). This version includes multiple important features, such as resource ratio-based partitions on GPU nodes, NUMA-aware, mixed deployment of multiple schedulers, and greatly improved stability.