Meet Cloud Native Batch Computing with Volcano in AI & Big Data Scenarios

Cloud native batch computing engine Volcano is designed for high-performance computing applications such as AI, big data, gene sequencing, and rendering, and supports mainstream general computing frameworks. More than 58,000 global developers joined us, among whom the in-house ones come from companies such as Huawei, AWS, Baidu, Tencent, JD, and Xiaohongshu. There are 3.7k+ Stars and 800+ Forks for the project. Volcano has been proven feasible for mass data computing and analytics, such as AI, big data, and gene sequencing. Supported frameworks include Spark, Flink, TensorFlow, PyTorch, Argo, MindSpore, Paddlepaddle, Kubeflow, MPI, Horovod, MXNet, KubeGene, and Ray. The ecosystem is thriving with more developers and use cases coming up.

As the industry-first cloud native batch computing project，Volcano was Open-sourced at KubeCon Shanghai in June 2019, it became an official CNCF project in April 2020. In April 2022, Volcano was promoted to a CNCF incubating project. By now, more than 600 global developers have committed code to the project. The community is seeing growing popularity among developers, partners, and users.

Try new features in Volcano v1.8.2

In Volcano’s Latest release v1.8.2 ，the following new features are added :

• Support for vGPU scheduling and isolation

• Support for vGPU and user-defined resource preemption capabilities

• Addition of JobFlow workflow scheduling engine

• Node load-aware scheduling and rescheduling support for diverse monitoring systems

• Optimization of Volcano’s ability to schedule microservices

• Optimization of Volcano charts packages for publishing and archiving

Try Volcano v1.8.2:https://github.com/volcano-sh/volcano/releases/tag/v1.8.2

Join Volcano Community Co-construction Program

Recently，More than 50 cases related to Volcano have been implemented. These cases are widely distributed in industries such as Internet, advanced manufacturing, finance, life sciences, scientific research, autonomous driving, and medicine. They cover massive data computing and analysis scenarios like AI, big data, genomic sequencing, and rendering. The main users are Tencent, Amazon, ING Bank, Baidu, Xiaohongshu, DiDi, 360, iQIYI, Leinao, Pengcheng Laboratory, Cruise, Li Auto, Unisound, Ximalaya, Vipshop, GrandOmics, BOSS Zhipin, and so on. With the expansion of the Volcano ecosystems, more and more users are highly willing to join the community.

The Volcano community launched the co-construction program to welcome users into the Volcano community, to accelerate cloud native progress, and to ensure a diverse Volcano ecosystem.

Through this program, you will have opportunities for technological guidance, promotion, as well as online and offline technological sharing. If your company or organization recognizes the value that Volcano has to offer, wants help using Volcano, or wants to exert their technological influence, consider joining the program. For details about the requirements and benefits, see https://github.com/volcano-sh/community/blob/master/community-building-program.md

Join Volcano at KubeCon + CloudNativeCon Europe, 19-22 March in Paris!

Volcano will participate in several activities, including:

• Speech Schedule
  • March 19 at 14:05 - 14:30 am CET:Level 7.3 | Room S03 Volcano Maintainer Kevin Wang, Huawei， presents“Efficient Multi-Cluster GPU Workload Management with Karmada and Volcano”
  • March 22 at 11:55 - 12:30 am CET：Pavilion 7 | Level 7.3 | N03 Volcano Maintainer William Wang, Huawei & Mengxuan Li, 4paradigm presents “Cloud Native Batch Computing with Volcano: Updates and Future ”
    
  • March 22 at 16:00 - 16:35 am CET：Pavilion 7 | Level 7.3 | Paris Room Volcano Maintainer William Wang & Hongcai Ren, Huawei presents “Maximizing GPU Utilization Over Multi-Cluster: Challenges and Solutions for Cloud-Native AI Platform”
• Booth Hours:
  
  • March 20-22 PM(W, Th, F) :Stop by CNCF Project Pavilion Booth PP18-B at KubeCon +CloudNativeCon Europe to speak with an expert or see a demo!