apache/incubator-celeborn

This is stars and forks stats for /apache/incubator-celeborn repository. As of 26 Apr, 2024 this repository has 558 stars and 249 forks.

Apache Celeborn (Incubating) Celeborn is dedicated to improving the efficiency and elasticity of different map-reduce engines and provides an elastic, high-efficient management service for intermediate data including shuffle data, spilled data, result data, etc. Currently, Celeborn is focusing on shuffle data. Internals Architecture Celeborn has three primary components: Master, Worker, and Client. Master manages all resources and syncs shared states based on Raft. Worker processes read-write requests...