GitHub stars · StarDay

1pathwaycom / pathwayPython ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.PythonLicense not declared62,014

2dagster-io / dagsterAn orchestration platform for the development, production, and observation of data assets.PythonApache-2.0 · Permissive16,375

3apache / dolphinschedulerApache data orchestration platform for defining workflows with low-code tooling.JavaApache-2.0 · Permissive14,551

4kedro-org / kedroAuthor description: Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.PythonLicense not declared11,045

5mage-ai / mage-ai🧙 Build, run, and manage data pipelines for integrating and transforming data.PythonApache-2.0 · Permissive8,844

6OpenDCAI / DataFlow[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.PythonApache-2.0 · Permissive8,481

7fluvio-community / fluvio🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.RustApache-2.0 · Permissive5,261

8StructuredLabs / preswaldPreswald is a WASM packager for Python-based interactive data apps: bundle full complex data workflows, particularly visualizations, into single files, runnable completely in-browser, using Pyodide, DuckDB, Pandas, and Plotly, Matplotlib, etc. Build dashboards, reports, and notebooks that run offline, load fast, and share like a document.PythonApache-2.0 · Permissive4,270

9ucbepic / docetlA system for agentic LLM-powered data processing and ETLPythonMIT · Permissive4,211

10Netflix / maestroMaestro: Netflix’s Workflow OrchestratorJavaApache-2.0 · Permissive3,852

11elementary-data / elementaryThe dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.HTMLApache-2.0 · Permissive2,430

12data-engineering-community / data-engineering-wikiAuthor description: The best place to learn data engineering. Built and maintained by the data engineering community.CSSCC0-1.0 · Permissive2,058

13yobix-ai / extractousFast and efficient unstructured data extraction. Written in Rust with bindings for many languages.RustApache-2.0 · PermissiveInactive1,787

14amphi-ai / amphi-etlvisual data prep powered by pythonTypeScriptLicense not declared1,412

15raystack / optimusOptimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.GoApache-2.0 · PermissiveInactive769

16dataflint / sparkDrop-in replacement for Apache Spark UITypeScriptApache-2.0 · Permissive498