GitHub stars · StarDay

1pathwaycom / pathwayPython ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.PythonLicense not declared62,025

2rocketride-org / rocketride-serverAn AI pipeline engine combining a C++ core with Python-extensible nodes.PythonMIT · Permissive19,678

3cocoindex-io / cocoindexIncremental engine for long horizon agents 🌟 Star if you like it!RustApache-2.0 · Permissive11,812

4onceupon / Bash-OnelinerA collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.MIT · Permissive10,798

5johnkerl / millerMiller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSONGoLicense not declared10,055

6OpenDCAI / DataFlow[SIGMOD'27] Easy Data Preparation with latest LLMs-based Operators and Pipelines.PythonApache-2.0 · Permissive8,428

7TomWright / daselUnified querying, transformation, and modification of JSON, TOML, YAML, XML, INI, HCL, KDL and CSV.GoMIT · Permissive8,056

8datajuicer / data-juicerData processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷PythonApache-2.0 · Permissive7,211

9NVIDIA / DALIA GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.C++Apache-2.0 · Permissive5,791

10deepseek-ai / smallpondA lightweight data processing framework built on DuckDB and 3FS.PythonMIT · Permissive5,028

11unionai-oss / panderaA light-weight, flexible, and expressive statistical data testing libraryPythonMIT · Permissive4,508

12datachain-ai / datachainA typed, versioned dataset layer for unstructured data in object storage.PythonApache-2.0 · Permissive2,830