GitHub stars · StarDay

1DataExpert-io / data-engineer-handbookThis is a repo with links to everything you'd ever want to learn about data engineeringJupyter NotebookLicense not declared45,005

2rustfs / rustfsRustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.RustApache-2.0 · Permissive35,809

3taosdata / TDengineHigh-performance, scalable time-series database designed for Industrial IoT (IIoT) scenariosCAGPL-3.0 · Share derivative source25,187

4apache / shardingsphereEmpowering Data Intelligence with Distributed SQL for Sharding, Scalability, and Security Across All Databases.JavaApache-2.0 · Permissive20,818

5heibaiying / BigData-NotesA Beginner's Guide to Big Data :star:JavaLicense not declared16,995

6oxnr / awesome-bigdataA curated list of awesome big data frameworks, ressources and other awesomeness.MIT · Permissive14,714

7juicedata / juicefsJuiceFS is a distributed POSIX file system built on top of Redis and S3.GoApache-2.0 · Permissive14,694

8wangzhiwubigdata / God-Of-BigDataFocus on big data learning interviews, and the road to becoming a god in big data begins. Flink/Spark/Hadoop/Hbase/Hive...License not declared10,566

9databendlabs / databendData Agent Ready Warehouse : One for Analytics, Search, AI, Python Sandbox. — rebuilt from scratch. Unified architecture on your S3.RustApache-2.0 · Permissive9,492

10vaexio / vaexOut-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀PythonMIT · Permissive8,515

11apache / hudiUpserts, Deletes And Incremental Processing on Big Data.JavaApache-2.0 · Permissive6,362

12volcano-sh / volcanoA Cloud Native Batch System (Project under CNCF)GoApache-2.0 · Permissive6,068

13iGaoWei / BigDataView100+ sets of cool large-screen Html5 templates for big data visualization; including industries: community, property, government affairs, transportation, finance and banking, etc., the newest, most complete, coolest and most dazzling big data visualization templates on the entire network. Being updated one after anotherJavaScriptLicense not declared5,360

14DTStack / chunjunA data integration frameworkJavaApache-2.0 · Permissive4,107

15liyupi / sql-generator🔨 Generate structured SQL statements using JSON. Implemented with Vue3 + TypeScript + Vite + Ant Design + MonacoEditor. The project is simple (light logic, lightweight interface), suitable for practice~VueApache-2.0 · Permissive3,412

16apconw / Aix-DBAix-DB is based on the LangChain/LangGraph framework and combined with the MCP Skills multi-agent collaboration architecture to achieve end-to-end conversion from natural language to data insights.JavaScriptLicense not declared2,264

17shzlw / poliAn easy-to-use BI server built for SQL lovers. Power data analysis in SQL and gain faster business insights.JavaMIT · Permissive1,973

18hi-primus / optimus:truck: Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySparkPythonApache-2.0 · Permissive1,535

19josonle / Coding-NowSome notes recorded during study, as well as some eBooks, video resources, and some blogs, websites, and tools that I usually collect that I think are better. Involving several major components of big data, Python machine learning and data analysis, Linux, operating systems, algorithms, networks, etc.PythonGPL-2.0 · Share derivative source1,066

20grailbio / bigsliceA serverless cluster computing system for the Go programming languageGoApache-2.0 · Permissive555