All projects
101 repositories · updated 2026-11-07
Loading…
1pathwaycom / pathwayPython ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.PythonLicense not declaredInsufficient rank history62,014
2vectordotdev / vectorA high-performance observability data pipeline.RustMPL-2.0 · Share derivative sourceInsufficient rank history22,811
3airbytehq / airbyteOpen-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.PythonLicense not declaredInsufficient rank history22,330
4dagster-io / dagsterAn orchestration platform for the development, production, and observation of data assets.PythonApache-2.0 · PermissiveInsufficient rank history16,375
5cocoindex-io / cocoindexIncremental engine for long horizon agents 🌟 Star if you like it!RustApache-2.0 · PermissiveInsufficient rank history11,831
6mage-ai / mage-ai🧙 Build, run, and manage data pipelines for integrating and transforming data.PythonApache-2.0 · PermissiveInsufficient rank history8,844
7redpanda-data / connectFancy stream processing made operationally mundaneGoLicense not declaredInsufficient rank history8,793
8turbot / steampipeZero-ETL, infinite possibilities. Live query APIs, code & more with SQL. No DB required.GoAGPL-3.0 · Share derivative sourceInsufficient rank history7,997
9cloudquery / cloudqueryData pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.GoMPL-2.0 · Share derivative sourceInsufficient rank history6,552
10apache / flink-cdcFlink CDC is a streaming data integration toolJavaApache-2.0 · PermissiveInsufficient rank history6,494
11Eventual-Inc / DaftHigh-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scaleRustApache-2.0 · PermissiveInsufficient rank history5,829
12rudderlabs / rudder-serverPrivacy and Security focused Segment-alternative, in Golang and ReactGoLicense not declaredInsufficient rank history4,515
13ucbepic / docetlA system for agentic LLM-powered data processing and ETLPythonMIT · PermissiveInsufficient rank history4,211
14aws / aws-sdk-pandaspandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).PythonApache-2.0 · PermissiveInsufficient rank history4,121
15Netflix / maestroMaestro: Netflix’s Workflow OrchestratorJavaApache-2.0 · PermissiveInsufficient rank history3,852
16xyflow / awesome-node-based-uisA curated list with resources about node-based UIsCC0-1.0 · PermissiveInactiveInsufficient rank history3,709
17pawl / awesome-etlA curated list of awesome ETL frameworks, libraries, and software.CC0-1.0 · PermissiveInactiveInsufficient rank history3,601
18SQLMesh / sqlmeshScalable and efficient data transformation framework - backwards compatible with dbt.PythonApache-2.0 · PermissiveInsufficient rank history3,346
19PeerDB-io / peerdbFast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and StorageGoAGPL-3.0 · Share derivative sourceInsufficient rank history3,315
20apache / devlakeApache DevLake is an open-source dev data platform to ingest, analyze, and visualize the fragmented data from DevOps tools, extracting insights for engineering excellence, developer experience, and community growth.GoApache-2.0 · PermissiveInsufficient rank history3,190