DataEngineering · Stream Processing

Stream Processing

• pathwaycom/pathway on GitHub, opens in a new tab

  62.4Kstars

  Performant open-source Python ETL framework with Rust runtime, supporting 300+ data sources.

  Python·Other·active·11 hours ago

• cocoindex-io/cocoindex on GitHub, opens in a new tab

  11.3Kstars

  An open source ETL framework to build fresh index for AI.

  Rust·Apache License 2.0·active·3 hours ago

• pipelinedb/pipelinedb on GitHub, opens in a new tab

  2.7Kstars

  The Streaming SQL Database.

  C·Apache License 2.0·dormant·4 years ago

• faust-streaming/faust on GitHub, opens in a new tab

  1.9Kstars

  Forever scalable event processing & in-memory durable K/V store as a library with asyncio & static typing.

  Python·Other·active·5 days ago

• aklivity/zilla on GitHub, opens in a new tab

  1.2Kstars

  An API gateway built for event-driven architectures and streaming that supports standard protocols such as HTTP, SSE, gRPC, MQTT, and the native Kafka protocol.

  Java·Other·active·5 hours ago

• hstreamdb/hstream on GitHub, opens in a new tab

  721stars

  The streaming database built for IoT data storage and real-time processing.

  Haskell·BSD 3-Clause "New" or "Revised" License·slowing·2 years ago