Open Source Streaming & messaging Software

Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information.

Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter

Apache NiFi

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.

Apache Spark - A unified analytics engine for large-scale data processing

Mirror of Apache Storm

Event Hubs is a fully managed, real-time data ingestion service that’s simple, trusted, and scalable.

Apache Beam is a unified programming model for Batch and Streaming data processing.

A common specification for Continuous Delivery events

Standardizing common eventing metadata and their location to help with event identification and routing.

deepstream.io server

The most scalable open-source MQTT broker for IoT, IIoT, and connected vehicles

Apache Flink

An intelligent event streaming platform

Cloud Dataflow is a fully-managed service for transforming and enriching data in stream (real time) and batch (historical) modes with equal reliability and expressiveness -- no more complex workarounds or compromises needed. And with its serverless approach to resource provisioning and management, you have access to virtually limitless capacity to solve your biggest data processing challenges, while paying only for what you use.

Distributed Stream and Batch Processing

Mirror of Apache Kafka

KubeMQ is a Kubernetes Message Queue Broker

Lightbend offers a reactive application development platform for building distributed applications and modernizing aging infrastructures.

Next-Generation Event Processing Platform

NATS.io is a connective technology for distributed systems and is a perfect fit to connect devices, edge, cloud or hybrid deployments. True multi-tenancy makes NATS ideal for SaaS and self-healing and scaling technology allows for topology changes anytime with zero downtime.

Cloud-oriented, simple, flexible, vendor-neutral and language-independent standards for messaging

Data-Centric Pipelines and Data Versioning

Pravega - Streaming as a new software defined storage primitive

Apache Pulsar - distributed pub-sub messaging system

Open source RabbitMQ: core server and tier 1 (built-in) plugins

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

SeaTunnel is a distributed, high-performance data integration platform for the synchronization and transformation of massive data (offline & real-time).

Stream Processing and Complex Event Processing Engine

datacollector-oss

Kubernetes-native data streaming powered by Apache Kafka

Talend specializes in cloud data integration and data integrity.

Main Tremor Project Rust Codebase