SQLFlow - Easy Stream Processing

SQLFlow is an affordable easy-to-use alternative to stream processing systems like Flink. SQLFlow models stream-processing as SQL queries using the DuckDB SQL dialect. Express your entire stream processing pipeline—ingestion, transformation, and enrichment—as a single SQL statement and configuration file. Process 10's of thousands of events per second on a single machine with low memory overhead, using Python, DuckDB, Arrow and Confluent Python Client. Tap into the DuckDB ecosystem of tools and libraries to build your stream processing applications. SQLFlow support parquet, csv, json and iceberg. Read data from Kafka.