1.11 | Pipenet

pipenet run my-script

Streaming joins no longer require ugly hacks with tumble() functions. The new window_join operator handles out-of-order events gracefully, using a novel watermark heuristic that’s less aggressive than Flink’s but smarter than Spark Structured Streaming’s default. I threw 5 minutes of late-arriving IoT data at it, and it only dropped 0.2% of events (compared to 8% in 1.10). pipenet 1.11

Limitations and considerations