Feature Deep Dive: Watermarking in Apache Spark Structured StreamingAugust 22, 2022 by Max Fisher in Product Key Takeaways Watermarks help Spark understand the processing progress based on event time, when to produce windowed aggregates and when to trim the...
Using Apache Flink With Delta LakeFebruary 10, 2022 by Max Fisher, Dylan Gessner and Vini Jaiswal in Open Source As with all parts of our platform, we are constantly raising the bar and adding new features to enhance developers’ abilities to build...