Email Gateway (Apr 16 2021 at 05:47): Email Gateway (Apr 16 2021 at 05:47):From: Tobias Nipkow <nipkow@in.tum.de>
Formalization of Timely Dataflow's Progress Tracking Protocol
Matthias Brun, Sára Decova, Andrea Lattuada and Dmitriy Traytel
Large-scale stream processing systems often follow the dataflow paradigm,
which
enforces a program structure that exposes a high degree of parallelism. The
Timely Dataflow distributed system supports expressive cyclic dataflows for
which it offers low-latency data- and pipeline-parallel stream processing. To
achieve high expressiveness and performance, Timely Dataflow uses an intricate
distributed protocol for tracking the computation’s progress. We formalize this
progress tracking protocol and verify its safety. Our formalization is described
in detail in our forthcoming ITP'21 paper.
https://www.isa-afp.org/entries/Progress_Tracking.html
Enjoy!
smime.p7s
Last updated: Jan 04 2025 at 20:18 UTC