Performance modeling of stream joins
Paper i proceeding, 2017

Streaming analysis is widely used in a variety of environments, from cloud computing infrastructures up to the network's edge. In these contexts, accurate modeling of streaming operators' performance enables fine-grained prediction of applications' behavior without the need of costly monitoring. This is of utmost importance for computationally-expensive operators like stream joins, that observe throughput and latency very sensitive to rate-varying data streams, especially when deterministic processing is required. In this paper, we present a modeling framework for estimating the throughput and the latency of stream join processing. The model is presented in an incremental step-wise manner, starting from a centralized non-deterministic stream join and expanding up to a deterministic parallel stream join. The model describes how the dynamics of throughput and latency are influenced by the number of physical input streams, as well as by the amount of parallelism in the actual processing and the requirement for determinism. We present an experimental validation of the model with respect to the actual implementation. The proposed model can provide insights that are catalytic for understanding the behavior of stream joins against different system deployments, with special emphasis on the influences of determinism and parallelization.

Data streaming

Modeling

Stream join

Författare

Vincenzo Massimiliano Gulisano

Chalmers, Data- och informationsteknik, Nätverk och system

A.V. Papadopoulos

Mälardalens högskola

Ioannis Nikolakopoulos

Chalmers, Data- och informationsteknik, Nätverk och system

Marina Papatriantafilou

Chalmers, Data- och informationsteknik, Nätverk och system

Philippas Tsigas

Chalmers, Data- och informationsteknik, Nätverk och system

DEBS 2017 - Proceedings of the 11th ACM International Conference on Distributed Event-Based Systems

191-202

Ämneskategorier

Produktionsteknik, arbetsvetenskap och ergonomi

Datorsystem

DOI

10.1145/3093742.3093923

ISBN

978-145035065-5