DRIVEN: a Framework for Efficient Data Retrieval and Clustering in Vehicular Networks
Paper in proceedings, 2019

Applications for adaptive (sometimes also called smart) Cyber-Physical Systems are blossoming thanks to the large volumes of data, sensed in a continuous fashion, in large distributed systems. The benefits of these applications come nonetheless with a price: the need for jointly addressing challenges in efficient data communication and analysis (among others). The goal of the DRIVEN framework, presented here, is to address these challenges for a data gathering and distance-based clustering tool in the context of vehicular networks. Because of the limited communication bandwidth (compared to the volume of sensed data) of vehicular networks and the monetary costs of data transmission, the intuition behind DRIVEN is to avoid gathering the data to be clustered in a raw format from each vehicle, but rather to allow for a streaming-based error-bounded approximation, through Piecewise Linear Approximation, to compress the volumes of data to be gathered. At the same time, rather than relying on a batch-based clustering algorithm that requires all the data to be first gathered (and then clustered), DRIVEN relies on and extends a streaming-based clustering algorithm that leverages the inherent ordering of the spatial and temporal data being collected, to perform the clustering in an online fashion, while data is being retrieved. As we show, based on our prototype implementation using Apache Flink and our evaluation with real-world data such as GPS and LiDAR, the accuracy loss for the clustering performed on the reconstructed data can be small, even when the raw data is compressed to 10- 35% of its original size, and the transferring of data itself can be completed in up to one-tenth of the duration observed when gathering raw data.

streaming data

edge computing

clustering

fog computing

compression

Author

Bastian Havers

Chalmers, Computer Science and Engineering (Chalmers), Networks and Systems (Chalmers)

Romaric Duvignau

Chalmers, Computer Science and Engineering (Chalmers), Networks and Systems (Chalmers)

Hannaneh Najdataei

Chalmers, Computer Science and Engineering (Chalmers), Networks and Systems (Chalmers)

Vincenzo Massimiliano Gulisano

Chalmers, Computer Science and Engineering (Chalmers), Networks and Systems (Chalmers)

Marina Papatriantafilou

Chalmers, Computer Science and Engineering (Chalmers), Networks and Systems (Chalmers)

Ashok Krishna Chaitanya Koppisetty

Proceedings of the 2019 IEEE 35th International Conference on Data Engineering (ICDE)

1850-1861

International Conference on Data Engineering 2019
Macau, Macau,

HARE: Self-deploying and Adaptive Data Streaming Analytics in Fog Architectures

Swedish Research Council (VR), 2017-01-01 -- 2020-12-31.

Future factories in the Cloud (FiC)

Swedish Foundation for Strategic Research (SSF), 2016-01-01 -- 2020-12-31.

Subject Categories

Other Computer and Information Science

Media Engineering

Computer Science

Areas of Advance

Information and Communication Technology

DOI

10.1109/ICDE.2019.00201

ISBN

9781538674741

More information

Latest update

7/8/2019 2