RIoTBench: An IoT benchmark for distributed stream processing systems

Shukla, Anshu and Chaturvedi, Shilpa and Simmhan, Yogesh (2017) RIoTBench: An IoT benchmark for distributed stream processing systems. In: CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 29 (21).

PDF CON_COM_29-21_2017.pdf - Published Version Restricted to Registered users only Download (2MB) | Request a copy

Abstract

The Internet of Things (IoT) is an emerging technology paradigm where millions of sensors and actuators help monitor and manage physical, environmental, and human systems in real time. The inherent closed-loop responsiveness and decision making of IoT applications make them ideal candidates for using low latency and scalable stream processing platforms. Distributed stream processing systems (DSPS) hosted in cloud data centers are becoming the vital engine for real-time data processing and analytics in any IoT software architecture. But the efficacy and performance of contemporary DSPS have not been rigorously studied for IoT applications and data streams. Here, we propose RIoTBench, a real-time IoT benchmark suite, along with performance metrics, to evaluate DSPS for streaming IoT applications. The benchmark includes 27 common IoT tasks classified across various functional categories and implemented as modular microbenchmarks. Further, we define four IoT application benchmarks composed from these tasks based on common patterns of data preprocessing, statistical summarization, and predictive analytics that are intrinsic to the closed-loop IoT decision-making life cycle. These are coupled with four stream workloads sourced from real IoT observations on smart cities and smart health, with peak streams rates that range from 500 to 10000messages/second from up to 3million sensors. We validate the RIoTBench suite for the popular Apache Storm DSPS on the Microsoft Azure public cloud and present empirical observations. This suite can be used by DSPS researchers for performance analysis and resource scheduling, by IoT practitioners to evaluate DSPS platforms, and even reused within IoT solutions.

Item Type:	Journal Article
Publication:	CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE
Additional Information:	Copy right for this article belongs to the WILEY, 111 RIVER ST, HOBOKEN 07030-5774, NJ USA
Department/Centre:	Division of Interdisciplinary Sciences > Supercomputer Education & Research Centre
Date Deposited:	30 Oct 2017 03:37
Last Modified:	30 Oct 2017 03:37
URI:	http://eprints.iisc.ac.in/id/eprint/58084

Actions (login required)

View Item