SheerMP: Optimized Streaming Analytics-as-a-Service over Multi-site and Multi-platform Settings

George Stamatakis, Antonios Kontaxakis, Alkis Simitsis, Nikos Giatrakos, Antonios Deligiannakis - Proceedings of the 25th International Conference on Extending Database Technology (Demo paper) - EDBT (online conference) 2022


Analytics are in the core of many emerging applications and can greatly benefit from the abundance of data and the progress in the processing capabilities of modern hardware. Still, new challenges arise with the extreme complexity of deciding how to execute analytics workflows given the plethora of choices of various cloud providers, the fragmented nature of diverse Big Data technologies, and the difficult task of resource provisioning to dynamically satisfy the demands of running streaming analytics over time. In this paper, we present SheerMP, a prototype system that optimizes streaming analytics workflows of multiple users, across Big Data platforms and networks of compute clusters/clouds. SheerMP provides end-to-end support for Analytics-as-a-Service providers offering a holistic framework serving diverse optimization and adaptive resource allocation scenarios over a variety of streaming Big Data platforms.

Go to publication:

This project has received funding from the European Union Horizon 2020 research and innovation programme under grant agreement No 825070.

Let's get in touch!