BIROn - Birkbeck Institutional Research Online

    Detecting performance degradation in cloud systems using LSTM autoencoders

    Chouliaras, Spyridon and Sotiriadis, Stelios (2021) Detecting performance degradation in cloud systems using LSTM autoencoders. In: The 35th International Conference on Advanced Information Networking and Applications (AINA-2021), 12-14 May 2021, Online. (Unpublished)

    [img]
    Preview
    Text
    Detecting_Performance_Degradation_in_Cloud_Systems_using_LSTM_Autoencoders (3).pdf - Author's Accepted Manuscript

    Download (3MB) | Preview

    Abstract

    Cloud computing technology is on the rise as it provides an easy to scale environment for Internet users in terms of computational resources. At the same time, cloud providers manage this demand for computational power by offering a pay per use model for virtualized resources. Yet, it is a challenging issue to administer the variety of different cloud applications and ensure high performance by identifying failures and errors on runtime. Distributed applications are error-prone, and creating a platform to support minimum hardware and software failures is a key challenge. In this work, we focus on anomaly detection of data storage systems, and we propose a solution for detecting performance degradation of cloud deployed systems in real time. We use Long Short-term Memory (LSTM) Autoencoders for learning the normal representations and reconstruct the input sequences. Then, we used the reconstructed errors of the LSTM Autoencoders on unseen time series data to detect abnormal behaviours. We used state-of-the-art benchmarks such as TPCx-IoT and YCSB to evaluate the performance of HBase and MongoDB systems. Our experimental analysis shows the ability of the proposed approach to detect abnormal behaviours in cloud systems.

    Metadata

    Item Type: Conference or Workshop Item (Paper)
    School: School of Business, Economics & Informatics > Computer Science and Information Systems
    Research Centres and Institutes: Data Analytics, Birkbeck Institute for
    Depositing User: Stelios Sotiriadis
    Date Deposited: 10 May 2022 13:07
    Last Modified: 12 May 2022 05:26
    URI: https://eprints.bbk.ac.uk/id/eprint/43771

    Statistics

    Downloads
    Activity Overview
    17Downloads
    18Hits

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item