BIROn - Birkbeck Institutional Research Online

    A deadline scheduler for jobs in distributed systems

    Perret, Q. and Charlemagne, G. and Sotiriadis, Stelios and Bessis, N. (2013) A deadline scheduler for jobs in distributed systems. In: UNSPECIFIED (ed.) Advanced Information Networking and Applications Workshops (WAINA), 2013 27th International Conference on. IEEE, pp. 757-764. ISBN 9781467362399.

    [img] Text
    06550487.pdf - Published Version of Record
    Restricted to Repository staff only

    Download (1MB) | Request a copy

    Abstract

    This study presents a soft deadline scheduler for distributed systems that aims of exploring data locality management. In Hadoop, neither the Fair Scheduler nor the Capacity Scheduler takes care about deadlines defined by the user for a job. Our algorithm, named as Cloud Least Laxity First (CLLF), minimizes the extra-cost implied from tasks that are executed over a cloud setting by ordering each of which using its laxity and locality. By using our deadline scheduling algorithm, we demonstrate prosperous performance, as the number of available nodes needed in a cluster in order to meet all the deadlines is minimized while the total execution time of the job remains in acceptable levels. To achieve this, we compare the ability of our algorithm to meet deadlines with the Time Shared and the Space Shared scheduling algorithms. At last we implement our solution in the CloudSim simulation framework for producing the experimental analysis.

    Metadata

    Item Type: Book Section
    Keyword(s) / Subject(s): cloud computing, cost reduction, digital simulation, public domain software, scheduling, CLLF, CloudSim simulation framework, Hadoop, capacity scheduler, cloud least laxity first, data locality management, deadline minimization, deadline scheduling algorithm, distributed systems, fair scheduler, soft deadline scheduler, space shared scheduling algorithm, time shared scheduling algorithm, total execution time, Algorithm design and analysis, Clustering algorithms, Distributed databases, Heuristic algorithms, Scheduling, Scheduling algorithms, Cloud computing, Cluster computing, Hadoop, Soft deadline scheduling
    School: Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences
    Research Centres and Institutes: Birkbeck Knowledge Lab
    Depositing User: Stelios Sotiriadis
    Date Deposited: 11 Jun 2018 09:48
    Last Modified: 09 Aug 2023 12:43
    URI: https://eprints.bbk.ac.uk/id/eprint/21915

    Statistics

    Activity Overview
    6 month trend
    1Download
    6 month trend
    192Hits

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item