BIROn - Birkbeck Institutional Research Online

    A comparison of scoring metrics for predicting the next navigation step with Markov model-based systems

    Borges, J. and Levene, Mark (2010) A comparison of scoring metrics for predicting the next navigation step with Markov model-based systems. International Journal of Information Technology & Decision Making 09 (04), pp. 547-573. ISSN 0219-6220.

    Full text not available from this repository.

    Abstract

    The problem of predicting the next request during a user's navigation session has been extensively studied. In this context, higher-order Markov models have been widely used to model navigation sessions and to predict the next navigation step, while prediction accuracy has been mainly evaluated with the hit and miss score. We claim that this score, although useful, is not sufficient for evaluating next link prediction models with the aim of finding a sufficient order of the model, the size of a recommendation set, and assessing the impact of unexpected events on the prediction accuracy. Herein, we make use of a variable length Markov model to compare the usefulness of three alternatives to the hit and miss score: the Mean Absolute Error, the Ignorance Score, and the Brier score. We present an extensive evaluation of the methods on real data sets and a comprehensive comparison of the scoring methods.

    Metadata

    Item Type: Article
    Keyword(s) / Subject(s): web usage mining, variable length Markov model, sequential prediction, scoring metrics
    School: Birkbeck Schools and Departments > School of Business, Economics & Informatics > Computer Science and Information Systems
    Research Centre: Birkbeck Knowledge Lab
    Depositing User: Sarah Hall
    Date Deposited: 31 May 2013 08:33
    Last Modified: 02 Dec 2016 13:23
    URI: http://eprints.bbk.ac.uk/id/eprint/7155

    Statistics

    Downloads
    Activity Overview
    0Downloads
    167Hits

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item