BIROn - Birkbeck Institutional Research Online

    A comparison of scoring metrics for predicting the next navigation step with Markov model-based systems

    Borges, J. and Levene, Mark (2010) A comparison of scoring metrics for predicting the next navigation step with Markov model-based systems. International Journal of Information Technology & Decision Making 09 (04), pp. 547-573. ISSN 0219-6220.

    Full text not available from this repository.


    The problem of predicting the next request during a user's navigation session has been extensively studied. In this context, higher-order Markov models have been widely used to model navigation sessions and to predict the next navigation step, while prediction accuracy has been mainly evaluated with the hit and miss score. We claim that this score, although useful, is not sufficient for evaluating next link prediction models with the aim of finding a sufficient order of the model, the size of a recommendation set, and assessing the impact of unexpected events on the prediction accuracy. Herein, we make use of a variable length Markov model to compare the usefulness of three alternatives to the hit and miss score: the Mean Absolute Error, the Ignorance Score, and the Brier score. We present an extensive evaluation of the methods on real data sets and a comprehensive comparison of the scoring methods.


    Item Type: Article
    Keyword(s) / Subject(s): web usage mining, variable length Markov model, sequential prediction, scoring metrics
    School: Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences
    Research Centres and Institutes: Birkbeck Knowledge Lab
    Depositing User: Sarah Hall
    Date Deposited: 31 May 2013 08:33
    Last Modified: 09 Aug 2023 12:33


    Activity Overview
    6 month trend
    6 month trend

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item