Borges, J. and Levene, Mark (2010) A comparison of scoring metrics for predicting the next navigation step with Markov model-based systems. International Journal of Information Technology & Decision Making 09 (04), pp. 547-573. ISSN 0219-6220.
Abstract
The problem of predicting the next request during a user's navigation session has been extensively studied. In this context, higher-order Markov models have been widely used to model navigation sessions and to predict the next navigation step, while prediction accuracy has been mainly evaluated with the hit and miss score. We claim that this score, although useful, is not sufficient for evaluating next link prediction models with the aim of finding a sufficient order of the model, the size of a recommendation set, and assessing the impact of unexpected events on the prediction accuracy. Herein, we make use of a variable length Markov model to compare the usefulness of three alternatives to the hit and miss score: the Mean Absolute Error, the Ignorance Score, and the Brier score. We present an extensive evaluation of the methods on real data sets and a comprehensive comparison of the scoring methods.
Metadata
| Item Type: | Article |
|---|---|
| Keyword(s) / Subject(s): | web usage mining, variable length Markov model, sequential prediction, scoring metrics |
| School: | Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences |
| Research Centres and Institutes: | Birkbeck Knowledge Lab |
| Depositing User: | Sarah Hall |
| Date Deposited: | 31 May 2013 08:33 |
| Last Modified: | 09 Aug 2023 12:33 |
| URI: | https://eprints.bbk.ac.uk/id/eprint/7155 |
Statistics
Additional statistics are available via IRStats2.
Archive Staff Only (login required)
