BIROn - Birkbeck Institutional Research Online

    Bounding the search space for global optimization of neural networks learning error: an interval analysis approach

    Adam, S.P. and Magoulas, George D. and Karras, D.A. and Vrahatis, M.N. (2016) Bounding the search space for global optimization of neural networks learning error: an interval analysis approach. Journal of Machine Learning Research 17 , pp. 1-40. ISSN 1533-7928.

    14-350-2.pdf - Published Version of Record

    Download (1MB) | Preview


    Training a multilayer perceptron (MLP) with algorithms employing global search strategies has been an important research direction in the field of neural networks. Despite a number of significant results, an important matter concerning the bounds of the search region---typically defined as a box---where a global optimization method has to search for a potential global minimizer seems to be unresolved. The approach presented in this paper builds on interval analysis and attempts to define guaranteed bounds in the search space prior to applying a global search algorithm for training an MLP. These bounds depend on the machine precision and the term guaranteed denotes that the region defined surely encloses weight sets that are global minimizers of the neural network's error function. Although the solution set to the bounding problem for an MLP is in general non-convex, the paper presents the theoretical results that help deriving a box which is a convex set. This box is an outer approximation of the algebraic solutions to the interval equations resulting from the function implemented by the network nodes. An experimental study using well known benchmarks is presented in accordance with the theoretical results.


    Item Type: Article
    School: Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences
    Research Centres and Institutes: Birkbeck Knowledge Lab
    Depositing User: George Magoulas
    Date Deposited: 25 Nov 2016 15:50
    Last Modified: 09 Aug 2023 12:38


    Activity Overview
    6 month trend
    6 month trend

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item