BIROn - Birkbeck Institutional Research Online

    Bounding the search space for global optimization of neural networks learning error: an interval analysis approach

    Adam, S.P. and Magoulas, George D. and Karras, D.A. and Vrahatis, M.N. (2016) Bounding the search space for global optimization of neural networks learning error: an interval analysis approach. Journal of Machine Learning Research 17 , ISSN 1533-7928.

    [img]
    Preview
    Text
    14-350-2.pdf - Published Version of Record

    Download (1MB) | Preview

    Abstract

    Training a multilayer perceptron (MLP) with algorithms employing global search strategies has been an important research direction in the field of neural networks. Despite a number of significant results, an important matter concerning the bounds of the search region---typically defined as a box---where a global optimization method has to search for a potential global minimizer seems to be unresolved. The approach presented in this paper builds on interval analysis and attempts to define guaranteed bounds in the search space prior to applying a global search algorithm for training an MLP. These bounds depend on the machine precision and the term guaranteed denotes that the region defined surely encloses weight sets that are global minimizers of the neural network's error function. Although the solution set to the bounding problem for an MLP is in general non-convex, the paper presents the theoretical results that help deriving a box which is a convex set. This box is an outer approximation of the algebraic solutions to the interval equations resulting from the function implemented by the network nodes. An experimental study using well known benchmarks is presented in accordance with the theoretical results.

    Metadata

    Item Type: Article
    School: Birkbeck Schools and Departments > School of Business, Economics & Informatics > Computer Science and Information Systems
    Research Centre: Birkbeck Knowledge Lab
    Depositing User: Prof George Magoulas
    Date Deposited: 25 Nov 2016 15:50
    Last Modified: 02 Dec 2016 13:23
    URI: http://eprints.bbk.ac.uk/id/eprint/16075

    Statistics

    Downloads
    Activity Overview
    41Downloads
    116Hits

    Additional statistics are available via IRStats2.

    Archive Staff Only (login required)

    Edit/View Item Edit/View Item