Adaptive nonmonotone conjugate gradient training algorithm for recurrent neural networks

Peng, C.-C. and Magoulas, George (2007) Adaptive nonmonotone conjugate gradient training algorithm for recurrent neural networks. In: UNSPECIFIED (ed.) 19th IEEE International Conference on Tools with Artificial Intelligence. IEEE Computer Society, pp. 374-381. ISBN 9780769530154.

Full text not available from this repository.

Official URL: https://doi.org/10.1109/ICTAI.2007.126

Abstract

Recurrent networks constitute an elegant way of increasing the capacity of feedforward networks to deal with complex data in the form of sequences of vectors. They are well known for their power to model temporal dependencies and process sequences for classification, recognition, and transduction. In this paper, we propose a nonmonotone conjugate gradient training algorithm for recurrent neural networks, which is equipped with an adaptive tuning strategy for the nonmonotone learning horizon. Simulation results show that this modification of conjugate gradient is more effective than the original CG in four applications using three different recurrent network architectures.

Metadata

Item Type:	Book Section
School:	Birkbeck Faculties and Schools > Faculty of Science > School of Computing and Mathematical Sciences
Depositing User:	Sarah Hall
Date Deposited:	15 Jun 2021 17:05
Last Modified:	09 Aug 2023 12:51
URI:	https://eprints.bbk.ac.uk/id/eprint/44755

Statistics

Archive Staff Only (login required)