|
| << vorige | volgende >> |
Tijdschrift beschrijving
Alle jaargangen van het bijbehorende tijdschrift
Alle afleveringen van het bijbehorende jaargang
Alle artikelen van de bijbehorende aflevering
Details van artikel 23 van 114 gevonden artikelen
| Titel: |
Differential-algebraic equations and singular perturbation methods in recurrent neural learning |
| Auteur: |
Riaza, Ricardo Zufiria, Pedro J. |
| Verschenen in: |
Dynamical systems |
| Paginering: | Jaargang 18 (2003) nr. 1 pagina's 89-105 |
| Jaar: |
2003-03 |
| Inhoud: |
This paper introduces a mathematical framework based on dynamical system theory, differential-algebraic equations (DAEs) and singularly perturbed (SP) systems, oriented to the analysis and design of on-line schemes for fixed point recurrent neural learning. New schemes proposed in this framework make it possible to relax some common assumptions in usual recurrent backpropagation (RBP) implementations. The scope of the work is not necessarily restricted to gradient-based adaptation methods, the results being applicable to more general learning strategies. The presented models clarify the relative timescaling between the network dynamics and the adaptation process in on-line techniques, including adjoint-based approaches. Certain restrictions on the learning speed are formalized through a 'rate of learning' limit appearing in the DAE/SP setting. Local convergence is rigorously stated, and certain Newton-based stabilization techniques are proposed regarding global issues in the presence of bifurcations, which typically introduce severe difficulties in common RBP methods. Some simulation examples concerning the synthesis of associative memories illustrate the applicability of the proposed techniques. |
| Uitgever: |
Taylor & Francis |
| Bronbestand: |
Elektronische Wetenschappelijke Tijdschriften |
Details van artikel 23 van 114 gevonden artikelen
| << vorige | volgende >> |