Artificial Neural Systems: Principle and Practice

Artificial Neural Systems: Principle and Practice

Indexed in: EBSCO, Ulrich's Periodicals Directory

An intelligent system is one which exhibits characteristics including, but not limited to, learning, adaptation, and problem-solving. Artificial Neural Network (ANN) Systems are intelligent systems ...
[view complete introduction]

US $
30

*(Excluding Mailing and Handling)



Probability-based Neural Network Systems

Pp. 171-197 (27)

Pierre Lorrentz

Abstract

Since Gaussian distribution may be employed as a universal approximator, it is clear that most modelling and optimisation problems could be solved by probabilitybased ANN systems. For this reason, chapter 9 concentrate on probability-based ANN systems. The first section introduces the random number generator, which has application in Markov-Chain and its hybrid, in subsequent sections. The fifth section describes the Restricted Boltzmann Machine (RBM) in detail. The Boltzmann machine may be a component network of Deep Belief Networks (DBN), which is described in the last section. The chapter has explained many algorithms related to DBN with great intuition, as this may facilitate better understanding and therefore implementation.

Keywords:

Annealed Importance Sampling (AIS), Boltzmann machine, Contrastive divergence, Detailed balance, Distribution, Dynamic architecture, Energy function, Ergodic, Gibbs, Hamiltonian, Markov chain, Metropolis-Hasting criteria, Molecular dynamics, Momentum heat-bath, Partition function, Pseudorandom number, Random number, Sampling, Stationary distribution, Timereversible, Verlet integrator.

Affiliation:

University of Kent, United Kingdom.