Neural Networks for Pattern Classification and Universal Approximation

No Thumbnail Available

Date

2002-07-08

Authors

Journal Title

Series/Report No.

Journal ISSN

Volume Title

Publisher

Abstract

This dissertation studies neural networks for pattern classification and universal approximation. The objective is to develope a new neural network model for pattern classification, and relax the conditions for Radial-Basis Function networks to be universal approximators. First, the problem of pattern classification is introduced, which is followed by a brief introduction of three popular nonlinear classification techniques, that is, Multi-Layer Perceptrons (MLP), Radial-Basis Function (RBF) networks, and Support Vector Machines (SVM). Then, based on the basic concepts of MLP, RBF and SVM, a new neural network model with bounded weights is proposed, and some experimental results are reported. Later, the problem of universal approximation by neural networks is introduced, and the researches on ridge activation functions and radial-basis activation functions are reviewed. Then, the relaxed conditions for RBF networks to be universal approximators are presented. We show that RVF networks can uniformly approximate any continuous function on a compact set provided that the radial basis activation function is continuous almost every where, locally essentially bounded, and not a polynomial. Some experimental results are reported to illustrate our findings. The dissertation ends with the conclusion and future research.

Description

Keywords

Universal Approximation, Pattern Classification, Neural Networks

Citation

Degree

PhD

Discipline

Industrial Engineering

Collections