Using feature construction to improve the performance of neural networks

Selwyn Piramuthu, Harish Ragavan, Michael J. Shaw

Research output: Contribution to journalArticlepeer-review

Abstract

Recent years have seen the growth in popularity of neural networks for business decision support because of their capabilities for modeling, estimating, and classifying. Compared to other AI methods for problem solving such as expert systems, neural network approaches are especially useful for their ability to learn adaptively from observations. However, neural network learning performed by algorithms such as back-propagation (BP) are known to be slow due to the size of the search space involved and also the iterative manner in which the algorithm works. In this paper, we show that the degree of difficulty in neural network learning is inherent in the given set of training examples. We propose a technique for measuring such learning difficulty, and then develop a feature construction methodology that helps transform the training data so that both the learning speed and classification accuracy of neural network algorithms are improved. We show the efficacy of the proposed method for financial risk classification, a domain characterized by frequent data noise, lack of functional structure, and high attribute interactions. Moreover, the empirical studies also provide insights into the structural characteristics of neural networks with respect to the input data used as well as possible mechanisms to improve the learning performance.

Original languageEnglish (US)
Pages (from-to)416-430
Number of pages15
JournalManagement Science
Volume44
Issue number3
DOIs
StatePublished - Mar 1998
Externally publishedYes

Keywords

  • Feature Construction
  • Financial Credit-Risk Evaluation
  • Learning Difficulty
  • Neural Networks

ASJC Scopus subject areas

  • Strategy and Management
  • Management Science and Operations Research

Fingerprint

Dive into the research topics of 'Using feature construction to improve the performance of neural networks'. Together they form a unique fingerprint.

Cite this