Wlodzislaw Duch,
Department of Informatics,
Nicholas Copernicus University,
Grudziadzka 5, 87-100 Torun, Poland,
and School of Computer Engineering, Nanyang Technological University, Singapore.
Final version published in: Proc. of International Joint Conference on Neural Networks (IJCNN) 2003, Vol. I, pp. 1735-1740
Neural networks are commonly regarded as black boxes performing incomprehensible functions. For classification problems networks provide maps from high dimensional feature space to K-dimensional image space. Images of training vector are projected on polygon vertices, providing visualization of network function. Such visualization may show the dynamics of learning, allow for comparison of different networks, display training vectors around which potential problems may arise, show differences due to regularization and optimization procedures, investigate stability of network classification under perturbation of original vectors, and place new data sample in relation to training data, allowing for estimation of confidence in classification of a given sample. An illustrative examples for the three-class Wine data and five-class Satimage data are described. The visualization method proposed here is applicable to any black box system that provides continuous outputs.
Paper in PDF, 890 KB
Matlab files with software/data used in this paper, 1 MB. Please note that it requires the Netlab neural network toolbox to run.
BACK to the publications of W. Duch.
BACK to the on-line publications of the Department of Informatics, NCU.