A node pruning algorithm based on optimal brain surgeon for feedforward neural networks

Jinhua Xu; Daniel W. C. Ho

doi:10.1007/11759966_78

A node pruning algorithm based on optimal brain surgeon for feedforward neural networks

Department of Mathematics

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

8 Citations (Scopus)

Abstract

In this paper, a node pruning algorithm based on optimal brain surgeon is proposed for feedforward neural networks. First, the neural network is trained to an acceptable solution using the standard training algorithm. After the training process, the orthogonal factorization is applied to the output of the nodes in the same hidden layer to identify and prune the dependant nodes. Then, a unit-based optimal brain surgeon(UB-OBS) pruning algorithm is proposed to prune the insensitive hidden units to further reduce the size of the neural network, and no retraining is needed. Simulations are presented to demonstrate the effectiveness of the proposed approach. © Springer-Verlag Berlin Heidelberg 2006.

Original language	English
Title of host publication	Advances in Neural Networks - ISNN 2006
Subtitle of host publication	Third International Symposium on Neural Networks, ISNN 2006, Proceedings
Publisher	Springer Verlag
Pages	524-529
Volume	3971 LNCS
ISBN (Print)	354034439, 9783540344391
DOIs	https://doi.org/10.1007/11759966_78
Publication status	Published - 2006
Event	3rd International Symposium on Neural Networks, ISNN 2006 - Advances in Neural Networks: Advances in Neural Networks - Chengdu, China Duration: 28 May 2006 → 1 Jun 2006

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	3971 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	3rd International Symposium on Neural Networks, ISNN 2006 - Advances in Neural Networks
Country/Territory	China
City	Chengdu
Period	28/05/06 → 1/06/06

Access Output

10.1007/11759966_78

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Xu, J., & Ho, D. W. C. (2006). A node pruning algorithm based on optimal brain surgeon for feedforward neural networks. In Advances in Neural Networks - ISNN 2006: Third International Symposium on Neural Networks, ISNN 2006, Proceedings (Vol. 3971 LNCS, pp. 524-529). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 3971 LNCS). Springer Verlag. https://doi.org/10.1007/11759966_78

Xu, Jinhua ; Ho, Daniel W. C. / A node pruning algorithm based on optimal brain surgeon for feedforward neural networks. Advances in Neural Networks - ISNN 2006: Third International Symposium on Neural Networks, ISNN 2006, Proceedings. Vol. 3971 LNCS Springer Verlag, 2006. pp. 524-529 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{c9ada99fac8447b998e8b04deebe672d,

title = "A node pruning algorithm based on optimal brain surgeon for feedforward neural networks",

abstract = "In this paper, a node pruning algorithm based on optimal brain surgeon is proposed for feedforward neural networks. First, the neural network is trained to an acceptable solution using the standard training algorithm. After the training process, the orthogonal factorization is applied to the output of the nodes in the same hidden layer to identify and prune the dependant nodes. Then, a unit-based optimal brain surgeon(UB-OBS) pruning algorithm is proposed to prune the insensitive hidden units to further reduce the size of the neural network, and no retraining is needed. Simulations are presented to demonstrate the effectiveness of the proposed approach. {\textcopyright} Springer-Verlag Berlin Heidelberg 2006.",

author = "Jinhua Xu and Ho, {Daniel W. C.}",

year = "2006",

doi = "10.1007/11759966_78",

language = "English",

isbn = "354034439",

volume = "3971 LNCS",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "524--529",

booktitle = "Advances in Neural Networks - ISNN 2006",

address = "Germany",

note = "3rd International Symposium on Neural Networks, ISNN 2006 - Advances in Neural Networks : Advances in Neural Networks ; Conference date: 28-05-2006 Through 01-06-2006",

}

Xu, J & Ho, DWC 2006, A node pruning algorithm based on optimal brain surgeon for feedforward neural networks. in Advances in Neural Networks - ISNN 2006: Third International Symposium on Neural Networks, ISNN 2006, Proceedings. vol. 3971 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 3971 LNCS, Springer Verlag, pp. 524-529, 3rd International Symposium on Neural Networks, ISNN 2006 - Advances in Neural Networks, Chengdu, China, 28/05/06. https://doi.org/10.1007/11759966_78

A node pruning algorithm based on optimal brain surgeon for feedforward neural networks. / Xu, Jinhua; Ho, Daniel W. C.
Advances in Neural Networks - ISNN 2006: Third International Symposium on Neural Networks, ISNN 2006, Proceedings. Vol. 3971 LNCS Springer Verlag, 2006. p. 524-529 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 3971 LNCS).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - A node pruning algorithm based on optimal brain surgeon for feedforward neural networks

AU - Xu, Jinhua

AU - Ho, Daniel W. C.

PY - 2006

Y1 - 2006

N2 - In this paper, a node pruning algorithm based on optimal brain surgeon is proposed for feedforward neural networks. First, the neural network is trained to an acceptable solution using the standard training algorithm. After the training process, the orthogonal factorization is applied to the output of the nodes in the same hidden layer to identify and prune the dependant nodes. Then, a unit-based optimal brain surgeon(UB-OBS) pruning algorithm is proposed to prune the insensitive hidden units to further reduce the size of the neural network, and no retraining is needed. Simulations are presented to demonstrate the effectiveness of the proposed approach. © Springer-Verlag Berlin Heidelberg 2006.

AB - In this paper, a node pruning algorithm based on optimal brain surgeon is proposed for feedforward neural networks. First, the neural network is trained to an acceptable solution using the standard training algorithm. After the training process, the orthogonal factorization is applied to the output of the nodes in the same hidden layer to identify and prune the dependant nodes. Then, a unit-based optimal brain surgeon(UB-OBS) pruning algorithm is proposed to prune the insensitive hidden units to further reduce the size of the neural network, and no retraining is needed. Simulations are presented to demonstrate the effectiveness of the proposed approach. © Springer-Verlag Berlin Heidelberg 2006.

UR - http://www.scopus.com/inward/record.url?scp=33745921470&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-33745921470&origin=recordpage

U2 - 10.1007/11759966_78

DO - 10.1007/11759966_78

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 354034439

SN - 9783540344391

VL - 3971 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 524

EP - 529

BT - Advances in Neural Networks - ISNN 2006

PB - Springer Verlag

T2 - 3rd International Symposium on Neural Networks, ISNN 2006 - Advances in Neural Networks

Y2 - 28 May 2006 through 1 June 2006

ER -

Xu J, Ho DWC. A node pruning algorithm based on optimal brain surgeon for feedforward neural networks. In Advances in Neural Networks - ISNN 2006: Third International Symposium on Neural Networks, ISNN 2006, Proceedings. Vol. 3971 LNCS. Springer Verlag. 2006. p. 524-529. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/11759966_78

A node pruning algorithm based on optimal brain surgeon for feedforward neural networks

Abstract

Publication series

Conference

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this