Evaluating the performance of the survey parser with the NIST scheme

Alex Chengyu Fang

doi:10.1007/11671299_19

Evaluating the performance of the survey parser with the NIST scheme

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

6 Citations (Scopus)

Abstract

Different metrics have been proposed for the estimation of how good a parser-produced syntactic tree is when judged by a correct tree from the treebank. The emphasis of measurement has been on the number of correct constituents in terms of constituent labels and bracketing accuracy. This article proposes the use of the NIST scheme as a better alternative for the evaluation of parser output in terms of correct match, substitution, deletion, and insertion. It describes an experiment to measure the performance of the Survey Parser that was used to complete the syntactic annotation of the International Corpus of English. This article will finally report empirical scores for the performance of the parser and outline some future research. © Springer-Verlag Berlin Heidelberg 2006.

Original language	English
Title of host publication	Computational Linguistics and Intelligent Text Processing
Subtitle of host publication	7th International Conference, CICLing 2006, Proceedings
Publisher	Springer Verlag
Pages	168-179
Volume	3878 LNCS
ISBN (Print)	3540322051, 9783540322054
DOIs	https://doi.org/10.1007/11671299_19
Publication status	Published - 2006
Event	7th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing 2006 - Mexico City, Mexico Duration: 19 Feb 2006 → 25 Feb 2006

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	3878 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	7th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing 2006
Country/Territory	Mexico
City	Mexico City
Period	19/02/06 → 25/02/06

Access Output

10.1007/11671299_19

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Fang, A. C. (2006). Evaluating the performance of the survey parser with the NIST scheme. In Computational Linguistics and Intelligent Text Processing: 7th International Conference, CICLing 2006, Proceedings (Vol. 3878 LNCS, pp. 168-179). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 3878 LNCS). Springer Verlag. https://doi.org/10.1007/11671299_19

Fang, Alex Chengyu. / Evaluating the performance of the survey parser with the NIST scheme. Computational Linguistics and Intelligent Text Processing: 7th International Conference, CICLing 2006, Proceedings. Vol. 3878 LNCS Springer Verlag, 2006. pp. 168-179 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{dbba0d750a8e4d4d9fe07ba5f386365f,

title = "Evaluating the performance of the survey parser with the NIST scheme",

abstract = "Different metrics have been proposed for the estimation of how good a parser-produced syntactic tree is when judged by a correct tree from the treebank. The emphasis of measurement has been on the number of correct constituents in terms of constituent labels and bracketing accuracy. This article proposes the use of the NIST scheme as a better alternative for the evaluation of parser output in terms of correct match, substitution, deletion, and insertion. It describes an experiment to measure the performance of the Survey Parser that was used to complete the syntactic annotation of the International Corpus of English. This article will finally report empirical scores for the performance of the parser and outline some future research. {\textcopyright} Springer-Verlag Berlin Heidelberg 2006.",

author = "Fang, {Alex Chengyu}",

year = "2006",

doi = "10.1007/11671299_19",

language = "English",

isbn = "3540322051",

volume = "3878 LNCS",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "168--179",

booktitle = "Computational Linguistics and Intelligent Text Processing",

address = "Germany",

note = "7th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing 2006 ; Conference date: 19-02-2006 Through 25-02-2006",

}

Fang, AC 2006, Evaluating the performance of the survey parser with the NIST scheme. in Computational Linguistics and Intelligent Text Processing: 7th International Conference, CICLing 2006, Proceedings. vol. 3878 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 3878 LNCS, Springer Verlag, pp. 168-179, 7th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing 2006, Mexico City, Mexico, 19/02/06. https://doi.org/10.1007/11671299_19

Evaluating the performance of the survey parser with the NIST scheme. / Fang, Alex Chengyu.
Computational Linguistics and Intelligent Text Processing: 7th International Conference, CICLing 2006, Proceedings. Vol. 3878 LNCS Springer Verlag, 2006. p. 168-179 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 3878 LNCS).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - Evaluating the performance of the survey parser with the NIST scheme

AU - Fang, Alex Chengyu

PY - 2006

Y1 - 2006

N2 - Different metrics have been proposed for the estimation of how good a parser-produced syntactic tree is when judged by a correct tree from the treebank. The emphasis of measurement has been on the number of correct constituents in terms of constituent labels and bracketing accuracy. This article proposes the use of the NIST scheme as a better alternative for the evaluation of parser output in terms of correct match, substitution, deletion, and insertion. It describes an experiment to measure the performance of the Survey Parser that was used to complete the syntactic annotation of the International Corpus of English. This article will finally report empirical scores for the performance of the parser and outline some future research. © Springer-Verlag Berlin Heidelberg 2006.

AB - Different metrics have been proposed for the estimation of how good a parser-produced syntactic tree is when judged by a correct tree from the treebank. The emphasis of measurement has been on the number of correct constituents in terms of constituent labels and bracketing accuracy. This article proposes the use of the NIST scheme as a better alternative for the evaluation of parser output in terms of correct match, substitution, deletion, and insertion. It describes an experiment to measure the performance of the Survey Parser that was used to complete the syntactic annotation of the International Corpus of English. This article will finally report empirical scores for the performance of the parser and outline some future research. © Springer-Verlag Berlin Heidelberg 2006.

UR - http://www.scopus.com/inward/record.url?scp=33745528940&partnerID=8YFLogxK

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-33745528940&origin=recordpage

U2 - 10.1007/11671299_19

DO - 10.1007/11671299_19

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 3540322051

SN - 9783540322054

VL - 3878 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 168

EP - 179

BT - Computational Linguistics and Intelligent Text Processing

PB - Springer Verlag

T2 - 7th International Conference on Computational Linguistics and Intelligent Text Processing, CICLing 2006

Y2 - 19 February 2006 through 25 February 2006

ER -

Fang AC. Evaluating the performance of the survey parser with the NIST scheme. In Computational Linguistics and Intelligent Text Processing: 7th International Conference, CICLing 2006, Proceedings. Vol. 3878 LNCS. Springer Verlag. 2006. p. 168-179. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/11671299_19

Evaluating the performance of the survey parser with the NIST scheme

Abstract

Publication series

Conference

Access Output

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this