The Parameter-optimized ATEC Metric for MT Evaluation

Billy T-M Wong; Chunyu Kit

The Parameter-optimized ATEC Metric for MT Evaluation

Billy T-M Wong
, Chunyu Kit

Department of Linguistics and Translation

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

5 Citations (Scopus)

Abstract

This paper describes the latest version of the ATEC metric for automatic MT evaluation, with parameters optimized for word choice and word order, the two fundamental features of language that the metric relies on. The former is assessed by matching at various linguistic levels and weighting the informativeness of both matched and unmatched words. The latter is quantified in term of word position and information flow. We also discuss those aspects of language not yet covered by other existing evaluation metrics but carefully considered in the formulation of our metric. © 2010 Association for Computational Linguistics.

Original language	English
Title of host publication	ACL 2010 - Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, Proceedings of the Workshop
Editors	Chris Callison-Burch, Philipp Koehn, Christof Monz, Kay Peterson, Omar Zaidan
Place of Publication	Stroudsburg, PA
Publisher	Association for Computational Linguistics
Pages	360-364
ISBN (Print)	9781932432718, 193243271X
Publication status	Published - Jul 2010
Event	Joint 5th Workshop on Statistical Machine Translation and MetricsMATR (WMT10) - Uppsala, Sweden Duration: 15 Jul 2010 → 16 Jul 2010 https://machinetranslate.org/wmt10

Publication series

Name	Proceedings of the Annual Meeting of the Association for Computational Linguistics
ISSN (Print)	0736-587X

Conference

Conference	Joint 5th Workshop on Statistical Machine Translation and MetricsMATR (WMT10)
Abbreviated title	WMT’10/MetricsMATR
Place	Sweden
City	Uppsala
Period	15/07/10 → 16/07/10
Internet address	https://machinetranslate.org/wmt10

Other Access Options

Check CityUHK Library

Permanent Link

Right click to copy link

Cite this

Wong, B. T.-M., & Kit, C. (2010). The Parameter-optimized ATEC Metric for MT Evaluation. In C. Callison-Burch, P. Koehn, C. Monz, K. Peterson, & O. Zaidan (Eds.), ACL 2010 - Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, Proceedings of the Workshop (pp. 360-364). (Proceedings of the Annual Meeting of the Association for Computational Linguistics). Association for Computational Linguistics.

Wong, Billy T-M ; Kit, Chunyu. / The Parameter-optimized ATEC Metric for MT Evaluation. ACL 2010 - Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, Proceedings of the Workshop. editor / Chris Callison-Burch ; Philipp Koehn ; Christof Monz ; Kay Peterson ; Omar Zaidan. Stroudsburg, PA : Association for Computational Linguistics, 2010. pp. 360-364 (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

@inproceedings{472fde7ccab1405a92aa2df0c266adef,

title = "The Parameter-optimized ATEC Metric for MT Evaluation",

abstract = "This paper describes the latest version of the ATEC metric for automatic MT evaluation, with parameters optimized for word choice and word order, the two fundamental features of language that the metric relies on. The former is assessed by matching at various linguistic levels and weighting the informativeness of both matched and unmatched words. The latter is quantified in term of word position and information flow. We also discuss those aspects of language not yet covered by other existing evaluation metrics but carefully considered in the formulation of our metric. {\textcopyright} 2010 Association for Computational Linguistics.",

author = "Wong, \{Billy T-M\} and Chunyu Kit",

year = "2010",

month = jul,

language = "English",

isbn = "9781932432718",

series = "Proceedings of the Annual Meeting of the Association for Computational Linguistics",

publisher = "Association for Computational Linguistics",

pages = "360--364",

editor = "Chris Callison-Burch and Philipp Koehn and Christof Monz and Kay Peterson and Omar Zaidan",

booktitle = "ACL 2010 - Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, Proceedings of the Workshop",

address = "United States",

note = "Joint 5th Workshop on Statistical Machine Translation and MetricsMATR (WMT10), WMT{\textquoteright}10/MetricsMATR ; Conference date: 15-07-2010 Through 16-07-2010",

url = "https://machinetranslate.org/wmt10",

}

Wong, BT-M & Kit, C 2010, The Parameter-optimized ATEC Metric for MT Evaluation. in C Callison-Burch, P Koehn, C Monz, K Peterson & O Zaidan (eds), ACL 2010 - Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, Proceedings of the Workshop. Proceedings of the Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Stroudsburg, PA, pp. 360-364, Joint 5th Workshop on Statistical Machine Translation and MetricsMATR (WMT10), Uppsala, Sweden, 15/07/10.

The Parameter-optimized ATEC Metric for MT Evaluation. / Wong, Billy T-M; Kit, Chunyu.
ACL 2010 - Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, Proceedings of the Workshop. ed. / Chris Callison-Burch; Philipp Koehn; Christof Monz; Kay Peterson; Omar Zaidan. Stroudsburg, PA: Association for Computational Linguistics, 2010. p. 360-364 (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review

TY - GEN

T1 - The Parameter-optimized ATEC Metric for MT Evaluation

AU - Wong, Billy T-M

AU - Kit, Chunyu

PY - 2010/7

Y1 - 2010/7

N2 - This paper describes the latest version of the ATEC metric for automatic MT evaluation, with parameters optimized for word choice and word order, the two fundamental features of language that the metric relies on. The former is assessed by matching at various linguistic levels and weighting the informativeness of both matched and unmatched words. The latter is quantified in term of word position and information flow. We also discuss those aspects of language not yet covered by other existing evaluation metrics but carefully considered in the formulation of our metric. © 2010 Association for Computational Linguistics.

AB - This paper describes the latest version of the ATEC metric for automatic MT evaluation, with parameters optimized for word choice and word order, the two fundamental features of language that the metric relies on. The former is assessed by matching at various linguistic levels and weighting the informativeness of both matched and unmatched words. The latter is quantified in term of word position and information flow. We also discuss those aspects of language not yet covered by other existing evaluation metrics but carefully considered in the formulation of our metric. © 2010 Association for Computational Linguistics.

UR - https://www.scopus.com/pages/publications/84987731784

UR - https://www.scopus.com/record/pubmetrics.uri?eid=2-s2.0-84987731784&origin=recordpage

M3 - RGC 32 - Refereed conference paper (with host publication)

SN - 9781932432718

SN - 193243271X

T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics

SP - 360

EP - 364

BT - ACL 2010 - Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, Proceedings of the Workshop

A2 - Callison-Burch, Chris

A2 - Koehn, Philipp

A2 - Monz, Christof

A2 - Peterson, Kay

A2 - Zaidan, Omar

PB - Association for Computational Linguistics

CY - Stroudsburg, PA

T2 - Joint 5th Workshop on Statistical Machine Translation and MetricsMATR (WMT10)

Y2 - 15 July 2010 through 16 July 2010

ER -

Wong BTM, Kit C. The Parameter-optimized ATEC Metric for MT Evaluation. In Callison-Burch C, Koehn P, Monz C, Peterson K, Zaidan O, editors, ACL 2010 - Joint Fifth Workshop on Statistical Machine Translation and MetricsMATR, Proceedings of the Workshop. Stroudsburg, PA: Association for Computational Linguistics. 2010. p. 360-364. (Proceedings of the Annual Meeting of the Association for Computational Linguistics). Epub 2010 Jul 15.

The Parameter-optimized ATEC Metric for MT Evaluation

Abstract

Publication series

Conference

Other Access Options

Permanent Link

Other Files and Links

Fingerprint

Cite this