Learning Word Embeddings via Context Grouping
Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review
Author(s)
Related Research Unit(s)
Detail(s)
Original language | English |
---|---|
Title of host publication | ACM TUR-C '17 : Proceedings of the ACM Turing 50th Celebration Conference - China |
Place of Publication | New York |
Publisher | Association for Computing Machinery (ACM) |
Pages | 1-10 |
ISBN (print) | 9781450348737 |
Publication status | Published - 12 May 2017 |
Publication series
Name | ACM International Conference Proceeding Series |
---|---|
Volume | F127754 |
Conference
Title | 50th ACM Turing Conference - China, ACM TUR-C 2017 |
---|---|
Place | China |
City | Shanghai |
Period | 12 - 14 May 2017 |
Link(s)
Abstract
Recently, neural-network based word embedding models have been shown to produce high-quality distributional representations capturing both semantic and syntactic information. In this paper, we propose a grouping-based context predictive model by considering the interactions of contextwords, which generalizes the widely used CBOWmodel and Skip-Gram model. In particular, the words within a context window are split into several groups with a grouping function, where words in the same group are combined while different groups are treated as independent. To determine the grouping function, we propose a relatedness hypothesis stating the relationship among context words and propose several context grouping methods. Experimental results demonstrate better representations can be learned with suitable context groups.
Research Area(s)
- Context grouping, Non-parametric clustering, Word embeddings
Citation Format(s)
Learning Word Embeddings via Context Grouping. / Ma, Yun; Li, Qing; Yang, Zhenguo et al.
ACM TUR-C '17 : Proceedings of the ACM Turing 50th Celebration Conference - China. New York: Association for Computing Machinery (ACM), 2017. p. 1-10 24 (ACM International Conference Proceeding Series; Vol. F127754).
ACM TUR-C '17 : Proceedings of the ACM Turing 50th Celebration Conference - China. New York: Association for Computing Machinery (ACM), 2017. p. 1-10 24 (ACM International Conference Proceeding Series; Vol. F127754).
Research output: Chapters, Conference Papers, Creative and Literary Works › RGC 32 - Refereed conference paper (with host publication) › peer-review