Discriminating between Lexico-Semantic Relations with the Specialization Tensor Model

Author

Glavaš, Goran and Vulić, Ivan

Conference

Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)

Year

2018

Figures & Tables

Figure 1: Architecture of the Specialization Tensor Model (STM).
Table 4: Language transfer results on the HR WN-LS. Training on combinations of EN, ES, and DE data.
Table 1: Performance on the CogALex-V dataset.
Table 2: STM performance for three languages on (respective translations of) the WN-LS dataset.

Table of Contents

  • Abstract
  • 1 Introduction
  • 2 Related Work
  • 3 Specialization Tensor Model
    • 3.1 Specialization Tensor
    • 3.2 Bilinear Product Scores
    • 3.3 Classification Objective
  • 4 Evaluation
    • 4.1 Experimental Setup
    • 4.2 Results and Discussion
  • 5 Conclusion
  • Acknowledgments
  • References

References

  •  Mikel Artetxe, Gorka Labaka, and Eneko Agirre. 2017. Learning bilingual word embeddings with (almost)no bilingual data. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), pages 451–462.View this Paper
  •   5Mohammed Attia, Suraj Maharjan, Younes Samih,Laura Kallmeyer, and Thamar Solorio. 2016. CogALex-V shared task: GHHH-detecting semantic relations via word embeddings. In Proceedings of the 5th Workshop on Cognitive Aspects of the Lexicon (CogALex-V), pages 86–91.View this Paper
  •  Marco Baroni, Raffaella Bernardi, Ngoc-Quynh Do,and Chung-chieh Shan. 2012. Entailment above the word level in distributional semantics. In Proceedings of the Conference of the European Chapter of the Association for Computational Linguistics(EACL), pages 23–32.View this Paper
  • 2Piotr Bojanowski, Edouard Grave, Armand Joulin, and Tomas Mikolov. 2017. Enriching word vectors with subword information. Transactions of the Association for Computational Linguistics (TACL), 5:135–146.View this Paper
  •  Qian Chen, Xiaodan Zhu, Zhen-Hua Ling, and Diana Inkpen. 2017. Natural language inference with external knowledge. arXiv preprint arXiv:1711.04289.View this Paper
  •  Manaal Faruqui, Jesse Dodge, Sujay Kumar Jauhar,Chris Dyer, Eduard Hovy, and Noah A. Smith.2015. Retrofitting word vectors to semantic lexicons. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies(NAACL-HLT), pages 1606–1615.View this Paper
  •  Christiane Fellbaum, editor. 1998. WordNet: An Electronic Lexical Database. MIT Press.
  •  Ruiji Fu, Jiang Guo, Bing Qin, Wanxiang Che, Haifeng Wang, and Ting Liu. 2014. Learning semantic hierarchies via word embeddings. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), pages 1199–1209.View this Paper
  •  Goran Glavaš and Sanja Štajner. 2015. Simplifying lexical simplification: Do we need simplified corpora?In Proceedings of the Annual Meeting of the Association for Computational Linguistics, pages 63–68.View this Paper
  • 2Goran Glavaš and Simone Paolo Ponzetto. 2017. Dual tensor model for detecting asymmetric lexico-semantic relations. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 1757–1767.View this Paper
  • 2Douwe Kiela, Felix Hill, and Stephen Clark. 2015. Specializing word embeddings for similarity or relatedness. In Proceedings of the Conference on Empirical Methods in Natural Language Processing(EMNLP), pages 2044–2048.View this Paper
  •   Diederik P. Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In Proceedings of the International Conference on Learning Representations (ICLR).View this Paper
  •  Nitin Madnani and Bonnie J Dorr. 2010. Generating phrasal and sentential paraphrases: A survey of data-driven methods. Computational Linguistics,36(3):341–387.View this Paper
  •  Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositional-ity. In Proceedings of the Conference on Neural Information Processing Systems (NIPS), pages 3111–3119.View this Paper
  • 2Nikola Mrkšić, Ivan Vulić, Diarmuid O’Seaghdha, Ira Leviant, Roi Reichart, Milica Gašić, Anna Korhonen, and Steve Young. 2017. Semantic specialization of distributional word vector spaces using monolingual and cross-lingual constraints. Transactions of the Association for Computational Linguistics (TACL), 5:309–324.View this Paper
  •  Jeffrey Pennington, Richard Socher, and Christopher D Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the Conference on Empirical Methods in Natural Language Processing(EMNLP), pages 1532–1543.View this Paper
  • 2Petar Ristoski, Stefano Faralli, Simone Paolo Ponzetto,and Heiko Paulheim. 2017. Large-scale taxonomy induction using entity and word embeddings. In Proceedings of the International Conference on Web Intelligence, pages 81–87.View this Paper
  •  Stephen Roller, Katrin Erk, and Gemma Boleda. 2014. Inclusive yet selective: Supervised distributional hy-pernymy detection. In Proceedings of the International Conference on Computational Linguistics(COLING), pages 1025–1036.View this Paper
  •   Enrico Santus, Anna Gladkova, Stefan Evert, and Alessandro Lenci. 2016. The CogALex-V shared task on the corpus-based identification of semantic relations. In Proceedings of the 5th Workshop on Cognitive Aspects of the Lexicon (CogALex-V),pages 69–79.View this Paper
  •   Vered Shwartz and Ido Dagan. 2016. CogALex-V Shared Task: LexNET-integrated path-based and distributional method for the identification of semantic relations. In Proceedings of the 5th Workshop on Cognitive Aspects of the Lexicon (CogALex-V),pages 80–85.View this Paper
  •   Vered Shwartz, Yoav Goldberg, and Ido Dagan. 2016. Improving hypernymy detection with an integrated path-based and distributional method. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), pages 2389–2398.View this Paper
  •   Samuel L. Smith, David H.P. Turban, Steven Hamblin,and Nils Y. Hammerla. 2017. Offline bilingual word vectors, orthogonal transformations and the inverted softmax. In Proceedings of the International Conference on Learning Representations (ICLR).View this Paper
  •   Marta Tatu and Dan Moldovan. 2005. A semantic approach to recognizing textual entailment. In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pages 371–378.View this Paper
  •   Ivan Vendrov, Ryan Kiros, Sanja Fidler, and Raquel Urtasun. 2016. Order-embeddings of images and language. In Proceedings of the International Conference on Learning Representations (ICLR).View this Paper
  •   Ivan Vulić and Nikola Mrkšić. 2018. Specialising word vectors for lexical entailment. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT).View this Paper
  •   Ivan Vulić, Nikola Mrkšić, Roi Reichart, Diarmuid Ó Séaghdha, Steve Young, and Anna Korhonen.2017. Morph-fitting: Fine-tuning word vector spaces with simple language-specific rules. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), pages 56–68.View this Paper
  •   John Wieting, Mohit Bansal, Kevin Gimpel, and Karen Livescu. 2015. From paraphrase database to com-positional paraphrase model and back. Transactions of the Association for Computational Linguistics (TACL), 3:345–358.View this Paper
  •   Mo Yu and Mark Dredze. 2014. Improving lexical em-beddings with semantic knowledge. In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), pages 545–550.View this Paper
+- Similar Papers (10)