Pitfall of Google Tri-Grams Word Similarity Measure

Linda Wong Lin Juan, Bong Chih How, Johari Abdullah, Lee Nung Kiong


This paper describes and examines Google Trigram word similarity based on Google n-gram dataset. Google Tri-grams Measure (GTM) is an unsupervised similarity measurement technique. The paper investigates GTM’s word similarity measure which is the state-of-the art of the measure and we eventually reveal its pitfall. We test the word similarity with MC-30 word pair dataset and compare the result against the other word similarity measures. After evaluation, GTM word similarity measures is found significantly fall behind other word similarity measure. The pitfall of GTM word similarity is detailed and proved with evidences.


Google Tri-grams; Pitfalls, Sentence Similarity, Text Similarity; Trigrams; Unsupervised; Word Similarity;

Full Text:



G. Ignatow and R. Mihalcea, Text Mining: A Guidebook for the Social Sciences, Sage Publications, 2016.

M. J. Wise, “YAP3: Improved detection of similarities in computer program and other texts,” ACM SIGCSE Bulletin, vol. 28, no. 1, pp. 130-134,1996.

G. Liu, Z. Lu, T. Hao, and W. Liu, “Automatic Short Text Annotation for Question Answering System,” International Conference on Web Information Systems and Technologies. Springer, Berlin, Heidelberg, 2010.

G. Salton, J. Allan, and C. Buckley, “Approaches to passage retrieval in full text information systems,” Proceedings of the 16th annual international ACM SIGIR conference on Research and development in information retrieval, ACM, 1993.

M. R. H. Rakib, A. Islam, and E. E. Milios. “TrWP: Text Relatedness using Word and Phrase Relatedness,” In SemEval@ NAACL-HLT, pp. 90-95, 2015.

S. Deerwester, S. T. Dumais, G. W. Furnas, T. K. Landauer, and R. Harshman, “Indexing by latent semantic analysis,” Journal of the American Society for Information Science, vol. 41, no. 6, pp. 391-407, Sep. 1990.

R. Mihalcea, C. Corley, and C. Strapparava. “Corpus-based and knowledge-based measures of text semantic similarity”. In Proceedings of AAAI’06, 2006.

Y. Li, Z. A. Bandar and D. McLean, “An approach for Measuring Semantic Similarity between Words Using Multiple Information Sources,” IEEE Transactions on Knowledge and Data Engineering, vol. 15, no. 4, pp. 871-882, 2003.

D. Lin, “An information-theoretic definition of similarity,” In Proc. of the 15th ICML, pp. 296–304, 1998.

X. Liu, Y. Zhou, R. Zheng, “Sentence similarity based on dynamic time warping,” In Semantic Computing, 2007 (ICSC 2007), International Conference on, pp. 250-256, 2007. IEEE.

A. Islam and D. Inkpen, “Semantic text similarity using corpus-based word similarity and string similarity,” ACM Trans. Knowl. Discov. from Data, vol. 2, no. 2, pp. 10:1–10:25, Jul. 2008

J. Jiang and D. Conrath. “Semantic similarity based on corpus statistics and lexical taxonomy,” In Proc. of the International Conference on Research in Computational Linguistics ROCLING X, 1998.

D. Lin. “Automatic retrieval and clustering of similar words,” In Proc. of the 17th COLING, pp. 768–774, 1998.

Z. Wu and M. Palmer, “Verb semantics and lexical selection,” In Proc. of the 32nd annual Meeting of the Association for Computational Linguistics, pp. 133 –138, New Mexico, USA, 1994.


  • There are currently no refbacks.

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.

ISSN: 2180-1843

eISSN: 2289-8131