NEFUSI: NeuroFuzzy Similarity. Final Report

Martinez-Gil, Jorge NEFUSI: NeuroFuzzy Similarity. Final Report., 2022 [Preprint]

[img]
Preview
Text
nefusi.pdf

Download (182kB) | Preview

English abstract

This research work presents the final report for the NEFUSI project. In fact, we present here our research findings on building neurofuzzy models that automatically evaluate semantic textual similarity in an accurate and timely manner. We show that neural networks and fuzzy logic have different features that make them suitable for certain problems but unsuitable for others. Neural networks, on the one hand, are valuable tools for identifying patterns. However, they need to make it easier for people to comply with the decisions. On the other hand, interpretation is possible within fuzzy logic systems, but they cannot automatically derive the rules they use to make those decisions. These constraints served as the primary reason for developing a novel intelligent hybrid system, which combines two approaches to circumvent the individual effects of both limitations simultaneously.

Item type: Preprint
Keywords: Neurofuzzy systems, Semantic Textual Similarity
Subjects: I. Information treatment for information services > ID. Knowledge representation.
I. Information treatment for information services > IE. Data and metadata structures.
L. Information technology and library technology > LL. Automated language processing.
Depositing user: Dr Jorge Martinez-Gil
Date deposited: 22 Dec 2022 08:32
Last modified: 22 Dec 2022 08:32
URI: http://hdl.handle.net/10760/43794

References

Plamen P. Angelov and Richard A. Buswell. Automatic generation of fuzzy rule-based models from data by genetic algorithms. Inf. Sci., 150(1-2):17–31, 2003.

Daniel Cer, Yinfei Yang, Sheng-yi Kong, Nan Hua, Nicole Limtiaco, Rhomni St. John, Noah Constant, Mario Guajardo-Cespedes, Steve Yuan, Chris Tar, Brian Strope, and Ray Kurzweil. Universal sentence encoder for english. In Eduardo Blanco and Wei Lu, editors, Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing, EMNLP 2018: System Demonstrations, Brussels, Belgium, October 31 - November 4, 2018, pages 169–174. Association for Computational Linguistics, 2018.

Rudi Cilibrasi and Paul M. B. Vitanyi. The google similarity distance. IEEE Trans. Knowl. Data Eng., 19(3):370–383, 2007.

Pablo Cingolani and Jesus Alcala-Fdez. jfuzzylogic: a java library to design fuzzy logic controllers according to the standard for fuzzy control programming. Int. J. Comput. Intell. Syst., 6(sup1):61–75, 2013.

Oscar Cordon. A historical review of evolutionary learning methods for mamdani-type fuzzy rule-based systems: Designing interpretable genetic fuzzy systems. Int. J. Approx. Reason., 52(6):894–913, 2011.

Kalyanmoy Deb, Samir Agrawal, Amrit Pratap, and T. Meyarivan. A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput., 6(2):182–197, 2002.

Scott C. Deerwester, Susan T. Dumais, Thomas K. Landauer, George W. Furnas, and Richard A. Harshman. Indexing by latent semantic analysis. J. Am. Soc. Inf. Sci., 41(6):391–407, 1990.

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. Bert: Pre-training of deep bidirectional transformers for language understanding. Preprint arXiv:1810.04805, 2018.

Manaal Faruqui and Chris Dyer. Improving vector space word representations using multilingual correlation. In Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, EACL 2014, April 26-30, 2014, Gothenburg, Sweden, pages 462–471, 2014.

Lushan Han, Abhay L. Kashyap, Tim Finin, James Mayfield, and Jonathan Weese. Umbc ebiquity-core: Semantic textual similarity systems. In Mona T. Diab, Timothy Baldwin, and Marco Baroni, editors, Proceedings of the Second Joint Conference on Lexical and Computational Semantics, *SEM 2013, June 13-14, 2013, Atlanta, Georgia, USA, pages 44– 52. Association for Computational Linguistics, 2013.

Sebastien Harispe, Sylvie Ranwez, Stefan Janaqi, and Jacky Montmain. Semantic Similarity from Natural Language and Ontology Analysis. Synthesis Lectures on Human Language Technologies. Morgan & Claypool Publishers, 2015.

Eric H. Huang, Richard Socher, Christopher D. Manning, and Andrew Y. Ng. Improving word representations via global context and multiple word prototypes. In The 50th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, July 8-14, 2012, Jeju Island, Korea - Volume 1: Long Papers, pages 873–882, 2012.

Jay J. Jiang and David W. Conrath. Semantic similarity based on corpus statistics and lexical taxonomy. In Proceedings of the 10th Research on Computational Linguistics International Conference, ROCLING 1997, Taipei, Taiwan, August 1997, pages 19–33, 1997.

Juan J. Lastra-Diaz, Josu Goikoetxea, Mohamed Ali Hadj Taieb, Ana Garcia-Serrano, Mohamed Ben Aouicha, and Eneko Agirre. A reproducible survey on word embeddings and ontology-based methods for word similarity: Linear combinations outperform the state of the art. Eng. Appl. Artif. Intell., 85:645–665, 2019.

Claudia Leacock and Martin Chodorow. Combining local context and wordnet similarity for word sense identification. WordNet: An electronic lexical database, 49(2):265–283, 1998.

Dekang Lin. An information-theoretic definition of similarity. In Proceedings of the Fifteenth International Conference on Machine Learning (ICML 1998), Madison, Wisconsin, USA, July 24-27, 1998, pages 296–304, 1998.

E. H. Mamdani and S. Assilian. An experiment in linguistic synthesis with a fuzzy logic controller. Int. J. Hum.-Comput. Stud., 51(2):135–147, 1999.

Jorge Martinez-Gil. Coto: A novel approach for fuzzy aggregation of semantic similarity measures. Cogn. Syst. Res., 40:8–17, 2016.

Jorge Martinez-Gil. Semantic similarity aggregators for very short textual expressions: a case study on landmarks and points of interest. J. Intell. Inf. Syst., 53(2):361–380, 2019.

Jorge Martinez-Gil. A comprehensive review of stacking methods for semantic similarity measurement. Machine Learning with Applications, 10:100423, 2022.

Jorge Martinez-Gil and Jose M. Chaves-Gonzalez. Automatic design of semantic similarity controllers based on fuzzy logics. Expert Syst. Appl., 131:45–59, 2019.

Jorge Martinez-Gil and Jose M. Chaves-Gonzalez. Semantic similarity controllers: On the trade-off between accuracy and interpretability. Knowl. Based Syst., 234:107609, 2021.

Jorge Martinez-Gil and Jose Manuel Chaves-Gonzalez. A novel method based on symbolic regression for interpretable semantic similarity measurement. Expert Syst. Appl., 160:113663, 2020.

Jorge Martinez-Gil and Jose Manuel Chaves-Gonzalez. Sustainable semantic similarity assessment. Journal of Intelligent & Fuzzy Systems, 43(5):6163–6174, 2022.

Jorge Martinez-Gil, Riad Mokadem, Josef Kung, and Abdelkader Hameurlain. A novel neurofuzzy approach for semantic similarity measurement. In Matteo Golfarelli, Robert Wrembel, Gabriele Kotsis, A Min Tjoa, and Ismail Khalil, editors, Big Data Analytics and Knowledge Discovery - 23rd International Conference, DaWaK 2021, Virtual Event, September 27-30, 2021, Proceedings, volume 12925 of Lecture Notes in Computer Science, pages 192–203. Springer, 2021.

Tomas Mikolov, Ilya Sutskever, Kai Chen, Gregory S. Corrado, and Jeffrey Dean. Distributed representations of words and phrases and their compositionality. In Advances in Neural Information Processing Systems 26: 27th Annual Conference on Neural Information Processing Systems 2013. Proceedings of a meeting held December 5-8, 2013, Lake Tahoe, Nevada, United States., pages 3111–3119, 2013.

G. Miller and W. Charles. Contextual correlates of semantic similarity. Language and Cognitive Processes, 6(1):1–28, 1991.

Detlef D. Nauck and Rudolf Kruse. Neuro-fuzzy systems for function approximation. Fuzzy Sets Syst., 101(2):261–271, 1999.

Roberto Navigli and Federico Martelli. An overview of word and sense similarity. Nat. Lang. Eng., 25(6):693–714, 2019.

Matthew E Peters, Mark Neumann, Mohit Iyyer, Matt Gardner, Christopher Clark, Kenton Lee, and Luke Zettlemoyer. Deep contextualized word representations. In Proceedings of NAACLHLT, pages 2227–2237, 2018.

Philip Resnik. Semantic similarity in a taxonomy: An information-based measure and its application to problems of ambiguity in natural language. J. Artif. Intell. Res., 11:95–130, 1999.

Leszek Rutkowski and Krzysztof Cpalka. Flexible neuro-fuzzy systems. IEEE Trans. Neural Networks, 14(3):554–574, 2003.

Barbara Rychalska, Katarzyna Pakulska, Krystyna Chodorowska, Wojciech Walczak, and Piotr Andruszkiewicz. Samsung poland NLP team at semeval-2016 task 1: Necessity for diversity; combining recursive autoencoders, wordnet and ensemble methods to measure semantic similarity. In Proceedings of the 10th International Workshop on Semantic Evaluation, SemEval- NAACL-HLT 2016, San Diego, CA, USA, June 16-17, 2016, pages 602–608, 2016.

Himanshu Singh and Yunis Ahmad Lone. Deep Neuro-Fuzzy Systems with Python. Springer, 2020.

Tomohiro Takagi and Michio Sugeno. Fuzzy identification of systems and its applications to modeling and control. IEEE Trans. Syst. Man Cybern., 15(1):116–132, 1985.

Ganggao Zhu and Carlos Angel Iglesias. Computing semantic similarity of concepts in knowledge graphs. IEEE Trans. Knowl. Data Eng., 29(1):72–85, 2017.


Downloads

Downloads per month over past year

Actions (login required)

View Item View Item