Szabó, Gábor and Kovács, László (2018) Benchmarking morphological analyzers for the Hungarian language. Annales Mathematicae et Informaticae, 49. pp. 141-166. ISSN 1787-6117
|
Text
AMI_49_from141to166.pdf - Published Version Download (982kB) | Preview |
Abstract
In this paper we evaluate, compare and benchmark the four most widely used and most advanced morphological analyzers for the Hungarian language, namely Hunmorph-Ocamorph, Hunmorph-Foma, Humor and Hunspell. The main goal of the current research is to define objective metrics while comparing these tools. The novelty of this paper is the fact that the analyzers are compared based on their annotation token systems instead of their lemmatization features. The proposed metrics for the comparison are the following: how different their annotation token systems are, how many words are recognized by the different analyzers and how many words are there whose morphological structure is equivalent using a well-defined mapping among the annotation token systems. For each of these metrics, we define the concept of similarity and distance. For the evaluation we use a unique Hungarian corpus that we generated in an automated way from Hungarian free texts, as well as a novel automated token mapping generation algorithm. According to our experimental results, Hunmorph-Ocamorph gives the best results. Hunmorph-Foma is very close to it, but sometimes returns an invalid lemma. Humor is the third best analyzer, while Hunspell is far worse than the other three tools. Keywords: natural language processing, grammar, morphology, lemmatization, inflection, morphological analyzers, Hungarian language MSC: 68T50
Item Type: | Article |
---|---|
Uncontrolled Keywords: | natural language processing, grammar, morphology, lemmatization, inflection, morphological analyzers, Hungarian language |
Subjects: | Q Science / természettudomány > QA Mathematics / matematika |
Depositing User: | Tibor Gál |
Date Deposited: | 26 Jan 2019 12:47 |
Last Modified: | 05 Apr 2023 07:56 |
URI: | http://real.mtak.hu/id/eprint/90538 |
Actions (login required)
Edit Item |