Library

Chasing the Perfect Splitter: A Comparison of Different Compound Splitting Tools

This paper reports on the evaluation of two compound splitters for German. Compounding is a very frequent phenomenon in German and thus efficient ways of detecting and correctly splitting compound words are needed for natural language processing applications. This paper presents different strategies for compound splitting, focusing on German. Four compound splitters for German are presented. Two of them were used in Statistical Machine Translation (SMT) experiments, obtaining very similar qualitative scores in terms of BLEU and TER and therefore a thorough evaluation of both has been carried out.

Computer ScienceLinguistics
Source

Paper

Full text

PDF

Chasing the Perfect Splitter: A Comparison of Different Compound Splitting Tools

Semantic Scholar · Computer Science · 2014

Abstract

This paper reports on the evaluation of two compound splitters for German. Compounding is a very frequent phenomenon in German and thus efficient ways of detecting and correctly splitting compound words are needed for natural language processing applications. This paper presents different strategies for compound splitting, focusing on German. Four compound splitters for German are presented. Two of them were used in Statistical Machine Translation (SMT) experiments, obtaining very similar qualitative scores in terms of BLEU and TER and therefore a thorough evaluation of both has been carried out.

Source of record · Semantic Scholar

References (30)

01Generation of Compound Words in Statistical Machine Translation into Compounding LanguagesSara Stymne, Nicola Cancedda, Lars Ahrenberg2013 · International Conference on Computational Logic · 21 citations
02Linguistic Variation in the Austrian Media Corpus. Dealing with the Challenges of Large Amounts of DataRansmayr Jutta, Mörth Karlheinz, Ďurčo Matej2013 · 12 citations
03A Simple, Fast, and Effective Reparameterization of IBM Model 2Chris Dyer, Victor Chahuneau, Noah A. Smith2013 · North American Chapter of the Association for Computational Linguistics · 1.1k citations
04Jane 2: Open Source Phrase-based and Hierarchical Statistical Machine TranslationJoern Wuebker, Matthias Huck, Stephan Peitz et al.2012 · International Conference on Computational Linguistics · 51 citations
05Analyzing and Aligning German compound nounsMarion Weller, U. Heid2012 · International Conference on Language Resources and Evaluation · 19 citations
06Design and compilation of a specialized Spanish-German parallel corpusCarla Parra Escartín2012 · International Conference on Language Resources and Evaluation · 12 citations
07Wortbildung der deutschen GegenwartsspracheW. Fleischer2012 · 305 citations
08How to Avoid Burning Ducks: Combining Linguistic Analysis and Corpus Statistics for German Compound ProcessingFabienne Fritzinger, Alexander M. Fraser2010 · WMT@ACL · 44 citations
09German Compounds in Factored Statistical Machine TranslationSara Stymne2008 · GoTAL · 36 citations
10Statistical Machine Translation of German Compound WordsMaja Popovic, D. Stein, H. Ney2006 · FinTAL · 66 citations
11German Compound Analysis with wfscAnne Schiller2005 · Finite-State Methods and Natural Language Processing · 37 citations
12SMOR: A German Computational Morphology Covering Derivation, Composition and InflectionHelmut Schmid, A. Fitschen, U. Heid2004 · International Conference on Language Resources and Evaluation · 200 citations

Scroll for more · 18 remaining

Similar papers

A Joint Approach to Compound Splitting and Idiomatic Compound DetectionИ В Кротова, Sergey Aksenov, Ekaterina Artemova2020 · arXiv (Cornell University) · 6 citations In Library
Towards Unsupervised and Language-independent Compound Splitting using Inflectional Morphological TransformationsPatrick Ziering, Lonneke van der Plas2016 · North American Chapter of the Association for Computational Linguistics · 20 citations In Library
To Split or Not to Split: Composing Compounds in Contextual Vector SpacesChris Jenkins, Filip Miletić, Sabine Schulte im Walde2023 · Conference on Empirical Methods in Natural Language Processing · 3 citations In Library
German Compounds and Statistical Machine Translation. Can they get along?Carla Parra Escartín, Stephan Peitz, H. Ney2014 · MWE@EACL · 6 citations In Library
Unsupervised Compound Splitting With Distributional Semantics Rivals Supervised MethodsMartin Riedl, Chris Biemann2016 · North American Chapter of the Association for Computational Linguistics · 31 citations In Library
Analyzing and Aligning German compound nounsMarion Weller, U. Heid2012 · International Conference on Language Resources and Evaluation · 19 citations In Library
CompoundPiece: Evaluating and Improving Decompounding Performance of Language ModelsBenjamin Minixhofer, Jonas Pfeiffer, Ivan Vulić2023 In Library
CompoundPiece: Evaluating and Improving Decompounding Performance of Language ModelsBenjamin Minixhofer, Jonas Pfeiffer, Ivan Vulić2023 · arXiv (Cornell University) · 13 citations In Library
Kvistur 2.0: a BiLSTM Compound Splitter for IcelandicJón Friðrik Daðason, David Erik Mollberg, Hrafn Loftsson et al.2020 · arXiv (Cornell University) · 2 citations In Library
Synthesizing Compound Words for Machine TranslationAustin Matthews, Eva Schlinger, A. Lavie et al.2016 · Annual Meeting of the Association for Computational Linguistics · 9 citations In Library
© 2026 NYSGPT2525 LLC