Constituency Structure over Eojeol in Korean Treebanks
By: Jungyeul Park, Chulwoo Park
Potential Business Impact:
Helps computers understand Korean sentences better.
The design of Korean constituency treebanks raises a fundamental representational question concerning the choice of terminal units. Although Korean words are morphologically complex, treating morphemes as constituency terminals conflates word internal morphology with phrase level syntactic structure and creates mismatches with eojeol based dependency resources. This paper argues for an eojeol based constituency representation, with morphological segmentation and fine grained part of speech information encoded in a separate, non constituent layer. A comparative analysis shows that, under explicit normalization assumptions, the Sejong and Penn Korean treebanks can be treated as representationally equivalent at the eojeol based constituency level. Building on this result, we outline an eojeol based annotation scheme that preserves interpretable constituency and supports cross treebank comparison and constituency dependency conversion.
Similar Papers
Counting trees: A treebank-driven exploration of syntactic variation in speech and writing across languages
Computation and Language
Shows how talking and writing use different sentence parts.
Second language Korean Universal Dependency treebank v1.2: Focus on data augmentation and annotation scheme refinement
Computation and Language
Makes computers understand Korean learned by non-native speakers.
Subword Tokenization Strategies for Kurdish Word Embeddings
Computation and Language
Helps computers understand Kurdish words better.