Automatic Extraction of Clausal Embedding Based on Large-Scale English Text Data
By: Iona Carslaw , Sivan Milton , Nicolas Navarre and more
Potential Business Impact:
Finds complex sentence parts in real writing.
For linguists, embedded clauses have been of special interest because of their intricate distribution of syntactic and semantic features. Yet, current research relies on schematically created language examples to investigate these constructions, missing out on statistical information and naturally-occurring examples that can be gained from large language corpora. Thus, we present a methodological approach for detecting and annotating naturally-occurring examples of English embedded clauses in large-scale text data using constituency parsing and a set of parsing heuristics. Our tool has been evaluated on our dataset Golden Embedded Clause Set (GECS), which includes hand-annotated examples of naturally-occurring English embedded clause sentences. Finally, we present a large-scale dataset of naturally-occurring English embedded clauses which we have extracted from the open-source corpus Dolma using our extraction tool.
Similar Papers
A large-scale, unsupervised pipeline for automatic corpus annotation using LLMs: variation and change in the English consider construction
Computation and Language
Lets computers sort words for language study.
Semantic Tree Inference on Text Corpa using a Nested Density Approach together with Large Language Model Embeddings
Computation and Language
Organizes texts into a family tree of ideas.
Scalable Multi-phase Word Embedding Using Conjunctive Propositional Clauses
Machine Learning (CS)
Helps computers understand words better, even long sentences.