Extracting O*NET Features from the NLx Corpus to Build Public Use Aggregate Labor Market Data
By: Stephen Meisenbacher, Svetlozar Nestorov, Peter Norlander
Potential Business Impact:
Organizes job ads to show skills and pay.
Data from online job postings are difficult to access and are not built in a standard or transparent manner. Data included in the standard taxonomy and occupational information database (O*NET) are updated infrequently and based on small survey samples. We adopt O*NET as a framework for building natural language processing tools that extract structured information from job postings. We publish the Job Ad Analysis Toolkit (JAAT), a collection of open-source tools built for this purpose, and demonstrate its reliability and accuracy in out-of-sample and LLM-as-a-Judge testing. We extract more than 10 billion data points from more than 155 million online job ads provided by the National Labor Exchange (NLx) Research Hub, including O*NET tasks, occupation codes, tools, and technologies, as well as wages, skills, industry, and more features. We describe the construction of a dataset of occupation, state, and industry level features aggregated by monthly active jobs from 2015 - 2025. We illustrate the potential for research and future uses in education and workforce development.
Similar Papers
Standard Occupation Classifier -- A Natural Language Processing Approach
Computation and Language
Helps match job ads to job types.
Ontology-Aligned Embeddings for Data-Driven Labour Market Analytics
Machine Learning (CS)
Helps computers understand job titles from anywhere.
JobPulse: A Big Data Approach to Real-Time Engineering Workforce Analysis and National Industrial Policy
Computers and Society
Shows companies what workers they need.