Détail du document
Identifiant
oai:arXiv.org:2402.13604
Sujet
Computer Science - Computation and... Economics - Econometrics I.2.7 I.7.0Auteur
Dahl, Christian Møller Johansen, Torben Vedel, ChristianCatégorie
Computer Science
Année
2024
Date de référencement
10/04/2024
Mots clés
descriptions occcanineRésumé
This paper introduces a new tool, OccCANINE, to automatically transform occupational descriptions into the HISCO classification system.
The manual work involved in processing and classifying occupational descriptions is error-prone, tedious, and time-consuming.
We finetune a preexisting language model (CANINE) to do this automatically, thereby performing in seconds and minutes what previously took days and weeks.
The model is trained on 14 million pairs of occupational descriptions and HISCO codes in 13 different languages contributed by 22 different sources.
Our approach is shown to have accuracy, recall, and precision above 90 percent.
Our tool breaks the metaphorical HISCO barrier and makes this data readily available for analysis of occupational structures with broad applicability in economics, economic history, and various related disciplines.
;Comment: All code and guides on how to use OccCANINE is available on GitHub https://github.com/christianvedels/OccCANINE
Dahl, Christian Møller,Johansen, Torben,Vedel, Christian, 2024, Breaking the HISCO Barrier: Automatic Occupational Standardization with OccCANINE
TurkishMMLU: Measuring Massive Multitask Language Understanding in Turkish
evaluate provide turkishmmlu questions language
The Measurement of Acculturation in Neuropsychological Evaluations of Hispanic/Latino Individuals across the Lifespan: A Scoping Review of the Literature
evidence review lifespan various validation acculturation measures
