Вход на сайт

Просмотр новости

Найдите то, что Вас интересует

Enhancing geocoding in Brazil through language model-based preprocessing

Дата публикации: 20-08-2026 08:15:02

Pita, R., Rocha, G., Ichihara, M., Harron, K., Brito, P., Carreiro, R., Almeida, B., Ramos, P., Barreto, M.ORCID logo & Barreto, M. (2026). Enhancing geocoding in Brazil through language model-based preprocessing. International Journal of Population Data Science, 11(5), p. 3757. https://doi.org/10.23889/ijpds.v11i5.3757

Основное содержимое страницы с новостью.

Pita, R., Rocha, G., Ichihara, M., Harron, K., Brito, P., Carreiro, R., Almeida, B., Ramos, P., Barreto, M.ORCID logo & Barreto, M. (2026). Enhancing geocoding in Brazil through language model-based preprocessing. International Journal of Population Data Science, 11(5), p. 3757. https://doi.org/10.23889/ijpds.v11i5.3757

Abstract

Similarity-based geocoding pipelines are highly sensitive to lexical noise in address data. This work evaluates the potential of language models to enhance and standardize address inputs during preprocessing, thereby improving geocoding accuracy in CIDACS-RL, which relies on Jaro-Winkler similarity and is sensitive to string length and prefix agreement. We extended CIDACS-RL with a preprocessing step that removes street types (e.g., street, avenue, lane) and stop words and expands numeric and abbreviated address components. Two pre-trained language models were included in the experiments. Records from nine Northeastern Brazilian states in the cohort baseline (N = 54,985,455) were geocoded by linking addresses to census tracts or coordinates from the Brazilian National Register of Addresses (CNEFE; N = 30,545,117). After linkage, we manually assessed the accuracy of our extension against previous CIDACS-RL version using stratified samples (N = 2,000) from each run to determine the cutoff points. The geocoding was evaluated using accuracy and precision. Overall, the proposed extension achieved competitive performance, with higher mean precision (0.86, SD = 0.01) and accuracy (0.94, SD = 0.024) compared to the original CIDACS-RL, which achieved a mean precision of 0.84 (SD = 0.02) and a mean accuracy of 0.93 (SD = 0.024). The largest gains were observed in states with shorter average street name lengths, such as Alagoas and Pernambuco, where precision increased by approximately 3% to 10%. Our findings support that geocoding tasks may benefit from pre-trained language models for preprocessing steps, addressing the limitation of well-posed similarity measures.

Схожие новости

#Наименование новостиТональностьИнформативностьДата публикации
1 Cenários de uso do RDC-Arq integrado ao SIGAD 013.7123-07-2026
2 Replication Data for: Coethnics Covote in Africa: Studying Electoral Cleavages with a Covoting Regression Model 05.5720-08-2026
3 Modelling in economic geography 07.7420-08-2026
4 Research on AI-generated disclosure characteristics, user sharing and behavioral intervention 09.7320-08-2026
5 Urban informal settlements: an overlooked context for adolescent digital safety 06.7520-08-2026
6 Replication Data for: Bringing Autocracy Home? How Migration to Autocracies Shapes Migrants' Support for Democracy 05.420-08-2026
7Remote Sensing for Forest Monitoring Across Four and a Half Decades: Mapping Knowledge Evolution, Scientific Collaboration, and Emerging Research Frontiers [version 2; peer review: awaiting peer review]0818-08-2026
8Review of Pattemore & Gesa (2025): Foreign language learning from audiovisual input: The role of original version television0514-07-2026
9 Gestión documental digital y eficiencia organizacional de empresas de ingeniería: revisión de literatura 06.1728-07-2026
10Papers accepted to Natural Language Processing conference01018-09-2013

Классификация: Наука. Схожих патентов: 0. Схожих новостей: 10. Тональность: 0. Информативность: 12.89. Источник: eprints.lse.ac.uk.