Data scraping on digital platforms

• Grant number: 25/22559-7
• Support Opportunities: Scholarships in Brazil - Scientific Initiation
• Start date: November 01, 2025
• End date: October 31, 2026
• Field of knowledge: Interdisciplinary Subjects
• Principal Investigator: Alvaro Augusto Comin
• Grantee: Murilo Rocha Souto Maior
• Host Institution: Fundação Sistema Estadual de Análise de Dados (SEADE). São Paulo , SP, Brazil
• Associated research grant: 23/18026-8 - Center for Data Science in Public Statistics, AP.CCD

Abstract

The new paradigm of information production and analysis in the digital era, with data from new sources, in large volumes and high frequency, requires the use of new computational tools and specific methods for generating statistics for society and for public policy planning.The Data Science Center seeks to provide solutions to the challenge of using large volumes of unstructured and high-frequency data (big data) to produce public policy indicators. The Labor Market Monitor aims to combine traditional databases with different data collection methods (computer-assisted telephone interviewing, IVR, Internet) to generate indicators on employment and unemployment, training, and labor market insertion:a) Activity status, aligning the International Labour Organization's (ILO) concepts of work, employment, and income with new data collection techniques; andb) Human resource training in Data Science and labor market integration, addressing the educational infrastructure of the State of São Paulo, by combining administrative sources of educational and occupational information with data from digital platforms.