Experian

Analista de Engenharia de Dados II - Vaga Afirmativa para Mulheres

Experian

Core Responsibilities

Develop, optimize, and maintain data ingestion pipelines using Autoloader. Process large-scale data with Spark Structured Streaming and Spark SQL. Implement data quality measures and create clear documentation for tasks. Collaborate with business and analytics teams to ensure data is structured and securely available.

Requirements

Experience with Databricks for processing and analyzing large data volumes. Solid knowledge of ETL processes and data integration. Experience in Data Engineering, focusing on building and optimizing scalable data pipelines. Familiarity with data architecture, data modeling, and cloud data solutions.

Additional Information

Experience Level

Mid-Level

Employment Type

permanent

Work Mode

Remote