CI&T

[Job - 31575] Senior /Master Data Developer, Brazil

CI&T

What You'll Do

Translates legacy Databricks notebook logic into modern ELT patterns, prioritizing declarative SQL-based transformation for standard cases and developing Python-based distributed processing routines for intricate logic. Ensures backward compatibility during migration by implementing trusted-core layering and reverse-view strategies. Builds scalable ingestion pipelines by parameterizing YAML configurations that feed an automated DAG generation pipeline.

What We're Looking For

Strong, hands-on technical depth in Python, PySpark, and advanced SQL for large-scale distributed data processing. Robust experience migrating data lakes and refactoring legacy code, including reverse-engineering tightly coupled logic into modular cloud-native components. Practical mastery of the Google Cloud data engineering ecosystem, particularly BigQuery, Dataform, and Dataproc Serverless.

What We Offer

Important: if you reside in the Metropolitan Region of Campinas, your presence in the city offices will be mandatory, according to the current attendance policy.

Additional Information

Experience Level

Senior

Job Language

Portuguese

Employment Type

Full-time

Work Mode

On-site