
[Job - 31575] Senior /Master Data Developer, Brazil
CI&TWhat You'll Do
Translates legacy Databricks notebook logic into modern ELT patterns, prioritizing declarative SQL-based transformation for standard cases and developing Python-based distributed processing routines for intricate logic. Ensures backward compatibility during migration by implementing trusted-core layering and reverse-view strategies. Builds scalable ingestion pipelines by parameterizing YAML configurations that feed an automated DAG generation pipeline.
What We're Looking For
Strong, hands-on technical depth in Python, PySpark, and advanced SQL for large-scale distributed data processing. Robust experience migrating data lakes and refactoring legacy code, including reverse-engineering tightly coupled logic into modular cloud-native components. Practical mastery of the Google Cloud data engineering ecosystem, particularly BigQuery, Dataform, and Dataproc Serverless.
What We Offer
Important: if you reside in the Metropolitan Region of Campinas, your presence in the city offices will be mandatory, according to the current attendance policy.
Key Skills & Technologies
Additional Information
Experience Level
Senior
Job Language
Portuguese
Employment Type
Full-time
Work Mode
On-site