What You'll Do
Build, maintain, and optimize robust data pipelines focusing on low latency, resilience, and data quality best practices. Develop scalable data routes using Apache Spark/PySpark and Databricks, ensuring efficient partitioning and cost optimization strategies. Structure and manage data using SQL Server and Delta Lake. Apply version control with Git, create CI/CD routines for deployment automation, and continuously monitor production routines.
What We're Looking For
Strong experience in data engineering and working in production environments. Experience with large data volumes and participation in migration, modernization, or data lake projects. Ability to investigate incidents and perform root cause analysis.
What We Offer
Presence in the Campinas Metropolitan Region office is mandatory according to the current attendance policy.
Key Skills & Technologies
Additional Information
Experience Level
Senior
Job Language
Portuguese
Employment Type
Full-time
Work Mode
Remote