Analista de Engenharia de Dados III

Develop, optimize, and maintain data ingestion pipelines using Autoloader. Process large-scale data with Spark Structured Streaming and Spark SQL. Implement data quality measures and create clear documentation for demands.

5+ years of experience in Data Engineering with a strong background in ETL/ELT processes. Proficiency in Apache Spark and Python, particularly in Databricks. Solid understanding of data architecture and modeling, as well as experience in cloud environments.

null