Experian

Analista de Dados Sênior (Databricks)

Experian

What You'll Do

Develop and maintain data ingestion pipelines using Databricks. Design and implement data integration solutions from multiple sources including APIs and databases. Optimize processes using Apache Spark and ensure the quality and performance of data pipelines.

What We're Looking For

Proven experience with Databricks in production environments. Strong knowledge of Apache Spark (PySpark or Scala) and data ingestion and transformation pipelines. Advanced skills in Python and SQL, along with experience in Data Lake and Lakehouse solutions.

Additional Information

Experience Level

Senior

Job Language

Portuguese

Employment Type

Full-time

Work Mode

Hybrid