What You'll Do
Develop, optimize, and maintain data ingestion pipelines using Autoloader. Process large-scale data with Spark Structured Streaming and Spark SQL. Implement data quality measures and create clear documentation for requirements.
What We're Looking For
Experience with Databricks for processing and analyzing large data volumes. Solid knowledge of ETL processes and data integration. Proven experience in Data Engineering, focusing on scalable data pipelines.
What We Offer
null
Additional Information
Experience Level
Mid-Level
Employment Type
permanent
Work Mode
Remote