What You'll Do
Develop and maintain data pipelines. Integrate data from various sources such as APIs, relational databases, and files. Collaborate with business and analytics teams to understand data requirements. Ensure quality, reliability, security, and governance of the ingested data.
What We're Looking For
Proven experience in building and managing large-scale data pipelines in Databricks (PySpark, Delta Lake, SQL). Strong programming skills in Python and SQL for data processing and transformation. Deep understanding of ETL/ELT frameworks, data warehousing, and distributed data processing. Familiarity with cloud platforms (AWS, Azure, or GCP) and related data services.
Key Skills & Technologies
Additional Information
Experience Level
Senior
Job Language
English
Employment Type
Full-time
Work Mode
Remote