Lead Data Engineer

Lead Data Engineer

• Lead the design and implementation of scalable data platforms and engineering solutions aligned with business needs.
• Optimize data pipelines for performance, reliability, and cost efficiency using Azure Data Factory (ADF), Azure Databricks, and SQL.
• Implement incremental data loads, handle schema changes, process large datasets, and troubleshoot production failures.
• Design fault-tolerant pipelines with restart and recovery mechanisms to prevent duplicate records.
• Lead and mentor data engineers while establishing engineering standards and best practices.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.
• Strong hands-on experience with scenario-based problem-solving in Databricks, ADF, PySpark, and SQL.