SDET - EST Candidates only - F2F Interview

Location

Remote (EST Candidates Only — Note: Final interview is F2F in NJ ) Mandatory Skills: Python, PySpark, SQL, AWS, Data Lakehouse The SDET (Software Development Engineer in Test) is responsible for ensuring the quality and reliability of ETL processes and data integration workflows.

This role involves designing and implementing automated tests to validate data transformation and migration, as well as collaborating with data engineers and developers to identify and resolve data quality issues. The ideal candidate will leverage their expertise in ETL testing and data validation to enhance the overall data pipeline performance and integrity.

Minimum Qualifications

• At least 8 years of IT experience with a minimum of 5 years of experience in the following skills: Tech Skills: Proficiency in ETL Testing and developing automation framework & test cases in at least one scripting language.
• Strong SQL skills, with experience in handling big data using ETL tools (e.g., Informatica).
• Mandatory work experience with PySpark.

Testing experience in cloud environment (AWS)

• S3, SSS, Glue, EMR, Data Catalog, Crawler, SQS, ETL Jobs, Event Bridge.
• Athena, Redshift Spectrum Databases.
• AWS Commands for running the jobs, file process and movements.
• Experience with Test Automation and DevOps practices in ETL and Cloud Systems.
• Work experience in a Big Data ecosystem processing data in data lakehouse.
• Familiarity with DBT (Data Build Tool) or similar data transformation tools is a plus.
• Experience providing testing oversight in Agile team.
• Should have excellent business communication to interact with Business teams and cross-functional teams.