Data Engineer

We are seeking an experienced Data Engineer to design, develop, and maintain data systems that consolidate and analyze structured and unstructured data from diverse sources. This role involves creating actionable insights, building data pipelines, and supporting complex business problems through advanced analytics and machine learning solutions.

About the Role

This position focuses on generating reports, datasets, and analytical solutions for end-users. You will work with system tools, database queries, and data warehouse scripts to support business intelligence and data-driven decision-making. The role includes designing specifications for reports based on business requests and building solutions that enhance client services and product offerings.

Responsibilities

• Address business problems by applying advanced analytics techniques to large, unstructured datasets
• Design databases for unstructured data, defining storage, consumption, integration, and management strategies
• Develop optimal techniques to explore correlations between disparate datasets and provide coaching on data transformation and cleaning
• Conduct exploratory data analysis from complex data sources and build key datasets
• Design, develop, and program methods and processes to consolidate and analyze diverse data sources
• Integrate data from multiple sources to produce requested data elements
• Program and maintain reports, information dashboards, data generators, and end-user information portals
• Work closely with data analysts and data engineers to review data pipelines and identify optimization opportunities
• Translate complex business requirements into data science and artificial intelligence solutions aligned to business goals
• Build or define machine learning and AI solutions that create measurable business value
• Analyze and model data to understand complex business issues and provide insights to decision-makers
• Use advanced mathematical and statistical concepts to analyze data, identify trends, and interpret patterns

Requirements

• AWS experience required
• Azure Databricks experience required
• Proficiency in Python and PySpark
• Must be a Green Card holder
• Ability to work hybrid with at least 3 days on-site (including Tuesday and Wednesday)

Nice to Have

• Experience with machine learning and AI solution development
• Background in statistical analysis and data modeling
• Experience working with both structured and unstructured data sources