AI and Data Engineer

About the Role

We are seeking an experienced and driven Senior Data & AI Engineer to lead our core data infrastructure, advanced analytics, and AI/ML initiatives. In this role, you will design, build, and scale robust data pipelines, integrate complex healthcare datasets (such as CMS, claims/encounters, and FHIR/HL7), and implement machine learning models while ensuring strict HIPAA compliance and data security.

You will collaborate closely with cross-functional teams to translate complex data requirements into scalable production solutions.

Minimum Qualifications

• 8+ years in data engineering/analytics; 5+ years hands-on with Snowflake (compute, storage, virtual warehouses, tasks, streams, Snowpipe, Time Travel, RBAC, row/column masking, data sharing, Dynamic Tables).
• 2+ years with Microsoft Fabric (including OneLake, Lakehouses, Warehouses, Dataflows Gen2, Notebooks, Pipelines; capacity management).
• Strong data modeling expertise (dimensional/star, 3NF, data vault; surrogate keys, SCD types, conformed dimensions).

Data integration & transformation proficiency

SQL (advanced), dbt or Fabric Dataflows/Power Query M, ADF/Synapse/Fabric Pipelines, Python for ETL/ELT. Mapping from CMS data (e.g., Medicare datasets, claims/encounters), X12/EDI, FHIR/HL7, provider, and eligibility. Experience with structured (tables, CSV, Parquet) and unstructured (clinical notes, PDFs, blobs) data; NLP pipelines (optional but valued).

Machine learning: feature engineering, model training/evaluation, and deployment (e.g., scikit-learn, PyTorch/TensorFlow, Fabric ML/Notebook, Azure ML); production monitoring.

Security & compliance

HIPAA, PHI handling, auditing, data residency, BAAs; practical access control in Snowflake/Fabric. Strong communication; ability to author mapping specs, lineage docs, and present trade-offs to technical and non-technical stakeholders.