Senior AI Platform Engineer

Principal AI Engineer

Location: New York, NY

Employment Type: Full-Time

Work Model: Hybrid (3 Days Onsite)

Position Overview

We are seeking a Senior AI / Agent Platform Engineer to build the execution layer powering enterprise AI agent capabilities. This role focuses on designing scalable runtime services and distributed systems that support long-running AI workflows in secure production environments.

Key Responsibilities

• Design and build runtime services for long-running, asynchronous AI workloads.
• Develop model routing and abstraction layers across multiple LLM providers.
• Implement tool invocation, execution state management, retries, checkpointing, and failure recovery.
• Build APIs and SDKs enabling reusable AI workflows.
• Develop tracing, telemetry, and evaluation capabilities.
• Collaborate with Security, Identity, and Platform Engineering teams.
• Experience with Knowledgegraph

Required Qualifications

• Strong software engineering and distributed systems background.
• Experience building production AI applications using LLMs, AI Agents, Function Calling, or Workflow Orchestration.
• Experience with asynchronous systems, queues, state management, retries, and observability.
• Understanding of model APIs, structured outputs, prompt/context management, and AI performance optimization.
• Cloud-native development experience (Containers, APIs, Kubernetes, Microservices).