Infrastructure Architect - AI Platform & GenAI Infrastructure
Job details
- Work mode
- Hybrid
- Employment
- Contract
- Level
- Staff / principal
- Experience
- 10+ years
- Posted
- Oct 6, 2026
- Last confirmed open
- Oct 7, 2026
About this role
Role: Infrastructure Architect
Location: Concord, CA / Charlotte, NC – Hybrid 3 days WFO
Role Description: The candidate combines strong technical depth with the ability to define long-term architecture, influence roadmaps, and lead cross-functional initiatives.
Lead architecture and technical direction for:
· Enterprise GenAI Platform
· Agentic AI Platform
· Model Serving Infrastructure
· Prompt and Evaluation Frameworks
· AI Governance and Guardrails
· Agent Runtime Platforms
· Observability and AI Operations
Multi-Cloud AI Platform
Design and drive architecture across:
· OpenShift AI / RHOAI
· GCP Vertex AI
· Gemini Models
· Azure AI Foundry
· AWS Bedrock
· Anthropic Claude
· OpenAI
Platform Scalability & Resiliency
Lead initiatives involving:
· Capacity planning
· GPU platform strategy
· NVIDIA Super POD architecture
· Multi-region resiliency
· Cloud DR strategy
· Active-active platform architectures
· High availability and disaster recovery
Required Qualifications
- 10+ years of software engineering, infrastructure and architecture experience.
- 5+ years designing large-scale cloud-native platforms.
- Strong experience with:
- Kubernetes/OpenShift
- Distributed systems
- Cloud architectures
- AI/ML platforms
- API platforms
- Data platforms
- Deep understanding of:
- Generative AI
- RAG architectures
- Agentic AI
- Model Serving
- MLOps
- Experience designing highly available Tier-1 production systems.