Software Engineer, Systems ML

Skip to main content

Jobs

Teams

Career Programs

Working at Meta

Blog

Podcasts

Jobs

Software Engineer, Systems ML

Software Engineer, Systems ML

Menlo Park, CA

Engineering

+ 2 more

Apply now

Meta is seeking a Software Engineer to join our Systems ML Engineering team, focused on building and optimizing the machine learning infrastructure that powers Meta's products at massive scale. In this role, you will design and develop high-performance ML systems, working across the full stack from model training and inference pipelines to hardware-aware optimizations.

You will collaborate with researchers, platform engineers, and product teams to accelerate ML workloads and improve the efficiency of AI infrastructure that serves billions of users.

Software Engineer, Systems ML Responsibilities

• Design, build, and optimize large-scale ML training and inference systems, including distributed computing frameworks and hardware-accelerated pipelines
• Develop and maintain high-performance ML infrastructure components in C++ and Python, ensuring reliability, scalability, and low-latency execution
• Identify and resolve performance bottlenecks across the ML stack using profiling, instrumentation, and benchmarking tools
• Architect and evaluate trade-offs in ML system design, including memory bandwidth, compute utilization, and I/O throughput
• Partner with research and product teams to translate ML model requirements into efficient infrastructure solutions
• Write automated tests covering expected behaviors, failure modes, and error paths for ML infrastructure components, and build monitoring and alerting for production anomalies
• Contribute to staged rollout strategies using feature flagging and experimentation frameworks to safely deploy ML system changes
• Produce accurate technical documentation when introducing new ML infrastructure features or updating existing systems
• Participate in on-call rotations to investigate and mitigate production incidents affecting ML serving systems, and contribute detailed retrospectives
• Provide constructive code review feedback to other engineers and contribute to engineering programs that improve the health and quality of the ML infrastructure codebase

Minimum Qualifications

• Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta
• 2+ years of experience in software engineering with a focus on machine learning systems, AI infrastructure, or high-performance computing
• Experience developing or optimizing ML training or inference pipelines using frameworks such as PyTorch, TensorFlow, or equivalent
• Experience with distributed computing architectures and large-scale systems design for ML workloads
• Experience programming in C++ and Python for performance-critical systems
• Experience using profiling and performance analysis tools to identify and resolve bottlenecks in ML or compute-intensive systems

Preferred Qualifications

• Experience with ML compiler technologies such as MLIR, LLVM, TVM, XLA, or IREE
• Demonstrated ongoing AI skill development (e.g., prompt/context engineering, agent orchestration) and staying current with emerging AI technologies
• Demonstrated ability to integrate AI tools to optimize/redesign workflows and drive measurable impact (e.g., efficiency gains, quality improvements)
• Experience with GPU programming using CUDA, ROCm, or equivalent hardware accelerator kernel development
• Experience adhering to and implementing responsible, ethical AI practices (e.g., risk assessment, bias mitigation, quality and accuracy reviews)
• Experience with hardware-software co-design, including numerics optimization and SIMD or vectorization techniques
• Experience optimizing large-scale ranking or recommendation model inference on AI accelerator hardware such as GPUs or TPUs

About Meta

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world.

Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

For those who live in or expect to work from California if hired for this position, please click here for additional information.

United States of America: $121,992/year to $181,000/year + bonus + equity + benefits

Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits.

Learn more about benefits at Meta.

Equal Employment Opportunity

Meta is proud to be an Equal Employment Opportunity employer.

We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics.

You may view our Equal Employment Opportunity notice here .

Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, fill out the Accommodations request form .

Apply for this job

Take the first step toward a rewarding career at Meta. Apply now

APPLY NOW

Find your role

Explore jobs that match your skills and experience. Search by technology, team or location to find an opening that’s right for you.

View jobs

Meta AI

Recruiters can view your conversations with AI. Using AI is optional and does not impact the outcome of your application process. Learn more

about AI usage and settings.

Sign up

to ask follow-up questions

Job Search

Technology Teams

Artificial Intelligence Creative Infrastructure Metaverse and Wearables Product and Program Management Research and Data Security Software Engineering

Business Teams

Business Operations Partnerships Sales and Marketing

Career Programs

Research Accelerate Eng Talent Students and Grads Rotational Programs

Working at Meta

Accessiblity and Engagement Benefits Culture Hiring Process

My account

Career profile Account settings Messages

Meta Careers Blog

Meta Tech Podcasts

About us

About Meta

Media gallery Brand resources For investors Looking for contractor roles?

Job Search

Technology Teams

Artificial Intelligence

Creative

Infrastructure

Metaverse and Wearables

Product and Program Management

Research and Data

Security

Software Engineering

Business Teams

Business Operations

Partnerships

Sales and Marketing

Career Programs

Research

Accelerate Eng Talent

Students and Grads

Rotational Programs

Working at Meta

Accessiblity and Engagement

Benefits

Culture

Hiring Process

My account

Career profile

Account settings

Messages

Meta Careers Blog

Meta Tech Podcasts

About us

About Meta

Media gallery

Brand resources

For investors

Looking for contractor roles?

Community Standards Data Policy Terms Cookie Policy

Equal Employment Opportunity Meta is proud to be an Equal Employment Opportunity employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, ch