Manager, Business Analysis
- Location
- California - San Francisco · San Francisco
- Employment
- Full-time
- Level
- Mid level
- Experience
- 3+ years
Posted Nov 20, 2026Last confirmed open Nov 21, 2026
About this role
As an Evaluation Manager on the Digital Success Data & AI team, you will lead the design, evolution, and operational excellence of evaluation programs that measure and improve Agentforce performance across Salesforce products. You will shape evaluation methodologies, quality standards, and scalable frameworks that enable consistent, trustworthy measurement while influencing product strategy and release readiness.
Beyond executing evaluations, you will define how evaluations are performed—improving sampling methodologies, evaluation criteria, success metrics, tooling, and reporting standards. You will partner closely with Product, Engineering, Operations, Data Science, and executive stakeholders to ensure evaluation insights drive meaningful business decisions and continuous product improvement.
You will serve as a subject matter expert on evaluation strategy, mentoring peers, driving cross-functional alignment, and continuously improving how evaluation operates at scale. Success in this role requires strategic thinking, operational excellence, and the ability to influence decisions through data, clarity, and trusted expertise.
Your Impact
- Lead evaluation strategy for major product initiatives, ensuring methodologies produce accurate, scalable, and business-relevant insights.
- Design and continuously improve evaluation frameworks , scoring methodologies, sampling strategies, and quality standards across products.
- Drive complex evaluation programs from planning through executive readout , ensuring high-quality execution across multiple concurrent initiatives.
- Translate evaluation findings into strategic recommendations that influence product roadmaps, operational priorities, and customer experience improvements.
- Partner with Product, Engineering, Operations, and executive stakeholders to establish evaluation success criteria and measurement strategies before launch.
- Develop scalable reporting frameworks, dashboards, and executive narratives that communicate quality trends, business risk, and product readiness.
- Identify systemic quality gaps and lead initiatives that improve evaluation efficiency, automation, consistency, and governance.
- Provide quality oversight across evaluation workstreams , reviewing methodologies and mentoring other Evaluation Managers to ensure consistency and rigor.
- Advance LLM judges, golden datasets, acceptance criteria, and evaluation tooling to increase confidence and reduce manual effort.
- Drive cross-functional alignment on evaluation standards, best practices, and operational processes across multiple product areas.
- Serve as a trusted advisor during product launches, providing objective evaluation guidance and evidence-based recommendations.
- Continuously identify opportunities to mature the organization's evaluation capabilities through innovation, experimentation, and operational improvements.
Required Skills
- 3+ years of experience in program management, project management, product operations, analytics, AI evaluation, quality assurance, or related disciplines.
- Demonstrated expertise designing evaluation methodologies, measurement frameworks, or operational quality programs.
- Strong analytical and business acumen with the ability to connect technical findings to business outcomes.
- Experience leading cross-functional initiatives involving Product, Engineering, Operations, and executive stakeholders.
- Excellent written and verbal communication skills, including executive-ready documentation and presentations.
- Strong program management capabilities with experience balancing multiple strategic initiatives simultaneously.
- Ability to simplify complex technical concepts into actionable recommendations for diverse audiences.
- Demonstrated success improving operational processes through automation, standardization, or tooling enhancements.
- Experience mentoring teammates or providing technical leadership within cross-functional environments.
How We
Work
- Clarity: We optimize for being understood, not sounding smart. Executive-ready summaries, clean narratives, no overcomplication.
- Operational rigor & integrity: Our work must be accurate, defensible, and trusted. Show your work — assumptions, data sources, and logic matter.
- Curious bias for action: We ask “why” in service of forward progress. Insight only matters if it leads to better outcomes.
- Customer Zero mindset: We use our own products first to surface issues before customers do — test, break, learn, improve.
- Mutual support & collaboration: We operate as a team — sharing context, helping each other unblock work, and maintaining strong operational awareness.
Prefer to apply directly?
Apply on Salesforce