About TrueFoundry

Every production AI system whether it's powering customer support, writing code, analyzing financial data, or diagnosing medical conditions needs the same foundational infrastructure.A way to route between models. A way to manage tools and integrate them securely. A way to orchestrate agents and enforce governance. A unified compute layer to run it all.

That infrastructure layer is being built right now.

We are looking for a Solution Architect

The Problem We're Solving

Companies are moving beyond simple chatbots to production agentic systems. These systems route between OpenAI, Anthropic, Google, and self-hosted models. They integrate dozens of tools via protocols like MCP. They orchestrate multi-agent workflows where agents coordinate with other agents.

The infrastructure to support this doesn't exist yet. You can't just duct-tape together a few API calls and call it production-ready.

You need a control plane that handles

• Intelligent routing with observability, cost policies, and fallback logic

• Centralized tool and MCP server management with security and lifecycle controls

• Agent orchestration with governance and guardrails

• A unified compute layer to run self-hosted models, custom tools, and agents

AI Gateway is the control plane five composable components (Prompts, LLM Gateway, MCP Gateway, Guardrails, Agent Gateway) that handle routing, orchestration, and governance.

We're Series A, backed by Intel Capital and Sequoia. Companies like CVS, Mastercard, Siemens, Paytm, Synopsys, and Zscaler run production AI workloads on our platform.

What you'll do

• Own the technical arc of the deal: discovery and the in-depth demo, the architecture discussion with the customer's engineering leaders, and the POC - all the way through to close.

• Win the POC on technical merit: Co-define the success criteria with the customer, run the execution tracker and the milestones, and write the integration glue, agent workflows, and eval pipelines that prove value in their environment. The goal is delivered impact, not lines of code.

• Make the architecture calls that decide how the customer will run AI in production. You are the technical decision-maker in the room - the CTO in the room - and the person their engineering leaders trust.

• Be the technical face of TrueFoundry to enterprise customers, and earn the credibility that turns an evaluation into a signed contract.

• Steer the product. You see, first-hand, what customers pull toward and where their first production win lands. Compile that field signal and bring structured, data-backed asks to TrueFoundry's engineering and product teams - your intuition helps shape the roadmap.

Who we're looking for

• Backend Engineering Experience: 3 to 7 years of backend software engineering experience with production systems you have shipped and owned. Strong in Python, Go, or TypeScript. Comfortable with Kubernetes or any major cloud (AWS, Azure, GCP).

• Business Acumen: You don’t just question the how but also the why - discovering impact, architecture design and deal-winning opportunities.

• AI and ML literacy: You have worked with LLMs, agents, evals, or ML pipelines in production. Familiarity with the modern stack (vLLM, SGLang, LangChain, Triton, model serving) is a strong plus.

• Design and Architecture: Comfortable leading an architecture discussion with a customer's engineering leaders, then doing the work yourself. High agency and a bias for action.

• We especially welcome founding engineers and CTOs of early-stage startups, as well as engineers from infrastructure, MLOps, and developer-tool companies.

Traits we are looking for: Ownership, ability to execute, hustle and think out of the box, data-driven decision-making, be comfortable with more unknowns than knowns.

Perks of Working at TrueFoundry

• Join a fast-growing Series A, Bay Area-based startup building cutting-edge AI infrastructure.

• Comprehensive health insurance for you and your family.

• Flexible hybrid work, 3 days a week in the office (Tuesday, Wednesday, and Thursday), with flexibility around the schedule.

• Lunch and snacks are on us whenever you come into the office.

• Work from another TrueFoundry office for up to 3 months each year, whether that's our London or Bay Area office, if you'd like a change of scenery.