Skip to main content
Back to Jobs

Senior Director, AI Engineering -Agentic AI Platform(Remote Eligible)

Oversee AI software components including LLM training and deployment

Partner with cross-functional teams to deliver AI-powered products that change how associates work and customers interact with Capital One. Oversee the design, development, testing, deployment, and support of AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability. Make high judgment build-vs-buy decisions across ...

Why This Role?

Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, and throughput

Key Responsibilities

  • Partner with engineers, research scientists, technical program managers, and product managers to deliver AI-powered products
  • Oversee design, development, testing, deployment, and support of AI software components including foundation model training and LLM inferenc
  • Make build-vs-buy decisions across Open Source and SaaS AI technologies like AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, and
  • Invent and introduce state-of-the-art LLM optimization techniques to improve performance, scalability, cost, latency, and throughput
  • Ensure governance and observability of AI systems including similarity search, guardrails, model evaluation, and experimentation

Requirements

  • Experience overseeing AI software component design, development, testing, deployment, and support
  • Expertise in foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, go
  • Experience making build-vs-buy decisions across Open Source and SaaS AI technologies including AWS Ultraclusters, Huggingface, VectorDBs, Ne
  • Ability to invent and introduce state-of-the-art LLM optimization techniques for performance, scalability, cost, latency, and throughput
  • Experience partnering with cross-functional teams of engineers, research scientists, technical program managers, and product managers

Required Skills

ai engineeringmachine learningproject managementstrategic decision makingteam leadershipLLM OptimizationFoundation ModelsML InfrastructureCross-functional LeadershipAI Governance

Indonesia Context

Working Hours Overlap:
Flexible — work your own hours
See remote (USD) vs local pay →

Keywords

AI Engineering DirectorLLM OptimizationFoundation Model TrainingAI Platform LeadershipBuild vs Buy DecisionsML ObservabilityAgentic AI PlatformCapital One AI
View Original Description from The Muse

Original description from The Muse

Senior Director, AI Engineering -Agentic AI Platform(Remote Eligible) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real-time, personalized customer experiences. Our investments in technology infrastructure and world-class talent - along with our deep experience in machine learning - position us to be at the forefront of enterprises leveraging AI. From informing customers about unusual charges to answering their questions in real time, our applications of AI & ML are bringing humanity and simplicity to banking. We are committed to continuing to build world-class applied science and engineering teams to deliver our industry leading capabilities with breakthrough product experiences and scalable, high-performance AI infrastructure. At Capital One, you will help bring the transformative power of emerging AI capabilities to reimagine how we serve our customers and businesses who have come to love the products and services we build. Team Description: The Intelligent Foundations and Experiences (IFX) team is at the center of bringing our vision for AI at Capital One to life. We work hand-in-hand with our partners across the company to advance the state of the art in science and AI engineering, and we build and deploy proprietary solutions that are central to our business and deliver value to millions of customers. Our AI models and platforms empower teams across Capital One to enhance their products with the transformative power of AI, in responsible and scalable ways for the highest leverage impact. In this role, you will: Partner with a cross-functional team of engineers, research scientists, technical program managers, and product managers to deliver AI-powered products that change how our associates work and how our customers interact with Capital One Oversee the design, development, testing, deployment, and support AI software components including foundation model training, large language model inference, similarity search, guardrails, model evaluation, experimentation, governance, and observability, etc. Make high judgment build-vs-buy decisions across a broad stack of Open Source and SaaS AI technologies such as AWS Ultraclusters, Huggingface, VectorDBs, Nemo Guardrails, PyTorch, and more Invent and introduce state-of-the-art LLM optimization techniques to improve the performance - scalability, cost, latency, throughput - of large scale production AI systems Contribute to the technical vision and the long term roadmap of foundational AI systems at Capital One. Attract and retain top talent in the AI industry and nurture personal and professional development for your team. Foster a culture of learning and staying abreast of the state-of-the-art in AI Capital One is open to hiring a Remote Employee for this opportunity The Ideal Candidate: You love to build systems, take pride in the quality of your work, and also share our passion to do the right thing. You want to work on problems that will help change banking for good Passion for staying abreast of the latest research, and an ability to intuitively understand scientific publications and judiciously apply novel techniques in production You get fulfillment from empowering others to achieve their potential and you actively drive professional development through mentoring and coaching. You are hands-on when necessary and lead by example You adapt quickly and thrive on bringing clarity to big, undefined problems. You love asking questions and digging deep to uncover the root of problems and can articulate your findings concisely with clarity. You have the courage to share new ideas even when they are unproven You are deeply technical. You possess a strong foundation in engineering and mathematics, and your expertise in hardware, software, and AI enable you to see and exploit optimization opportunities that others miss You are a resilient trailbl

Salary Context

Similar Data & Analytics roles on LokerDollar pay around $200k/yr (range $41.6k–999k/yr, n=60 active listings).

Hiring at Capital One

Capital One has 7 other active roles on LokerDollar and has been hiring here since May 7, 2026 — across Data & Analytics, Engineering.

View all Capital One openings →
Track this application + get a follow-up reminder

Free account · no credit card · Log in

Pro $9/mo · unlimited applies + AI resume

Source
The Muse
Job Type
full time
Location
Remote · Open worldwide
Seniority
lead
PostedFresh
Jul 24, 2026

Share this job

Help a friend find their next remote role.

Frequently asked questions

Is Senior Director, AI Engineering -Agentic AI Platform(Remote Eligible) at Capital One a remote job?
Yes. Senior Director, AI Engineering -Agentic AI Platform(Remote Eligible) at Capital One is a fully remote role open to candidates worldwide.
What type of employment is Senior Director, AI Engineering -Agentic AI Platform(Remote Eligible) at Capital One?
This is a full time position.
How do I apply?
Click the "Apply" button on this page to go to the official application at Capital One.

Explore related

Market data & reports

Salary & skill-demand research built from our own listings data.

From the blog

Track this application + get a follow-up reminder

Free account · no credit card · Log in

Pro $9/mo · unlimited applies + AI resume