Skip to main content
Back to Jobs

ML Engineer

Deploy and monitor ML systems handling millions of records per day

As an ML Engineer at CreatorIQ, you will deploy and monitor machine learning systems in production, including classical NLP, embedding models, and LLM-powered features processing millions of records daily. You will own the evaluation stack using golden datasets and model-as-a-judge frameworks, and build and maintain the vector embeddings ecosystem for retrieval, classification, and similarity tasks. You will partner with Data Science and Engin...

Why This Role?

Work on LLM-powered features and vector embeddings ecosystem at scale

Key Responsibilities

  • Deploy and monitor ML systems in production, including classical NLP, embedding models, and LLM-powered features
  • Own the evaluation stack using golden datasets, model-as-a-judge frameworks, and regression tests
  • Build and maintain the vector embeddings ecosystem and related retrieval, classification, and similarity patterns
  • Partner with Data Science and Engineering teams on model deployment and infrastructure decisions
  • Ensure ML systems work reliably at scale and are continuously evaluated against ground truth
  • Make data and infrastructure decisions that turn experimental data science into cost-efficient products

Requirements

  • Experience deploying ML systems in production
  • Experience with model evaluation and monitoring systems
  • Experience building or maintaining vector embeddings and retrieval systems
  • Experience working with LLMs or traditional NLP models
  • Ability to partner with cross-functional teams on data and infrastructure decisions
  • Experience ensuring ML systems scale to handle millions of records per day

Required Skills

machine learningpythonmodel deploymentML monitoringvector embeddingsLLM applicationsevaluation systems

Indonesia Context

Working Hours Overlap:
Flexible — work your own hours
See remote (USD) vs local pay →

Keywords

ML Engineerapplied AIvector embeddingsLLM featuresmodel evaluationproduction MLCreatorIQremote ML job
View Original Description from Ashby Job Boards

Original description from Ashby Job Boards

CreatorIQ is the operating system for creator-led growth trusted by more than 1,300 global brands and agencies. We’re on a mission to make businesses more human, and humans more impactful. We operate by our values — be intentional, pursue excellence every day, embrace the journey together, and be a good human — every day. CreatorIQ has earned the title of best companies to work for in multiple programs, including BuiltIn LA and NY. It’s been named a Fastest-Growing Company in North America on the Deloitte Technology Fast 500™ for four years, was named a leader in IDC MarketScape: Worldwide Influencer Marketing Platforms for Large Enterprises in 2025, was named a Leader by The Forrester New Wave™: Influencer Marketing Solutions, and has been consistently recognized by G2 as a Leader, and is rated 5 stars on Influencer MarketingHub. We operate in a flexible work model that combines both in-person and remote work to boost collaboration, enhance innovation, and adapt to individual work styles. We're seeking passionate, innovative minds to join our journey. Be a part of our dynamic team and let's transform the industry together! MACHINE LEARNING ENGINEER, APPLIED AI As a MLE you'll join our Product Innovations team and work across the full applied ML stack - deploying models, building the evaluation systems that tell us whether they actually work, and making the data and infrastructure decisions that turn experimental data science into cost-efficient products. You'll partner closely with our Data Science and Engineering teams on our vector embeddings ecosystem, ground truth pipelines, model evaluation, and the pre/post-processing decisions that determine product quality. This is a production focused role, with some research opportunities. You'll be the engineer who makes sure our ML systems - both traditional NLP and embedding models and our LLM-powered features - work reliably at scale (millions of records per day), are continuously evaluated against ground truth, and improve over time. What you'll do - Deploy and monitor ML systems in production, from classical NLP and embedding models to LLM-powered features - where "production" means millions of records per day - Own the evaluation stack - golden datasets, "model-as-a-judge" frameworks, inter-annotator agreement, and regression tests that gate releases - Build and maintain our vector embeddings ecosystem and the retrieval, classification, and similarity patterns that sit on top of it - Partner with Data Science on annotation workflows, PII scrubbing, and ground-truth pipelines - Improve our MLOps foundations - versioning, observability, drift detection - so the rest of the team can ship faster - Translate fuzzy product problems into measurable AI features with clear success criteria What you've done - 4–7 years of professional software or ML engineering experience, including 2+ years shipping ML systems to production - Strong Python; comfort with the modern data/ML stack - Hands-on experience deploying and monitoring models in at least one major cloud (AWS or GCP); willingness to learn the other - Production experience with NLP or ML systems - classification, NER, embeddings, ranking, similarity, or LLM-powered features (most candidates have done some mix of traditional ML and LLM work; we care that you've shipped, not which camp you came up in) - Practical experience with evaluation for ML or LLM systems - golden datasets, model-as-a-judge, IAA, precision/recall, or equivalent. You don't need to have built one from scratch, but you should know why they matter and how to improve them - Collaborative communicator - you work well alongside data scientists and engineers, and can clearly explain ideas, requirements, and tradeoffs to non-technical stakeholders Bonus - Experience with vector databases or retrieval systems at scale - Experience with managed ML services on AWS (SageMaker) and/or GCP (Vertex AI) - Annotation workflow experience (Label Studio, Scale AI, or similar) and a point of view on inter-annotator agreement - Familiarity with PII scrubbing patterns and privacy-by-design data handling - Open-source contributions, blog posts, or talks on LLM/embedding production work Confidence can sometimes hold us back from applying for a job. But we'll let you in on a secret: there's no such thing as a 'perfect' candidate. Have 50% of the criteria? Excited about this opportunity? Passionate about what we do at CreatorIQ? Please apply! CreatorIQ is a place where everyone can grow. What you will get from us: - People: work with talented, collaborative, and friendly people who love what they do. - Guidance: utilize our learning platform to fully get the training and tools you’ll need to become successful here from your first day with us. - Surprise meal stipends: work from home can’t stop the enjoyment of someone else making a meal for you! - Work/life harmony: 15 days vacation, floating and set holidays, wellness allowance, and paid parental leave. - Whole Health Package: medical, dental, vision, life, disability insurance, and more. - Savings: a 401k (USA) plan to help you plan ahead. - Work from home stipend: to assist you in setting up a home office that works for you (or buy a new dog leash - your choice!). Who we are: CreatorIQ is the operating system for creator-led growth. Trusted by more than 1,300 global brands and agencies—including Burson, Delta Air Lines, Google, LVMH, Nestlé, and Sephora—CreatorIQ unifies creator marketing across paid, owned, earned, commerce, and community into one seamless, enterprise-grade ecosystem. With industry-leading intelligence infrastructure, rigorous compliance and security standards, and integrations with Meta, Snapchat, TikTok, YouTube, and more, CreatorIQ empowers brands and agencies to harness the creator economy as a strategic growth engine. CreatorIQ is a global company headquartered in Los Angeles with offices in Austin, New York, San Francisco, London, Manila, and Warsaw. Learn more at http://www.creatoriq.com/www.creatoriq.com http://www.creatoriq.com and follow us on LinkedIn https://www.linkedin.com/company/creatoriq and Instagram https://www.instagram.com/creatoriq. At CreatorIQ, we believe that diversity is the key to unlocking our full potential. We are committed to fostering an inclusive, equitable, and empowering work environment where everyone can thrive, regardless of race, ethnicity, gender, sexual orientation, age, religion, disability, or any other characteristic that makes us unique. By embracing our core values of being intentional, pursuing excellence every day, embracing the journey together, being a good human, and staying focused on what’s important, we create an atmosphere that promotes collaboration and growth. Join us to celebrate differences, innovate together, and be a part of a business that is disrupting the marketing industry. Compensation, benefits, and beyond: We understand that a comprehensive benefits package plays a significant role in your overall compensation. To gain more insight into the various components of our total compensation, we invite you to review our benefits and perks https://creatoriq.notion.site/What-you-ll-get-from-us-at-CreatorIQ-d252de0c5995417f89b564cfdbbc4b24?pvs=4. AI Transparency Notice We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications and note taking during interviews. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please refer to our Global Candidate Privacy Notice https://creatoriq.notion.site/Global-Candidate-Privacy-Notice-1f29bdd3fbd98069a1e2eb6acefb3acf.

Salary Context

Similar Engineering roles on LokerDollar pay around $168.75k/yr (range $11.194k–999.999k/yr, n=376 active listings).

Hiring at CreatorIQ

CreatorIQ has 15 other active roles on LokerDollar and has been hiring here since Jul 4, 2026 — across Engineering, Marketing, Data & Analytics.

View all CreatorIQ openings →
Track this application + get a follow-up reminder

Free account · no credit card · Log in

Pro $9/mo · unlimited applies + AI resume

Remote-friendly · fits your timezone
Company
CreatorIQ
Source
Ashby Job Boards
Salary
Job Type
full time
Location
Remote
Category
Seniority
mid
Posted
Jun 4, 2026

Share this job

Help a friend find their next remote role.

Frequently asked questions

Is ML Engineer at CreatorIQ a remote job?
This role is based in Remote. See the listing for remote/onsite details.
What is the salary for ML Engineer at CreatorIQ?
The listed pay range for this role is $132k–165k/yr.
What type of employment is ML Engineer at CreatorIQ?
This is a full time position.
How do I apply?
Click the "Apply" button on this page to go to the official application at CreatorIQ.

Explore related

Market data & reports

Salary & skill-demand research built from our own listings data.

From the blog

Track this application + get a follow-up reminder

Free account · no credit card · Log in

Pro $9/mo · unlimited applies + AI resume