D

Senior AI Engineer - APM Integrations

Datadog
1 month ago
Full-time
Remote
Worldwide
Remote Engineering

IDM is the team that works on Datadog APM integrations: the parts that connect Datadog to the tools and services customers use. The team’s job is to make it easier for engineers to build and maintain integrations over time, and to keep quality and reliability high. You will build AI-assisted tools that help with day-to-day engineering work, like drafting code changes, suggesting fixes, and checking results with tests and other automated checks. The goal is building tools that engineers can trust in real production work. You’ll also work closely with other teams, understand how they work, and build solutions that fit their process. You will define what “good” means for these tools, measure results, and improve them over time. You’ll set up evaluation and testing so the AI output stays correct and doesn’t silently get worse. This is a senior role with high ownership, from early prototypes to production and ongoing support.

At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

 

What You’ll Do:

  • Build agent workflows that take an integration need from plan to implementation and validation with humans approving at the right checkpoints
  • Create systems that synthesize context from codebases, docs, specs, telemetry, and historical incidents to make changes that match Datadog conventions and customer expectations
  • Generate and evolve integration code and tests, including end-to-end scenarios that reflect real customer workloads and product features
  • Design evaluation harnesses that prevent silent regressions: golden sets, scenario baselines, semantic checks, performance thresholds, and release gating
  • Build portfolio-level automation: proactive updates for upstream breaking changes, tracer feature rollouts across the catalog, migrations to new schemas/semantics, and targeted coverage expansion
  • Partner tightly with PM, support engineers, and integration-owning teams to make the system adoptable, trustworthy, and embedded in daily engineering workflows

 

Who You Are:

Product-minded engineer who ships AI to production

  • 6+ years building backend systems (Go, Java, or .NET) with strong focus on simplicity, correctness, and performance
  • Proven experience delivering LLM/agent features to production (prompting, tooling, evals, safety/guardrails)
  • Comfortable navigating ambiguity, iterating from prot