Staff AI Engineer | US | Remote

Grafana Labs is the company behind Grafana Cloud, the fully managed observability platform trusted by more than 10,000 organizations to ensure reliability, resolve incidents faster, and optimize telemetry at scale. Built on open source and open standards and designed for interoperability across any stack, Grafana Cloud brings AI to observability and observability to AI, giving teams (and their agents) unified visibility so they can see, understand, and act on all their disparate data, wherever it lives, and move at the speed of their ambitions. Customers, including Anthropic, Bloomberg, NVIDIA, Microsoft, and Salesforce, rely on Grafana Labs.

We are a 100% remote company with team members across 40+ countries, backed by leading investors including Lightspeed Venture Partners, Sequoia Capital, GIC, Coatue, J.P. Morgan, CapitalG, and Lead Edge Capital. Learn more at grafana.com and follow us on LinkedIn and X.

We’re scaling fast and staying true to what makes us different: an open-source legacy, a global collaborative culture, and a passion for meaningful work. Our team thrives in an innovation-driven environment where transparency, autonomy, and trust fuel everything we do.

You may not meet every requirement, and that’s okay. If this role excites you, we’d love you to raise your hand for what could be a truly career-defining opportunity.

This is a remote opportunity and we are looking for candidates from the U.S.

The Opportunity

Grafana Labs is seeking a Staff Engineer (AI & Automation) to own the AI agent infrastructure and automation platform that powers our Marketing Operations organization. You’ll build multi-agent architectures, LLM integrations, and backend services that connect AI models to internal and third-party data platforms. You’ll ship production systems that teams depend on daily.

This is a high-autonomy role where you own the technical direction. You’ll identify the highest-leverage problems across Marketing, RevOps, and SDR teams, design the solutions, and ship them. You’ll define the technical direction for the automation platform (data models, API contracts, shared libraries, reference architectures) and partner with Data Engineering, GTM Systems, and Field Operations to build scalable, self-service automation that eliminates manual work and drives operational efficiency.

What You'll Be Doing

Agentic Systems & AI Infrastructure
  • Own end-to-end development of multi-agent AI systems, from architecture and implementation through testing, deployment, and ongoing operation
  • Build modular, composable agentic systems using orchestration frameworks (LangChain, CrewAI, Anthropic MCP, or similar) that operate 24/7 across teams
  • Develop reusable agentic skills that agents invoke across interfaces (Slack, dashboards, internal apps, CLIs)
  • Implement observability and feedback loops including logging, performance metrics, prompt iteration, model evaluation, and cost management
  • Establish governance and compliance standards for AI workflows including access controls, audit trails, PII handling, and human-in-the-loop escalation paths
Systems Integration & Backend Services
  • Build MCP servers, APIs, CLIs, and microservices connecting AI models to business systems (BigQuery, Slack, CRMs, email, calendars, analytics tools)
  • Architect data flows for retrieval-augmented generation (RAG), connecting LLMs to internal knowledge bases, customer data, and real-time business context
  • Build serverless or containerized services (GCP Cloud Functions, Cloud Run) that scale with usage and integrate with Grafana's cloud infrastructure
Automation & Workflow Enablement
  • Partner with RevOps, Demand Generation, Regional Marketing, and SDR teams to scope high-impact automation problems, identify bottlenecks, and build solutions with measurable business outcomes
  • Design and deploy workflows using orchestration tools (n8n, Workato, or custom platforms) with CI/CD, testing, and production reliability standards
  • Build systems designed for self-service with documentation, playbooks, and enablement materials that let partner teams operate independently
We invest heavily in developer productivity. You'll have access to AI coding assistants (Claude Code, Gemini CLI, OpenAI Codex, and others of your choice within security guidelines). We encourage pragmatic AI-assisted development paired with strong code review and quality standards. What Makes You a Great Fit
  • 8+ years of software engineering experience with depth in backend development, systems integration, or data/analytics engineering
  • 2+ years hands-on experience applying LLMs/AI to production workflows, not just prototypes
  • Strong proficiency in Python and JavaScript/Node.js with Git-based workflows, code review practices, and testing discipline
  • Hands-on experience with LLM frameworks and patterns including prompt engineering, RAG, function calling/tool use, structured output parsing, and evaluation
  • Experience building and operating multi-agent systems at scale including agent decomposition, orchestration patterns (sequential chains, router/dispatcher, parallel fan-out), state management, and production monitoring
  • You diagnose business problems before writing code. You think in workflows and outcomes, not just functions.
  • Deep familiarity with Google Cloud Platform, BigQuery, and serverless/containerized services (Cloud Functions, Cloud Run)
  • Understanding of LLM failure modes and production mitigations including confidence thresholds, fallback logic, human escalation, and cost/latency management
  • Proven ability to identify high-leverage problems, push back on low-impact requests, and deliver end-to-end with minimal direction
  • Fluent with AI-assisted development tools (GitHub Copilot, Cursor, Claude Code). You use AI to build AI systems
  • Clear technical communicator who can explain complex systems in simple terms to both engineers and business stakeholders
Bonus Points
  • Experience with vector databases or retrieval pipelines (Pinecone, Weaviate, ChromaDB, Qdrant, pgvector)
  • Familiarity with marketing or sales platforms (Salesforce, Customer.io, HubSpot, Marketo, Outreach)
  • Experience with frontend frameworks (React, Slack Block Kit) for building user-facing AI tool interfaces
  • Observability tooling for AI systems (LangSmith, Weights & Biases, custom evaluation frameworks)
  • Experience with workflow orchestration platforms (n8n, Temporal, Prefect, Airflow)
  • Familiarity with Model Context Protocol (MCP) or similar standards for connecting AI systems to data sources
  • Prior work automating marketing, sales, or customer success workflows in a B2B SaaS environment
  • Active in open-source communities. Grafana is built on OSS and we value engineers who share that DNA
In the United States, the base compensation range for this role is USD $154,445 - USD $185,334. Actual compensation may vary based on level, experience, and skillset as assessed throughout the interview process. All of our roles include Restricted Stock Units (RSUs), giving every team member ownership in Grafana Labs' success. We believe in shared outcomes—RSUs help us stay aligned and invested as we scale globally. *Compensation ranges are country specific. If you are applying for this role from a different location than listed above, your recruiter will discuss your specific market’s defined pay range & benefits at the beginning of the process.

Why You’ll Thrive at Grafana Labs:

  • 100% Remote, Global Culture - As a remote-only company, we bring together talent from around the world, united by a culture of collaboration and shared purpose.
  • Scaling Organization – Tackle meaningful work in a high-growth, ever-evolving environment.
  • Transparent Communication – Expect open decision-making and regular company-wide updates.
  • Innovation-Driven – Autonomy and support to ship great work and try new things.
  • Open Source Roots – Built on community-driven values that shape how we work.
  • Empowered Teams – High trust, low ego culture that values outcomes over optics.
  • Career Growth Pathways – Defined opportunities to grow and develop your career.
  • Approachable Leadership – Transparent execs who are involved, visible, and human.
  • Passionate People – Join a team of smart, supportive folks who care deeply about what they do.
  • In-Person onboarding - We want you to thrive from day 1 with your fellow new ‘Grafanistas’ to learn all about what we do and how we do it.
  • Balance is Key - We operate a global annual leave policy of 30 days per annum. 3 days of your annual leave entitlement are reserved for Grafana Shutdown Days to allow the team to really disconnect. *We will comply with local legislation where applicable.
Equal Opportunity Employer: Grafana Labs is an equal opportunities employer. We welcome applications from everyone regardless of race, colour, nationality, origin, caste, sex, gender reassignment identity or expression, sexual orientation, age, religion or belief, disability, veteran status, genetic information, pregnancy, maternity, marital, family or carer status, or any other characteristic which is protected by local law. We believe that equality and diversity build a strong organisation, and we work hard to ensure that is the foundation of our organisation as we grow. Grafana Labs may utilize AI tools in its recruitment process to assist in matching information provided in CVs to job postings. The recruitment team will continue to review inbound CVs manually to identify alignment with current openings.

For information about how your personal data is used once you’ve applied to a job, check out our privacy policy.

Back to blog

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...

Other Jobs To Apply

Amazon Delivery Driver

REMOTE - Entry-Level Management Training (Work from Home)No Experience Needed Full Training Provided

Delta Airlines (Data Entry) Work From Home Position Jobs - Apply Now

Film & TV Development & Production Internships: LA - Summer 2026

`Remote Entry-Level Role | Beginner Friendly | Full/Part-Time | Start ASAP

Work From Home Remote Entry Level -Focus Group Position

Fulfillment Center Warehouse Associate

Robotics Warehouse Associate

amazon warehouse associate $15+/ Hour (Sign on Bonus)!

Amazon Warehouse

Sr. Operations Manager

Delivery Driver(06993) - 2753 W Washington

"Fully Remote Benefits Representative | Flexible Schedule | Hiring Immediately

Fulfillment Workplace Health and Safety Specialist Intern 2026 - AZ, CA, CO, NM, NV, OH, OK, TX, UT, WA - Now Hiring

Software Development Engineer III (ADBL189)

Want to Work From Home? Provide Customer Service Support for Leading Cruise Lines - Flexible Hours

DJZ5 - $23.75hr - New Jersey - Amazon DSP Delivery Driver

EHS Specialist

Sales Associate- Redding

Team Member

Remote Travel Specialist (part time)

Remote Data Entry -Time Focus Group Participants (Up To $750/Week)

Data Entry Clerk Work From Home - Part-Time Focus Group Participants (Up To $750/Week)

Remote Healthcare Customer Service Representative

-Urgent Hiring | Entry-Level Remote Role | Flexible Schedule | Apply Today

REMOTE - Entry-Level Management Training (Work from Home)No Experience Needed Full Training Provided

Easy Remote Academic Transcription Jobs No Experience

Immediate Hiring: Virtual Scheduling Assistant-Entry Level

Remote Live Chat Assistant – Entry-Level Customer Support Specialist (No Experience Required | $35/Hour)

Flight Monitor, Amazon - Prime Air

Amazon Prime Delivery Driver $18-$26/hr

Sr. Operations Manager

EHS Specialist

Warehouse Team Member

Warehouse Associate - $18.00/hour

Work From Home - Up to $750/ week

(Part Time) Data Entry - Remote Jobs

Part-Time Doorstep Trash Collection Specialist - Weekends

Front Desk Concierge (Part-Time / Weekend)

EHS Specialist

Area Manager, Early Career (2027) - AR, MS, OK, LA

Warehouse Worker - Central NJ-OCS (collapsed into 763300000)

Amazon Customer Service Representative (Remote)

Remote Customer Service Specialist

Heavy Equipment Operator

Certified Nursing Assistant (CNA) Jobs in Tucson, AZ — $19–$21/hr, Flexible Shifts

Remote Travel Booking Agent (Flexible Schedule)

Pathways Operations Manager Intern - Summer 2027 - Now Hiring

Supervisory Transportation Security Officer

Paid Panel Immediate Start - Remote Part-Time - Customer Service Representative Welcome