Deepgram
More roles at DeepgramEmbedded AI Engineer, On-Device Models
Remote role where the employee must remain based in a particular country.
United States only
From the listing details: Residency required in United States
Employer listed it 4 months ago · Added 2 months ago
Been open since 4 months ago. Long-running listings are sometimes left up after the role is filled.
Salary
$219k to $274k per year
Location
United States only
Timezone
US East
Contract
Full-time
Experience
Mid
Category
Software
Published by the employer
What the advert says
Quoted word for word from the employer's advert. Where it says nothing, we say so.
- Working hours
- Not mentioned in the advert
- Where you can work from
- Location eligibility not confirmed
- Contract
- Not mentioned in the advert
- Experience asked for
- Not mentioned in the advert
- Pay
- Not mentioned in the advert
Remote flexibility
Work from home
This is a remote role, but the employee must be based in United States. It is work from home rather than work from anywhere.
What the employer says
- Source listing states candidate location: "USA - Remote, Remote"
What Nomaders makes of it
- Residency required in United States
- Payroll and tax are likely handled in that country only
The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.
Before you apply
Questions worth asking: Nomaders interpretation
- The advert does not say where you can be based. Ask which countries they can legally employ or contract you from.
- The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.
Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.
About the role
Company Overview
Deepgram is bringing the world’s most natural interface, voice, to the technology we use every day. Our speech models and real-time infrastructure power AI systems that keep up with the way people actually speak. More than 5,000 organizations run conversational voice AI on Deepgram in production, including Twilio, Cloudflare, Sierra, Decagon, Vapi, Cresta, Granola, and Jack in the Box.
The Deepgram Voice Agent Platform brings together speech-to-text, text-to-speech and speech-to-speech, with voice-native foundation models available through cloud APIs or self-hosted and on-premises deployments. Built for accuracy, low latency and cost efficiency, Deepgram makes high-quality voice experiences practical to build and run at scale. More than 650,000 developers have used Deepgram to process more than 200,000 years of audio. Every day, more of the world’s conversations with AI run on our models.
Operating Principles
Deepgram is a research company that productizes as fast as possible. Four Operating Principles shape how we think, decide, and work together:
Compress before you communicate. You think it through first, then lead with the bottom line.
Resist entropy. You question what already exists before adding more process or tools.
Solve the category. You fix recurring problems at the source, not one case at a time.
Work at the frontier. You go after problems no one has solved yet.
We look for people who already work this way, and these principles shape how we grow and evaluate our team.
AI-First by Default
We build AI that millions of people talk to, and we run the company the same way. AI is how we centralize work here, and is core to how we operate.
That means more than using the tools. We expect you to:
Build, not just use. Design your own workflows and agents, and use AI to remove whole categories of work instead of doing the same work faster.
Own the output. AI can speed up the work. It doesn’t make anyone less accountable for it. You understand, verify, and stand behind everything you share, including what an agent produces for you.
Spend the time you get back at the frontier. The capacity AI creates goes toward problems no one has solved yet.
Keep pace. Models and tools change every month, and so will your work. You adopt what’s new quickly and drop what no longer earns its place.
We judge AI by what it helps you deliver and whether you stand behind the result, not by how often you use it. In interviews, expect to walk us through a workflow you built and where you drew the line between AI and your own judgment.
About the Role
Deepgram's speech models are among the fastest and most accurate in the world, and we have deep machinery for running them on NVIDIA GPUs. Our customers need them on everything else: non-NVIDIA accelerators, embedded SoCs, mobile application processors, DSPs and NPUs, and purpose-built devices with tight memory, compute, thermal, and power budgets. When a target platform's standard kernels and runtime can't run a Deepgram model well enough, someone has to go below them. That is this role.
As an Embedded AI Engineer on the Partner Platform Engineering team, you work at the lowest layer of our edge stack. You write and optimize custom kernels and operators for specific hardware, collapse models onto device-specific execution units, and do the target-side quantization and assembly-level tuning that standard toolchains can't. You hand what you build up to Applied ML Engineers, who fit Deepgram models to your kernels. Your work is what makes a new hardware platform viable for Deepgram at all.
This role is a great fit for a senior embedded engineer who has spent their career close to the metal and wants to point that at speech AI, or a staff-level engineer who wants to define how Deepgram's models get onto new silicon. We'll set the level to your experience.
What You'll Do
Write and optimize custom kernels and operators (C, C++, Rust, and platform assembly or intrinsics) for non-NVIDIA accelerators, embedded SoCs, DSPs, and NPUs where the vendor's standard operator set is insufficient for Deepgram models.
Requirements
- ·Experience delivering production systems on resource-constrained hardware — embedded systems, mobile, edge AI, or small low-power devices.
- ·Strong proficiency in C, C++, and/or Rust, with experience writing performance-critical code for constrained environments.
- ·Hands-on experience with model optimization for on-device deployment, including quantization, pruning, knowledge distillation, or architecture-specific compilation.
- ·Familiarity with edge inference runtimes (e.g., ONNX Runtime, TensorRT, TFLite, ExecuTorch) and/or vendor-specific NPU/DSP toolchains.
- ·A strong understanding of hardware-software interaction — CPU/GPU/NPU/DSP architectures, memory hierarchies, fixed-point/integer arithmetic, and power management — and how they affect inference performance.
Benefits
No benefits package published with this listing. Ask about it at first interview.
How to apply
- 1Check the flexibility label above, work from home, matches where you plan to live and work.
- 2Tailor your CV to the role at Deepgram, mentioning your remote working experience and working hours (US East).
- 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.
Found 2mo ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.
Listing sourced from Company boards.
$219k to $274k per year · You'll be taken to the employer's careers page.