Deepgram
Systems Architect AI/ML Infrastructure
Remote role where the employee must remain based in a particular country.
United States only
From the listing details: Residency required in United States
Employer listed it 8 months ago · Added 2 months ago
Listed for 183 days before it closed.
This job has closed
Deepgram has taken this listing down, so it is no longer accepting applications. The details below are kept for reference only.
Browse open rolesSalary
$160,000 to $239,000
Location
United States only
Timezone
US East
Contract
Full-time
Experience
Senior
Category
Software
Published by the employer
What the advert says
Quoted word for word from the employer's advert. Where it says nothing, we say so.
- Working hours
- Not mentioned in the advert
- Where you can work from
Design multi-cloud and hybrid infrastructure strategies that balance performance, reliability, cost, and vendor flexibility
- Contract
- Not mentioned in the advert
- Experience asked for
7+ years of experience in infrastructure engineering, systems architecture, or a senior technical role focused on large-scale infrastructure
- Pay
- Not mentioned in the advert
Remote flexibility
Work from home
This is a remote role, but the employee must be based in United States. It is work from home rather than work from anywhere.
What the employer says
- Source listing states candidate location: "USA - Remote, Remote"
What Nomaders makes of it
- Residency required in United States
- Payroll and tax are likely handled in that country only
The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.
Before you apply
Experience: employer states
Written as a requirement
- “Proven experience designing multi-cloud architectures spanning AWS and at least one other major cloud provider or on-premises environment”
Questions worth asking: Nomaders interpretation
- The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.
Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.
About the role
Company Overview
Deepgram is the leading platform underpinning the emerging trillion-dollar Voice AI economy, providing real-time APIs for speech-to-text (STT), text-to-speech (TTS), and building production-grade voice agents at scale. More than 200,000 developers and 1,300+ organizations build voice offerings that are ‘Powered by Deepgram’, including Twilio, Cloudflare, Sierra, Decagon, Vapi, Daily, Cresta, Granola, and Jack in the Box. Deepgram’s voice-native foundation models are accessed through cloud APIs or as self-hosted and on-premises software, with unmatched accuracy, low latency, and cost efficiency. Backed by a recent Series C led by leading global investors and strategic partners, Deepgram has processed over 50,000 years of audio and transcribed more than 1 trillion words. There is no organization in the world that understands voice better than Deepgram.
Company Operating Rhythm
At Deepgram, we expect an AI-first mindset—AI use and comfort aren’t optional, they’re core to how we operate, innovate, and measure performance.
Every team member who works at Deepgram is expected to actively use and experiment with advanced AI tools, and even build your own into your everyday work. We measure how effectively AI is applied to deliver results, and consistent, creative use of the latest AI capabilities is key to success here. Candidates should be comfortable adopting new models and modes quickly, integrating AI into their workflows, and continuously pushing the boundaries of what these technologies can do.
Additionally, we move at the pace of AI. Change is rapid, and you can expect your day-to-day work to evolve just as quickly. This may not be the right role if you’re not excited to experiment, adapt, think on your feet, and learn constantly, or if you’re seeking something highly prescriptive with a traditional 9-to-5.
The Opportunity
Deepgram's infrastructure spans bare metal GPU clusters, multi-cloud deployments, and global edge presence -- all serving real-time voice AI at massive scale while simultaneously powering large-scale model training. As a Systems Architect, you will own the end-to-end infrastructure architecture that makes this possible. You will design the compute, storage, and networking systems that serve both production inference and research training workloads, build multi-cloud strategies that balance performance with cost, and create burstable infrastructure that scales with Deepgram's rapidly growing demands. This is a senior technical leadership role where your architectural decisions shape the foundation everything at Deepgram runs on.
What You'll Do
Define and drive the end-to-end infrastructure architecture for Deepgram's AI/ML workloads across production inference and research training
Design multi-cloud and hybrid infrastructure strategies that balance performance, reliability, cost, and vendor flexibility
Architect compute orchestration systems that efficiently schedule and manage GPU and CPU workloads across heterogeneous infrastructure
Design storage architectures that handle the massive datasets required for speech and audio ML -- from high-throughput training data pipelines to low-latency model serving
Lead capacity planning across all infrastructure dimensions, modeling growth and ensuring Deepgram can scale ahead of demand
Drive cost optimization and FinOps practices, identifying opportunities to reduce infrastructure spend without compromising performance or reliability
Design burstable, elastic training infrastructure that can scale up for large training runs and scale down to minimize idle cost
Architect research compute infrastructure that gives ML teams the resources they need while maintaining operational efficiency
Establish architectural standards, design review processes, and technical documentation practices for infrastructure decisions
Collaborate with engineering leadership to align infrastructure strategy with product roadmap and business objectives
Evaluate emerging hardware, cloud services, and infrastructure technologies for potential adoption
You'll Love This Role If You
Think in systems -- you naturally see the connections between compute, storage, network, and how they interact under load
Are motivated by designing infrastructure that operates at the intersection of real-time production systems and large-scale ML training
Enjoy making architectural trade-offs where cost, performance, reliability, and velocity are all in tension
Requirements
- ·7+ years of experience in infrastructure engineering, systems architecture, or a senior technical role focused on large-scale infrastructure
- ·Proven experience designing multi-cloud architectures spanning AWS and at least one other major cloud provider or on-premises environment
- ·Deep expertise in storage system design -- block, object, and file storage, including performance tuning for large-scale data workloads
- ·Strong experience with compute orchestration using Kubernetes, and an understanding of how to schedule diverse workloads efficiently
- ·Hands-on experience with GPU infrastructure -- procurement considerations, cluster design, driver and runtime management
Benefits
No benefits package published with this listing. Ask about it at first interview.
Applying
This listing has closed, so there is no application link. The details above are kept for reference only.
Found 2mo ago. Last checked 11 Oct. Always confirm the details on the original posting, salary and location can change after publication.
Listing sourced from Company boards.
Similar open jobs
This role is closed, applications are no longer accepted.