Fireworks AI logo

Fireworks AI

More roles at Fireworks AI

Member of Technical Staff, Data Infrastructure

Hybrid

Part remote, part office, you need to live within commuting distance of a named location.

Hybrid · San Mateo

Employer listed it 13 days ago · Added 3 weeks ago

Been open since 3 weeks ago, still being checked, but it has been live a while.

Salary

$175k to $220k per year

Location

Hybrid · San Mateo

Timezone

Not stated

Contract

Full-time

Experience

Lead

Category

Software

Published by the employer

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
Not mentioned in the advert
Where you can work from
Location eligibility not confirmed
Contract
Not mentioned in the advert
Experience asked for
5+ years of experience designing, building and operating storage, caching or data infrastructure in production at scale.
Pay
Not mentioned in the advert

Remote flexibility

Hybrid

This role is only partly remote, the employer expects time in the office around San Mateo, Hybrid, so you need to live within commuting distance.

What the employer says

  • Source listing states candidate location: "San Mateo, Hybrid"
  • Listing mentions "Hybrid"

What Nomaders makes of it

  • Not suitable if you plan to move between countries

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Questions worth asking: Nomaders interpretation

  • This role involves office time, but the advert does not say how often. Ask how many days a week are expected on site.
  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

About Us:

Fireworks is the platform for specialized intelligence, enabling companies to build, train, and serve AI models tailored to their own data, workflows, and products. Founded by the team behind PyTorch and backed by AMD, Atreides, Benchmark Capital, Index Ventures, Lightspeed, NVIDIA, Sequoia Capital, and TCV, Fireworks powers production AI with hundreds of state-of-the-art open models across text, image, embedding, audio, and multimodal workloads. Today, Fireworks is a Series D company valued at $17.5 billion, bringing together an ambitious, collaborative team that's building the future of enterprise AI.

The Role:

Make data a solved problem for every GPU workload at Fireworks. We own how data is stored, cached and moved across clouds, so that training and inference teams never have to think about where their data lives or how it gets to them, and no GPU ever waits on it.

In practice, that means building a unified, high-performance data layer that spans parallel file systems, object storage, distributed caches and key-value stores across multiple clouds. Datasets, checkpoints, model weights and KV cache should be in the right place at the right time, at whatever scale the GPUs need. Training jobs start without a data-staging step, inference replicas cold-start without waiting on weight downloads, and the system handles placement, replication and movement on its own.

Key Technical Archetypes:

We expect strong candidates to have gone deep in at least one of these areas and to be comfortable in the others:

The Storage Systems Builder: Has designed and shipped a storage system: a distributed file system, a blob/object store, a KV store, or a storage engine. They can explain the tradeoffs they made in consistency models, replication, erasure coding, metadata scaling, compaction and failure recovery, and why they made them.

The Caching Architect: Has built a distributed or tiered cache across memory, NVMe and remote storage. They think in hit rates, eviction policies, cache coherence, prefetching and tail latency. Bonus if they've worked on caching for model weights, datasets, checkpoints, or LLM KV cache offload.

The Linux Power User: Knows the system under the hood: kernel I/O paths, POSIX semantics, page cache behavior, io_uring/SPDK, and OS-level tuning (sysctl, I/O schedulers, NUMA).

The Network-As-Code Expert: Understands RDMA, RoCE v2, InfiniBand and GPUDirect Storage from a software and configuration perspective, because neoclouds often need manual plumbing.

Minimum qualifications:

Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience).

5+ years of experience designing, building and operating storage, caching or data infrastructure in production at scale.

Strong software development skills in C/C++, Rust or Go, with experience writing performance-critical data path code. Python or Go for automation.

Deep understanding of distributed storage fundamentals: consistency models, replication and consensus (e.g., Raft/Paxos), metadata scaling, caching, and failure recovery.

Hands-on experience with Kubernetes, including CSI, to mount high-performance volumes into ephemeral GPU pods.

Experience deploying and operating storage clusters (e.g., WEKA, VAST, Lustre, Ceph, MinIO) across clouds using infrastructure-as-code tools such as Terraform or Pulumi.

Proficiency with performance benchmarking and profiling tools (e.g., fio, iperf3, NCCL tests, perf, eBPF) to identify and resolve bottlenecks across the kernel, network, cache and storage backend.

Preferred qualifications:

Experience as a core contributor or owner of a storage, caching or KV system, either in-house or open source (e.g., Ceph, Alluxio, JuiceFS, RocksDB, FoundationDB, TiKV, Redis/Dragonfly, SeaweedFS, MinIO).

Experience with high-performance computing or large-scale AI clusters (e.g., Slurm, Kubernetes GPU pools) and familiarity with AI I/O patterns such as checkpoint bursts, random dataset reads, and model-weight loading for inference cold starts.

Familiarity with Linux internals, including kernel I/O paths, POSIX semantics, page cache behavior, io_uring/SPDK, and OS-level tuning (sysctl, I/O schedulers, NUMA).

Familiarity with high-performance networking (RDMA, RoCE v2, InfiniBand) and GPUDirect Storage.

Requirements

  • ·Bachelor's degree in Computer Science, Engineering, or a related technical field (or equivalent practical experience).
  • ·5+ years of experience designing, building and operating storage, caching or data infrastructure in production at scale.
  • ·Strong software development skills in C/C++, Rust or Go, with experience writing performance-critical data path code. Python or Go for automation.
  • ·Deep understanding of distributed storage fundamentals: consistency models, replication and consensus (e.g., Raft/Paxos), metadata scaling, caching, and failure recovery.
  • ·Hands-on experience with Kubernetes, including CSI, to mount high-performance volumes into ephemeral GPU pods.

Benefits

No benefits package published with this listing. Ask about it at first interview.

How to apply

  1. 1Check the flexibility label above, hybrid, matches where you plan to live and work.
  2. 2Tailor your CV to the role at Fireworks AI, mentioning your remote working experience.
  3. 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.

Found 25d ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

$175k to $220k per year · You'll be taken to the employer's careers page.