JetBrains
Research Engineer (Agentic Models)
Remote work allowed only within certain countries or regions.
Employer listed it 3 months ago · Added 2 months ago
Listed for 47 days before it closed.
This job has closed
JetBrains has taken this listing down, so it is no longer accepting applications. The details below are kept for reference only.
Browse open rolesSalary
Not stated
Location
Timezone
GMT
Contract
Full-time
Experience
Mid
Category
Data
The employer did not publish a salary, and we have too few comparable roles to estimate one.
What the advert says
Quoted word for word from the employer's advert. Where it says nothing, we say so.
- Working hours
- Not mentioned in the advert
- Where you can work from
- Location eligibility not confirmed
- Contract
- Not mentioned in the advert
- Experience asked for
- Not mentioned in the advert
- Pay
- Not mentioned in the advert
Remote flexibility
Region Restricted
Remote work is allowed, but only for candidates based in Netherlands, Serbia, Germany, Cyprus, United Kingdom, Spain, Czechia, Poland, Armenia.
What the employer says
- Source listing states candidate location: "Amsterdam, Netherlands; Belgrade, Serbia; Berlin, Germany; Limassol, Cyprus; London, United Kingdom; Madrid, Spain; Munich, Germany; Paphos, Cyprus; Prague, Czech Republic; Remote, Germany; Warsaw, Poland; Yerevan, Armenia, Armenia, Cyprus, Czech Republic, Germany, Netherlands, Poland, Serbia, Spain, United Kingdom"
What Nomaders makes of it
- Applications outside the listed area are usually rejected
- Timezone overlap with the listed area is often expected
The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.
Before you apply
Experience: employer states
Written as a requirement
- “At least 3 years of Python experience writing clean, maintainable code in modern ML codebases.”
Questions worth asking: Nomaders interpretation
- The advert does not say where you can be based. Ask which countries they can legally employ or contract you from.
- No pay is stated. Ask for the salary range before investing time in interviews.
- The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.
Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.
About the role
At JetBrains, code is our passion. Ever since we started, back in 2000, we’ve been striving to make the strongest, most effective developer tools on earth. Today, AI-powered assistance and agents are becoming a core part of how developers work in our IDEs.
We’re building multi-step coding agents that can understand large codebases, plan changes, call tools, and iterate with the user. As a Research Engineer in the Agentic Models team, you’ll be responsible for the models, training loops, and evaluation pipelines that power these agents.
You’ll work at the intersection of SFT and RL-style post-training, and product-driven evaluation, using our distributed GPU and MapReduce clusters to ship models into JetBrains products.
As part of our team, you will:
Design, implement, and maintain SFT and RL post-training pipelines for multi-step coding agents.
Train and adapt LLMs for agent workflows, including planning, tool use, and multi-step interactions inside JetBrains IDEs.
Build and develop evaluation and simulation environments where coding agents can act, be measured, and compared on realistic developer tasks.
Design evaluation frameworks and metrics for agent behavior, analyze traces and logs, and close the loop from evaluation back into training, data, and reward design.
Analyze training and evaluation results to propose and implement improvements to model architectures, training recipes, and datasets.
Work with large-scale infrastructure, including distributed training on GPU clusters and large MapReduce-style data processing for pre-training and fine-tuning datasets.
Collaborate closely with research, product, and infrastructure teams to turn high-level product visions into concrete models, experiments, and shipped features.
We’ll be happy to bring you on board if you have:
Extensive hands-on experience training LLMs (pre-training, fine-tuning, or post-training) in a research or production setting.
Deep expertise in modern deep learning frameworks such as PyTorch, and specialized LLM training stacks (e.g. Megatron, NeMo, verl, or similar).
Strong theoretical and practical understanding of LLM fundamentals: architectures, tokenization, data pipelines, batching, mixed precision, distributed training, and debugging unstable runs.
The ability to own projects end to end, starting from a high-level problem or product pain point and overseeing it through the design, experimentation, implementation, and iteration phases.
A product-aware mindset – you care about how developers actually use agents and can translate product needs and failure modes into modeling and evaluation work.
At least 3 years of Python experience writing clean, maintainable code in modern ML codebases.
Our ideal candidate would have experience with:
ML orchestrators and workflow tools such as Kubeflow, Dagster, Airflow, ZenML, and/or job schedulers like Kubernetes or SLURM.
Large-scale data and training pipelines, e.g. MapReduce-style clusters, multi-node GPU training, or workloads on the order of 1M+ CPU/GPU hours.
Designing and maintaining evaluation pipelines for LLMs or agents, including metrics, dashboards, experiment tracking, and automated regression checks.
AI agent development, such as tool-using agents, planners, or multi-step coding workflows, and familiarity with agentic frameworks or patterns.
Experiment tracking and observability using tools like Weights & Biases, MLflow, Langfuse, or similar.
Requirements
- ·Extensive hands-on experience training LLMs (pre-training, fine-tuning, or post-training) in a research or production setting.
- ·Deep expertise in modern deep learning frameworks such as PyTorch, and specialized LLM training stacks (e.g. Megatron, NeMo, verl, or similar).
- ·Strong theoretical and practical understanding of LLM fundamentals: architectures, tokenization, data pipelines, batching, mixed precision, distributed training, and debugging unstable runs.
- ·The ability to own projects end to end, starting from a high-level problem or product pain point and overseeing it through the design, experimentation, implementation, and iteration phases.
- ·A product-aware mindset – you care about how developers actually use agents and can translate product needs and failure modes into modeling and evaluation work.
Benefits
No benefits package published with this listing. Ask about it at first interview.
Applying
This listing has closed, so there is no application link. The details above are kept for reference only.
Found 2mo ago. Last checked 11 Oct. Always confirm the details on the original posting, salary and location can change after publication.
Listing sourced from Company boards.
Similar open jobs
This role is closed, applications are no longer accepted.