Gcore logo

Gcore

More roles at Gcore

Python Inference Engineer

Region Restricted

Remote work allowed only within certain countries or regions.

Employer listed it 2 months ago · Added 8 weeks ago

Been open since 2 months ago. Long-running listings are sometimes left up after the role is filled.

Salary

Not stated

Location

Timezone

Not stated

Contract

Full-time

Experience

Mid

Category

Software

The employer did not publish a salary, and we have too few comparable roles to estimate one.

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
Flexible working hours and hybrid or remote options, depending on your role
Where you can work from
Flexible working hours and hybrid or remote options, depending on your role
Contract
Not mentioned in the advert
Experience asked for
5+ years of experience writing reliable, well-tested production code.
Pay
Competitive compensation  

Remote flexibility

Region Restricted

Remote work is allowed, but only for candidates based in Serbia, Cyprus.

What the employer says

  • Source listing states candidate location: "Serbia, , Cyprus, Serbia, cy, Remote"
  • Job description states: "Work from anywhere"

What Nomaders makes of it

  • Timezone overlap with the listed area is often expected

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Experience: employer states

Written as a requirement

  • “Experience in at least one relevant area: distributed systems, GPU computing, ML runtimes, model optimization, or cluster scheduling.”

Questions worth asking: Nomaders interpretation

  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

This position is available only under an employment (labor) agreement. 

The world’s digital experiences run on something invisible: the infrastructure and software that keep them fast, reliable, and secure. At Gcore, you’ll help design and deliver that foundation for an AI-driven world. 

We’re a global provider of infrastructure and software solutions for AI, cloud, network, and security, powering everything from real-time communication and streaming to enterprise AI and secure web applications. With 210+ edge locations , 50+ cloud regions , and thousands of GPUs , your work here can reach users and businesses across the globe. 

You’ll collaborate with leading technology partners such as Intel, NVIDIA, Dell, and Equinix , and work on platforms that power digital products used around the world. Our vision is simple: to connect the world to AI, anywhere, anytime. 

Want to work on technology that goes beyond a single product or industry?   Join a global team of 550+ professionals building infrastructure and software that supports the entire digital ecosystem.

We are currently looking for a Python Inference Engineer to join our Edge Cloud&AI Team.

What You’ll Do

Build and improve the inference layer of the Gcore Inference platform.

Integrate and operate inference frameworks such as vLLM, SGLang, NVIDIA Dynamo, and TensorRT-LLM.

Bring new language and multimodal models into production.

Improve inference latency, throughput, memory use, GPU utilization, and cost efficiency.

Debug performance and reliability issues across model code, inference frameworks, GPU execution, networking, and Kubernetes.

Work with platform, infrastructure, product, and customer-facing teams to turn inference improvements into reliable product features.

Contribute improvements to open-source inference projects when appropriate.

What We’re Looking For

5+ years of experience writing reliable, well-tested production code.

Strong Python skills and experience designing production systems.

Hands-on experience with PyTorch and deploying machine learning models.

Experience with Linux, Docker, and Kubernetes.

Experience in at least one relevant area: distributed systems, GPU computing, ML runtimes, model optimization, or cluster scheduling.

Ability to debug complex problems across software, infrastructure, and hardware.

Strong sense of developer experience: you think about how systems are used, not just how they work.

Genuine interest in inference engineering. You do not need direct experience with inference engines, but you should be motivated to learn.

Good communication and collaboration skills.

Requirements

  • ·Hands-on experience with PyTorch and deploying machine learning models.
  • ·Experience with Linux, Docker, and Kubernetes.
  • ·Experience in at least one relevant area: distributed systems, GPU computing, ML runtimes, model optimization, or cluster scheduling.
  • ·Ability to debug complex problems across software, infrastructure, and hardware.
  • ·Strong sense of developer experience: you think about how systems are used, not just how they work.

Benefits

  • ·At Gcore, we want you to do your best work and enjoy the journey. Our benefits are designed to support your growth, well-being, and life beyond work: 
  • ·Competitive compensation  
  • ·Flexible working hours and hybrid or remote options, depending on your role
  • ·Competitive compensation  
  • ·Work from anywhere in the world for up to 45 days per year 

How to apply

  1. 1Check the flexibility label above, region restricted, matches where you plan to live and work.
  2. 2Tailor your CV to the role at Gcore, mentioning your remote working experience.
  3. 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.

Found 2mo ago. Last checked 17 Nov. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

Similar roles

Other open software roles with comparable remote rules.

Browse all open roles

Pay not stated · You'll be taken to the employer's careers page.