Kong logo

Kong

More roles at Kong

Senior Software Engineer, AI Gateway

Hybrid

Part remote, part office, you need to live within commuting distance of a named location.

Hybrid · Milan, Italy

Employer listed it 3 weeks ago · Added today

Been open since 3 weeks ago, still being checked, but it has been live a while.

Salary

€77k to €95k per year

Location

Hybrid · Milan, Italy

Timezone

Not stated

Contract

Full-time

Experience

Senior

Category

Software

Published by the employer

What the advert says

Quoted word for word from the employer's advert. Where it says nothing, we say so.

Working hours
Not mentioned in the advert
Where you can work from
Location eligibility not confirmed
Contract
Not mentioned in the advert
Experience asked for
Not mentioned in the advert
Pay
Not mentioned in the advert

Remote flexibility

Hybrid

This role is only partly remote, the employer expects time in the office around Milan, Italy, Hybrid, so you need to live within commuting distance.

What the employer says

  • Source listing states candidate location: "Milan, Italy, Hybrid"
  • Listing mentions "Hybrid"

What Nomaders makes of it

  • Not suitable if you plan to move between countries

The quotes above are the employer's own words; the reading is ours. Always check the original listing and employment terms before working from another country.

Before you apply

Questions worth asking: Nomaders interpretation

  • This role involves office time, but the advert does not say how often. Ask how many days a week are expected on site.
  • The advert does not say whether this is employment or a contractor arrangement. Ask, as it affects tax and benefits.

Produced automatically from this advert's text; not reviewed by a person. The employer's own page is the final word.

About the role

Are you ready to unlock intelligence?

If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others.

The Mission

The AI Gateway team is on a mission to build the central nervous system for the agentic era, enabling developers to securely and reliably connect, observe, and manage their AI and ML services at scale. In this role you will design and build the core of the gateway that handles live AI traffic: the runtime and data plane that route, translate, secure, and observe every request, with the performance and reliability our customers depend on.

What You’ll Do

Own the technical direction for core AI Gateway features, from design to production rollout.

Build and maintain high-performance components for Kong’s AI Gateway in Rust and Lua.

Implement gateway features such as multi-LLM routing and load balancing, caching, guardrails, and observability for AI traffic.

Design integrations with LLM providers and AI platforms, filling the gaps between Kong and third-party deployment platforms and tooling.

Influence the technical roadmap and architecture, and address technical debt before it limits scalability.

Investigate complex production issues and performance bottlenecks, and do low-level optimizations in the hot path.

Work with product management and other engineering teams to turn customer requirements into reliable, documented product features.

Mentor other engineers on the team through code reviews and design discussions.

What You’ll Bring

The Toolkit

5+ years of programming in server-side applications and components, in a language such as Rust or Go.

Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.

Knowledge of networking fundamentals and protocols on both L4 and L7 (TCP/IP, HTTP/2, gRPC).

Solid understanding of API design, and familiarity with API gateways, proxies, or service mesh.

Experience with LLMs and AI infrastructure, such as LLM provider APIs, agent frameworks, model serving, MCP and other agentic AI protocols.

Solid hands-on expertise in Linux systems, including troubleshooting memory issues and profiling processes.

The Kong DNA

Ownership: You take full ownership of your work from concept to production, including the documentation: engineers at Kong write the documentation for their products.

Urgency: You balance quality with the need to deliver value to customers quickly.

Requirements

  • ·5+ years of programming in server-side applications and components, in a language such as Rust or Go.
  • ·Experience building and debugging applications that are highly scalable, distributed, reliable and resilient.
  • ·Knowledge of networking fundamentals and protocols on both L4 and L7 (TCP/IP, HTTP/2, gRPC).
  • ·Solid understanding of API design, and familiarity with API gateways, proxies, or service mesh.
  • ·Experience with LLMs and AI infrastructure, such as LLM provider APIs, agent frameworks, model serving, MCP and other agentic AI protocols.

Benefits

No benefits package published with this listing. Ask about it at first interview.

How to apply

  1. 1Check the flexibility label above, hybrid, matches where you plan to live and work.
  2. 2Tailor your CV to the role at Kong, mentioning your remote working experience.
  3. 3Apply directly on the employer's careers page using the button below. Nomaders never handles your application.

Found 17h ago. Last checked today. Always confirm the details on the original posting, salary and location can change after publication.

Listing sourced from Company boards.

Similar roles

Other open software roles with comparable remote rules.

Browse all open roles

€77k to €95k per year · You'll be taken to the employer's careers page.