Lead design and build of a multi-tenant control plane for AI agents using Go. Develop and scale distributed services, high-throughput APIs, authentication, streaming (Kafka/SSE), telemetry pipelines, and integrations with LLMs. Own reliability, SLOs, observability, mentor engineers, and collaborate cross-functionally to deliver secure, low-latency developer experiences.
Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you’ll find your place here. We value winning together—while learning, having fun, and making a profound difference for the dreamers and builders in the world.
We are looking for a Senior Software Engineer II (IC4) who is passionate about distributed systems orchestration, high-throughput API design, and building the multi-tenant control plane that powers AI Agents.
As a Senior Software Engineer II (IC4) at DigitalOcean, you will join a dynamic engineering team dedicated to revolutionizing cloud computing and AI. In this role, you will report directly to the Senior Engineering Manager of the Agents team. You will act as the technical anchor for the team responsible for the Agents platform that allows our customers to build/migrate, deploy and use their agents efficiently on our cloud, while we take over management of these agents. You will design and develop the "brain" of the product, interfacing directly with customer facing SDK’s/CLI’s/UI/UX and coordinating with underlying internal virtualization services to deliver a seamless, secure, and scalable developer experience. This is a hands-on role, requiring you to be able to develop/mentor high quality software while availing of all the productivity boosts granted by the latest AI coding agents.
What You’ll Do- Technical Leadership: Act as a technical leader on the team, driving the end-to-end design, development, and delivery of critical control plane and data plane components of a multi-tenant platform that hosts a large number of AI agents.
- Design and scale the core platform using Go, managing the global state, session lifecycles, agent memory, complex state synchronization, human in the loop workflows, history management, tight integrations with popular agents (e.g. Claude code, open code, codex etc.) and agentic frameworks like Langchain, Langraph, crew.ai etc. for millions of user requests.
- Implement and optimize robust multi-tenant services, API gateways and authentication layers to securely isolate customer workloads, rate-limit abuse, and track usage for billing, while maintaining sub-20ms overhead.
- Own the developer interface, optimizing how the control plane surfaces real-time execution telemetry, structured logging pipelines, and token streaming back to the user's application.
- Collaboration: Work cross-functionally with Product Managers, customer-facing teams, and other engineering teams to align technical roadmaps with customer needs.
- Mentorship: Coach and mentor junior engineers, fostering a culture of technical excellence and continuous improvement.
- Operational Excellence: Maintain and operate critical, high-scale services, utilizing observability tools and defining SLOs to ensure superior platform health and a 99.99% uptime.
- Distributed Systems Mastery: 8+ years of professional software engineering experience working on microservices, messaging systems, databases, and infrastructure as code, with a heavy emphasis on building large-scale SaaS or PaaS products using Go or similar backend languages.
- AI/ML Domain Knowledge: Hands-on experience integrating with LLMs or multimodal models, creating, managing & operating Agentic workloads for high scale customers - managing complex multi-day agent session lifecycles, pause/resume transitions, fan-out live agent token streams from agents directly to developer CLI and Web UI clients using Kafka, SSE, sub-second responsiveness for inline Human-in-the-Loop (HITL) approvals and state transitions are constructs you have already built or have a working knowledge of.
- API & Proxy Expertise: Proven experience building high-throughput REST/gRPC APIs, custom reverse proxies, or network routers handling concurrent connection scaling.
- Orchestration & State Management: Practical experience with cluster schedulers (Kubernetes, Nomad), service meshes, or distributed key-value stores (Redis, Consul, Etcd) for real-time state tracking.
- Data Layer Architecture: Strong experience modeling application state in relational dbs like PostgreSQL or MySQL and designing high-volume telemetry ingestion pipelines using data stores like Snowflake, ClickHouse etc.
- Product-First Mindset: Experience building products designed for other developers (APIs, SDKs, Cloud Consoles) with a deep empathy for developer workflows and latency constraints.
- Cloud Operations: Proven experience shipping customer-facing software products and running critical services in a high-scale environment similar to DigitalOcean.
- Preferred Attributes: Familiarity with the unique orchestration challenges of Agentic AI, LLM frameworks (LangGraph, OpenAI Agents SDK, CrewAI), Model Context Protocol (MCP), or Human-in-the-Loop (HITL) primitives.
*This job is located in Hyderabad, India
#LI-Hybrid
Why You’ll Like Working for DigitalOcean
- We innovate with purpose. You’ll be a part of a cutting-edge technology company with an upward trajectory, who are proud to simplify cloud and AI so builders can spend more time creating software that changes the world. As a member of the team, you will be a Shark who thinks big, bold, and scrappy, like an owner with a bias for action and a powerful sense of responsibility for customers, products, employees, and decisions.
- We prioritize career development. At DO, you’ll do the best work of your career. You will work with some of the smartest and most interesting people in the industry. We are a high-performance organization that will always challenge you to think big. Our organizational development team will provide you with resources to ensure you keep growing. We provide employees with reimbursement for relevant conferences, training, and education. All employees have access to LinkedIn Learning's 10,000+ courses to support their continued growth and development.
- We care about your well-being. Regardless of your location, we will provide you with a competitive array of benefits to support you from our Employee Assistance Program to Local Employee Meetups to flexible time off policy, to name a few. While the philosophy around our benefits is the same worldwide, specific benefits may vary based on local regulations and preferences.
- We reward our employees. The salary range for this position is based on market data, relevant years of experience, and skills. You may qualify for a bonus in addition to base salary; bonus amounts are determined based on company and individual performance. We also provide equity compensation to eligible employees, including equity grants upon hire and the option to participate in our Employee Stock Purchase Program.
- DigitalOcean is an equal-opportunity employer. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.
Application Limit: You may apply to a maximum of 3 positions within any 180-day period. This policy promotes better role-candidate matching and encourages thoughtful applications where your qualifications align most strongly.
Similar Jobs at DigitalOcean
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Design and scale a Go-based orchestrator and multi-tenant control plane for sandboxed Agentic AI applications. Build high-throughput REST/gRPC APIs, routing proxies and authentication layers, manage state synchronization across clusters (Consul/Nomad/Kubernetes), and surface real-time telemetry, logging, and streaming to developer SDKs.
Top Skills:
ClickhouseConsulEtcdGoGoGrpcHTTPKubernetesNomadPostgresRestReverse ProxySdksService MeshWebsocket
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Develop and maintain high-throughput backend services and concurrent asynchronous workflows (Python/Go). Integrate control planes with isolated execution environments, build scalable gRPC/REST APIs, monitor performance, investigate bugs, and collaborate cross-functionally to ensure reliable evaluation of AI agents.
Top Skills:
C++DockerGoGrpcJavaKubernetesLlm ApisMicrovmsPythonRest
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Design and scale a Go-based orchestrator and multi-tenant control plane for sandboxed Agentic AI applications. Build high-throughput REST/gRPC APIs, routing proxies and authentication layers, manage state synchronization across clusters (Consul/Nomad/Kubernetes), and surface real-time telemetry, logging, and streaming to developer SDKs.
Top Skills:
ClickhouseConsulEtcdGoGoGrpcHTTPKubernetesNomadPostgresRestReverse ProxySdksService MeshWebsocket
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
