Design and scale a Go-based orchestrator and multi-tenant control plane for sandboxed Agentic AI applications. Build high-throughput REST/gRPC APIs, routing proxies and authentication layers, manage state synchronization across clusters (Consul/Nomad/Kubernetes), and surface real-time telemetry, logging, and streaming to developer SDKs.
Dive in and do the best work of your career at DigitalOcean. Journey alongside a strong community of top talent who are relentless in their drive to build the simplest scalable cloud. If you have a growth mindset, naturally like to think big and bold, and are energized by the fast-paced environment of a true industry disruptor, you’ll find your place here. We value winning together—while learning, having fun, and making a profound difference for the dreamers and builders in the world.
We are looking for a Senior Software Engineer II (IC4) who is passionate about distributed systems orchestration, high-throughput API design, and building the multi-tenant control plane that powers Agentic AI applications.
As a Senior Software Engineer II (IC4) at DigitalOcean, you will join a dynamic engineering team dedicated to revolutionizing cloud computing and AI. In this role, you will report directly to the Engineering Manager of the Sandbox Team. You will act as the technical anchor for the squad responsible for the entire management tier, user lifecycle, and API orchestration of our sandbox platform. You will design and develop the "brain" of the product, interfacing directly with developer SDKs and coordinating with underlying internal virtualization services to deliver a seamless, secure, and scalable developer experience.
What You’ll Do- Design and scale the core Orchestrator using Go, managing the global state, session lifecycles, and rapid allocation of sandboxes for millions of user requests.
- Design and implement robust multi-tenant API Gateways and authentication layers to securely isolate customer workloads, rate-limit abuse, and track usage for billing.
- Build high-performance routing proxies (HTTP/WebSocket/gRPC) capable of instantly tunneling traffic from external client SDKs directly to internal service endpoints.
- Manage complex state synchronization and service discovery patterns using tools like Consul, Nomad, or Kubernetes to ensure high availability across distributed clusters.
- Own the developer interface, optimizing how the control plane surfaces real-time execution telemetry, structured logging pipelines, and file streaming back to the user's application.
Key Metrics
- Control Plane API Latency: Maintain sub-20ms overhead for API authentication, routing, and command dispatching.
- System Uptime & Reliability: Target a 99.99% uptime SLA for the control plane API and proxy layers.
- Multi-Tenant Isolation: Ensure zero cross-tenant data leaks or unauthorized API access at the control plane level.
- Token/Session Handover Time: Minimize the time it takes from a user requesting a sandbox to the control plane establishing a secure proxy tunnel.
- Distributed Systems Mastery: 8+ years of professional software engineering experience, with a heavy emphasis on building large-scale SaaS or PaaS control products using Go (Golang) or similar backend languages.
- API & Proxy Expertise: Proven experience building high-throughput REST/gRPC APIs, custom reverse proxies, or network routers handling concurrent connection scaling.
- Orchestration & State Management: Practical experience with cluster schedulers (Nomad, Kubernetes), service meshes, or distributed key-value stores (Consul, Etcd) for real-time state tracking.
- Data Layer Architecture: Strong experience modeling application state in PostgreSQL and designing high-volume telemetry ingestion pipelines using columnar data stores like ClickHouse.
- Product-First Mindset: Experience building products designed for other developers (APIs, SDKs, Cloud Consoles) with a deep empathy for developer workflows and latency constraints.
- Preferred Attributes: Familiarity with the unique orchestration challenges of Agentic AI, LLM orchestration frameworks, or building multi-tenant user platforms.
*This job is located in Hyderabad, India
#LI-Hybrid
Why You’ll Like Working for DigitalOcean
- We innovate with purpose. You’ll be a part of a cutting-edge technology company with an upward trajectory, who are proud to simplify cloud and AI so builders can spend more time creating software that changes the world. As a member of the team, you will be a Shark who thinks big, bold, and scrappy, like an owner with a bias for action and a powerful sense of responsibility for customers, products, employees, and decisions.
- We prioritize career development. At DO, you’ll do the best work of your career. You will work with some of the smartest and most interesting people in the industry. We are a high-performance organization that will always challenge you to think big. Our organizational development team will provide you with resources to ensure you keep growing. We provide employees with reimbursement for relevant conferences, training, and education. All employees have access to LinkedIn Learning's 10,000+ courses to support their continued growth and development.
- We care about your well-being. Regardless of your location, we will provide you with a competitive array of benefits to support you from our Employee Assistance Program to Local Employee Meetups to flexible time off policy, to name a few. While the philosophy around our benefits is the same worldwide, specific benefits may vary based on local regulations and preferences.
- We reward our employees. The salary range for this position is based on market data, relevant years of experience, and skills. You may qualify for a bonus in addition to base salary; bonus amounts are determined based on company and individual performance. We also provide equity compensation to eligible employees, including equity grants upon hire and the option to participate in our Employee Stock Purchase Program.
- DigitalOcean is an equal-opportunity employer. We do not discriminate on the basis of race, religion, color, ancestry, national origin, caste, sex, sexual orientation, gender, gender identity or expression, age, disability, medical condition, pregnancy, genetic makeup, marital status, or military service.
Application Limit: You may apply to a maximum of 3 positions within any 180-day period. This policy promotes better role-candidate matching and encourages thoughtful applications where your qualifications align most strongly.
Similar Jobs at DigitalOcean
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Lead design and build of a multi-tenant control plane for AI agents using Go. Develop and scale distributed services, high-throughput APIs, authentication, streaming (Kafka/SSE), telemetry pipelines, and integrations with LLMs. Own reliability, SLOs, observability, mentor engineers, and collaborate cross-functionally to deliver secure, low-latency developer experiences.
Top Skills:
Api GatewayClickhouseConsulCrewaiEtcdGoGrpcKafkaKubernetesLangchainLanggraphModel Context Protocol (Mcp)MySQLNomadObservability ToolsOpenai Agents SdkPostgresRedisRestReverse ProxyService MeshSnowflakeSse
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Develop and maintain high-throughput backend services and concurrent asynchronous workflows (Python/Go). Integrate control planes with isolated execution environments, build scalable gRPC/REST APIs, monitor performance, investigate bugs, and collaborate cross-functionally to ensure reliable evaluation of AI agents.
Top Skills:
C++DockerGoGrpcJavaKubernetesLlm ApisMicrovmsPythonRest
Artificial Intelligence • Cloud • Software • Infrastructure as a Service (IaaS)
Lead design and build of a multi-tenant control plane for AI agents using Go. Develop and scale distributed services, high-throughput APIs, authentication, streaming (Kafka/SSE), telemetry pipelines, and integrations with LLMs. Own reliability, SLOs, observability, mentor engineers, and collaborate cross-functionally to deliver secure, low-latency developer experiences.
Top Skills:
Api GatewayClickhouseConsulCrewaiEtcdGoGrpcKafkaKubernetesLangchainLanggraphModel Context Protocol (Mcp)MySQLNomadObservability ToolsOpenai Agents SdkPostgresRedisRestReverse ProxyService MeshSnowflakeSse
What you need to know about the Kolkata Tech Scene
When considering the industries shaping India's tech scene, gaming might not immediately come to mind. However, in the last decade, increased internet usage and greater access to mobile devices have catapulted the industry to new heights, with Kolkata-based companies like Virtualinfocom, Red Apple Technologies and Digitoonz, at the forefront, driving the design and animation of new gaming titles for players.
