Jobs
A

Sr. Software Dev Engineer, Alexa LLM Inference, Capacity, & Efficiency

Amazon.comKA, IN3h ago
Full-timevia indeed

Required Skills

javallm

Job Description

  • *DESCRIPTION**
  • --------------

Are you passionate about building and operating the world's largest real\-time LLM inference systems? Are you a technical leader who thrives in high\-ambiguity environments and wants to drive architectural decisions that impact millions of Alexa customers daily? If so, the Alexa LLM Inference, Capacity, \& Efficiency (ALICE) team is looking for a Senior Software Development Engineer to join our new India team and own critical components of Alexa's LLM inference infrastructure.

Alexa is shaping the future of AI voice\-based personal assistants. At ALICE, we are passionate about infrastructure efficiency, cost optimization, and capacity management to enable amazing customer experiences at scale. You will be a founding technical leader of our India presence, setting the bar for engineering excellence and driving high\-impact work on one of Amazon's most critical AI services.

Key job responsibilities

  • Serve as a technical leader for the ALICE India team, driving architecture decisions for the AlexaLLMInferenceService (LLMI) and related ALICE portfolio services
  • Design and implement scalable, high\-availability systems for LLM inference serving, including multi\-node distributed inference and multi\-tenancy capabilities
  • Lead technical design reviews, set coding standards, and mentor junior SDEs on the team
  • Make technical trade\-offs between short\-term team needs and long\-term business needs, with a focus on performance, cost, and reliability
  • Collaborate with ALICE teams in Seattle and partner teams across Alexa and AGI on cross\-cutting infrastructure programs
  • Drive operational excellence for Tier\-1 production services, including on\-call ownership, incident response, and continuous improvement
  • Influence the broader ALICE software architecture and contribute to org\-wide technical strategy

A day in the life

As a Senior SDE, you will be part of the technical leadership for the India team, owning architecture decisions for LLMI components and contributing to ALICE's broader portfolio of infrastructure optimization products.

  • *BASIC QUALIFICATIONS**
  • -----------------------
  • 6\+ years of non\-internship professional software development experience
  • 5\+ years of programming using a modern programming language such as Java, C\+\+, or C\#, including object\-oriented design experience
  • 5\+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
  • Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
  • Experience building complex software systems that have been successfully delivered to customers
  • *PREFERRED QUALIFICATIONS**
  • ---------------------------
  • 5\+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
  • Bachelor's degree in computer science or equivalent

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how\-we\-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Similar Jobs

Browse all jobs

Job Overview

Job type
Full-time
Work mode
On-site
Location
Bengaluru
Posted
3h ago
Source
Indeed