Sr. Software Dev Engineer, Alexa LLM Inference, Capacity, & Efficiency
Join Our Community
Required Skills
Job Description
- *DESCRIPTION**
- --------------
Are you passionate about building and operating the world's largest real\-time LLM inference systems? Are you a technical leader who thrives in high\-ambiguity environments and wants to drive architectural decisions that impact millions of Alexa customers daily? If so, the Alexa LLM Inference, Capacity, \& Efficiency (ALICE) team is looking for a Senior Software Development Engineer to join our new India team and own critical components of Alexa's LLM inference infrastructure.
Alexa is shaping the future of AI voice\-based personal assistants. At ALICE, we are passionate about infrastructure efficiency, cost optimization, and capacity management to enable amazing customer experiences at scale. You will be a founding technical leader of our India presence, setting the bar for engineering excellence and driving high\-impact work on one of Amazon's most critical AI services.
Key job responsibilities
- Serve as a technical leader for the ALICE India team, driving architecture decisions for the AlexaLLMInferenceService (LLMI) and related ALICE portfolio services
- Design and implement scalable, high\-availability systems for LLM inference serving, including multi\-node distributed inference and multi\-tenancy capabilities
- Lead technical design reviews, set coding standards, and mentor junior SDEs on the team
- Make technical trade\-offs between short\-term team needs and long\-term business needs, with a focus on performance, cost, and reliability
- Collaborate with ALICE teams in Seattle and partner teams across Alexa and AGI on cross\-cutting infrastructure programs
- Drive operational excellence for Tier\-1 production services, including on\-call ownership, incident response, and continuous improvement
- Influence the broader ALICE software architecture and contribute to org\-wide technical strategy
A day in the life
As a Senior SDE, you will be part of the technical leadership for the India team, owning architecture decisions for LLMI components and contributing to ALICE's broader portfolio of infrastructure optimization products.
- *BASIC QUALIFICATIONS**
- -----------------------
- 6\+ years of non\-internship professional software development experience
- 5\+ years of programming using a modern programming language such as Java, C\+\+, or C\#, including object\-oriented design experience
- 5\+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
- Experience contributing to the architecture and design (architecture, design patterns, reliability and scaling) of new and current systems
- Experience building complex software systems that have been successfully delivered to customers
- *PREFERRED QUALIFICATIONS**
- ---------------------------
- 5\+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
- Bachelor's degree in computer science or equivalent
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how\-we\-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Similar Jobs
- J
Lead Software Engineer - Java Full Stack, React
JPMorganChase · Bengaluru, Karnataka, India
- C
Senior Software Engineer – Full stack developer (Java & React)
Candescent · India
- D
Managed Services Engineer II-Fullstack Java-Hyderabad/Bengaluru
Deloitte · Hyderabad, Telangana, India
Job Overview
- Job type
- Full-time
- Work mode
- On-site
- Location
- Bengaluru
- Posted
- 3h ago
- Source
- Indeed