CareerPlanSign in

Principal Software Engineer - AI Frameworks

United States, Multiple Locations, Multiple Locations💼 Full-time🗓 2026-09-28 → 2026-10-03

Core

Define technical vision, architecture, and roadmap for critical AI frameworks, performance, and developer-productivity capabilities while driving measurable improvements in model onboarding and runtime efficiency.

Role type

Principal Software Engineer (AI Frameworks & Infrastructure)

Builds

Scalable AI inference platforms, high-performance distributed systems, and reusable engineering mechanisms for model deployment.

Domain

Artificial Intelligence, High-Performance Computing, Cloud Infrastructure

Deliverable

production ML models

Required skills

C++, Python, software architecture, computer architecture, accelerator-aware optimization, LLM inference frameworks, distributed systems design, technical leadership, stakeholder alignment, cross-team strategy execution, platform scalability, observability, automation.

Preferred skills

AI accelerator kernel optimizations, Azure capacity management, mentoring emerging technical leads, inclusive engineering culture building.

Technologies

C++, Python, LLM inference frameworks, AI accelerators, Azure

Responsibilities

Own technical vision and multi-release execution strategy for AI frameworks; lead technical alignment across teams and resolve competing requirements; mentor engineers and develop technical leadership capacity; steer cross-stack investigations spanning models, compilers, and silicon; provide hands-on technical leadership via prototypes and critical-path implementation; drive automation and observability mechanisms for scalable platform capabilities.

Seniority

Principal, strategy & mentorship

Sourced via microsoft · Listed on CareerPlan, which tracks 928,000+ jobs from 20+ sources.