Skip to main content
Apple

Machine Learning System Software Engineer

Apple Sunnyvale, California, United States 9 days ago
At Apple, we"re on the cutting edge of delivering transformative experiences through Artificial Intelligence. If you"re passionate about pushing the boundaries of AI and hardware optimization, we want you to join our team! As a Machine Learning System Software Engineer on the Apple Neural Engine (ANE) team, you"ll work to bring high-performance, low-power AI solutions to life on iconic Apple products like the Vision Pro, iPhone, iPad, Mac, and more.

This is a dynamic opportunity to work in a creative, collaborative environment while developing groundbreaking technologies that will shape the future of computing! We are looking for an engineer with deep expertise in system software technology who is eager to tackle new challenges and responsibilities as the role evolves. As the position progresses, there will be opportunities to demonstrate technical leadership, influence key design decisions, collaborate with and support other engineers, and help guide the direction of Apple"s AI-driven capabilities across the ecosystem. Are you ready to help us deliver the next groundbreaking Apple products?

Design and implement API"s for Apple"s Neural Engine - defining how clients load, compile, schedule and execute models on device\\nArchitect APIs which provide client control of model lifecycle management, memory allocation strategies, multi-model scheduling, and concurrent execution β€” ensuring the runtime scales with new hardware capabilities\\nCollaborate deeply with driver, firmware and compiler teams to co-design the runtime-to-silicon interface, ensuring new hardware features are exposed with correct abstractions\\nProfile and optimize end-to-end inference paths, identifying bottlenecks in scheduling, compilation, and inference execution\\nSupport clients in adopting APIs and ensuring efficient integration

BS and a minimum of 3 years relevant industry experience\\nExperience defining interfaces that are used by other teams or external developers, with attention to lifecycle, error handling, and forward compatibility\\nDeep proficiency in C and C++ in large, production system software\\nUnderstanding of runtime systems: process/thread models, memory management, IPC/RPC, and resource lifecycle\\nUnderstanding of software-hardware interfaces: registers, DMA, command queues, or similar accelerator interaction patterns\\nExperience shipping production system software

Experience building or extending ML runtimes, inference engines, or accelerator driver stacks (e.g., TensorRT, ONNX Runtime, XLA, Metal, Vulkan compute, or similar)\\nFamiliarity with Swift/Rust or another memory-safe systems language\\nFamiliarity with ML model compilation pipelines and how runtime APIs interact with compiler outputs (graph IR, compiled binaries)\\nExperience with multi-client runtime scenarios: arbitrating hardware access, managing priority/QoS, and handling client lifecycle (ex: connect, disconnect, crash recovery)\\nKnowledge of neural network inference: operator execution, tensor memory layout, pipelining, and batching strategies\\nStrong communication skills and experience working across team boundaries (framework teams, compiler teams, hardware teams)
Apply now
Sunnyvale, California, United States
On-site
9 days ago

Share this job