Software Principal Engineer- AI Compiler

Role responsibilities

Optimize deep learning computational graphs to enhance performance, throughput, and latency on Ampere's accelerator hardware. Collaborate on HW/SW co-design and integrate popular AI frameworks and serving platforms into the hardware stack.

Requirements

Requires a Bachelor's or Master's degree in Computer Science or a related field with 6-8 years of experience. Candidates should have strong CS fundamentals, proficiency in Python and C++, and ideally a background in CPU/GPU compiler development.

Key skills

Computational Graph Optimization, Python, C/C++, LLVM, MLIR, Deep Learning, PyTorch, Llama.cpp, vLLM, SGLang, Algorithms, Data Structures, Compiler Development, Neural Network Architectures, Graph Algorithms

Keywords

AI Compiler, Deep Learning Accelerator, Computational Graphs, Op Fusion, Pattern Recognition, Redundancy Elimination, PyTorch, Llama.cpp, vLLM, SGLang, LLVM, MLIR, C++, Python, Semiconductor, CPU Design, GPU, Inference Serving, Compute Kernels, Competitive Programming, ACM ICPC, Codeforces, USACO, IOI, Neural Networks, Hardware-Software Co-design