About this role
The LocalAI team is seeking a Senior Systems Software Engineer to build and optimize efficient on-device AI inference stacks for RTX and DGX-class systems. The role involves end-to-end optimization of AI models, development of inference runtimes, and applying techniques like quantization and pruning to enable high-performance local AI deployment.
Skills for this role
C++Llama.cppvLLMPyTorchWinMLDXCGCTensorRTCUDAVulkanDirectXMachine LearningDeep LearningGenerative AI