About this role
The LocalAI team is seeking a Senior Systems Software Engineer to develop efficient on-device AI software for RTX and DGX-class systems. The role focuses on building and optimizing local AI inference stacks, performing end-to-end model optimization, and ensuring high-performance deployment on resource-constrained platforms.
Skills for this role
C++Machine LearningDeep LearningLlama.cppvLLMPyTorchWindows MLDXCGCTensorRTCUDAGPU ProgrammingQuantizationPruningDistillationVulkanDirectX