New opportunity

Lead Software Engineer, Perception (Robotics)

Grab · Singapore

About this role

The Robotics Technology team at Grab is focused on building urban embodied AI for last-mile delivery services. As a Lead Software Engineer, Perception (Robotics), you will develop and ship systems that transform raw multi-sensor data into real-time, predictive representations of the world. You will work across a modular perception stack, contributing to model development, evaluation, integration, and on-robot validation. Responsibilities include advancing multi-object tracking, generic open-set world understanding, and motion prediction for various agents. You will also explore VLM/VLA and embodied foundation models for open-vocabulary perception and task-conditioned intelligence, ensuring these models meet real-time performance and safety standards. You will collaborate with cross-functional teams to move capabilities from research into production-grade deployment on hardware like NVIDIA Orin. Required qualifications include at least 3 years of hands-on experience in perception or prediction systems for robotics, AV, or ADAS, with proficiency in C++ and Python. You must have depth in classical geometric methods and modern learning-based approaches, including Bayesian filtering and multi-sensor integration. Preferred qualifications include experience with foundation model adaptation, 3D/BEV detection, and robotics platforms such as ROS 2, TensorRT, or DeepStream. The role is based in Singapore and China and requires working on-site.

For full details about this role, click “Apply on company site” to view the employer’s original posting.

Skills for this role

C++PythonMulti-object trackingBayesian state estimationMotion predictionLiDARRadarIMUComputer VisionSensor fusionAutonomous drivingROS 2NVIDIA OrinTensorRTOpenCVPCLCeresVLMVLABEV occupancy

Your skill match

Checking your profile…

YOUR NEXT STEP

Get interview-ready for this role

A focused preparation guide, built around this job’s responsibilities and requirements.

✦ AI-generated guide
Preparation suggestions, not the employer’s actual interview questions. Always check the original posting for current requirements.
01

Understand the role

What matters most

  • Production-Grade Perception Deployment

    The role requires moving research-level perception models into real-world, on-robot deployment on hardware like NVIDIA Orin. You must balance the performance of modern learning-based models with the reliability of classical geometric and Bayesian filtering methods to ensure safety and real-time execution.

  • Robust Multi-Object Tracking and Prediction

    You are expected to advance tracking capabilities, specifically focusing on ID stability during occlusions and crowded scenes. This includes evolving from traditional Bayesian state estimation to query-based or learned tracking, while ensuring motion prediction interfaces effectively with downstream planning systems.

  • Open-Set World Understanding

    A core priority is building class-agnostic obstacle detection and occupancy representations to handle unknown or rare objects. You will need to implement and validate these systems to ensure the robot can safely navigate complex, unpredictable urban environments.

  • Foundation Model Adaptation

    You will explore the integration of VLM/VLA and embodied foundation models for long-tail reasoning and task-conditioned intelligence. The priority is to distill, quantize, and adapt these models for edge deployment, ensuring they meet strict latency and grounding standards.

Likely challenges to think through

  • Balancing Research Innovation with Real-Time Constraints

    The team values cutting-edge research but demands measurable closed-loop value and strict embedded latency budgets. Prepare by demonstrating how you have successfully optimized complex models for resource-constrained hardware without sacrificing safety or reliability.

  • Managing Multi-Sensor and Temporal Consistency

    Integrating data from camera, LiDAR, radar, and IMU requires precise calibration and temporal alignment. You may face challenges with sensor drift or synchronization issues; prepare by highlighting your experience in diagnosing and resolving these issues through log-driven root-cause analysis.

  • Ensuring Safety in Unstructured Environments

    Moving from controlled testing to production fleet operations in urban areas introduces significant edge cases. Prepare by discussing your approach to defining quality gates and using simulation or replay to validate safety outcomes before deployment.

03

Practice your answers

Technical practice

Multi-Object Tracking (MOT) in Crowded Environments

What to coverExplain your approach to maintaining ID stability during occlusions and detector gaps. Discuss the trade-offs between classical Bayesian filtering (e.g., EKF/UKF) and modern query-based or transformer-based tracking methods.

Generic Open-Set World Understanding

What to coverHow do you implement class-agnostic obstacle detection to ensure safety against unknown objects? Discuss the use of occupancy grids or occupancy networks and how they integrate with learned detection branches.

Motion Prediction and Uncertainty Estimation

What to coverDescribe how you model multi-modal trajectory forecasting for dynamic agents like pedestrians or cyclists. How do you quantify and communicate prediction uncertainty to the downstream planning stack?

Sensor Fusion and Temporal Consistency

What to coverDetail your strategy for integrating asynchronous data from LiDAR, radar, cameras, and IMU. Address how you handle time-synchronization and calibration issues to maintain a consistent world representation.

Deploying Foundation Models to Edge Hardware

What to coverWhen adapting VLM/VLA models for on-robot deployment (e.g., NVIDIA Orin), what techniques do you use for distillation, quantization, or fine-tuning? How do you validate these models against hallucinations and latency constraints?

Performance Metrics and Quality Gates

What to coverDefine the key metrics you use to evaluate perception and prediction systems (e.g., MOTA, ADE/FDE, occupancy recall). How do you set quality gates to prevent regressions during fleet-log replay and simulation?

Hybrid Perception Architectures

What to coverThe role emphasizes balancing modular classical methods with end-to-end learning. Suggest how to design a system where classical geometric methods serve as safety fallbacks for deep learning models.

Real-time Embedded Optimization

What to coverDiscuss your experience optimizing perception pipelines using tools like TensorRT. How do you balance the computational cost of complex models against the strict latency requirements of a delivery robot?

Behavioural practice

Handling Research-to-Production Transitions

What to coverDescribe a situation where you had to take a promising research prototype and make it production-ready. Focus on how you handled performance bottlenecks, reliability requirements, and cross-functional feedback.

Root-Cause Analysis in Production

What to coverProvide an example of a time you identified a failure in a deployed robotics system using fleet logs. Explain your process for isolating the issue, validating the fix in simulation, and ensuring it did not recur.

Cross-Functional Collaboration

What to coverDescribe a time you worked with planning or integration teams to resolve a disagreement regarding perception output interfaces. How did you ensure the final design met the needs of both teams while maintaining system safety?

Navigating Technical Trade-offs

What to coverGive an example of a project where you had to choose between a high-performance learning-based approach and a more interpretable classical method. What factors influenced your decision and what was the outcome?

02

Sharpen your knowledge

Topics to prepare

  • Bayesian State Estimation and Multi-Object Tracking

    Review the mathematical foundations of Kalman, EKF, and UKF filters. Practice designing data association strategies for scenarios with occlusions and sensor noise. This is critical for the role's requirement to maintain ID stability and track lifecycles in crowded urban environments.

  • Embodied Foundation Model Adaptation

    Study techniques for distilling, quantizing, and fine-tuning VLM/VLA models for edge deployment. Focus on methods to mitigate hallucinations and ensure temporal consistency. This is essential for the team's goal of moving open-vocabulary perception from research to production-grade hardware.

  • Temporal Perception and BEV Representations

    Analyze streaming Bird's-Eye-View (BEV) architectures and occupancy flow models. Understand how to integrate temporal context into detection and prediction pipelines. This is directly relevant to the role's focus on building reliable, real-time world representations.

Skills to revise

  • C++ and Python for Embedded Robotics

    Practice writing performance-critical code in C++ and high-level orchestration in Python. Focus on memory management and latency optimization for real-time systems. This is a core requirement for deploying models on hardware like NVIDIA Orin.

  • TensorRT and Edge Inference Optimization

    Gain hands-on experience with TensorRT to optimize neural network inference. Practice converting models to run efficiently on embedded GPUs. This is highly relevant for meeting the role's strict real-time performance and safety standards.

  • Multi-Sensor Fusion and Geometric Calibration

    Develop a workflow for calibrating and synchronizing data from LiDAR, Radar, and Cameras. Practice diagnosing alignment issues using PCL or OpenCV. This is essential for ensuring consistent spatial and temporal data integration in the perception stack.

04

Your preparation checklist

  • Prepare a technical case study on multi-object tracking

    Draft a summary of a past project where you solved ID stability or fragmentation issues in crowded scenes. Be prepared to discuss your specific implementation of Bayesian filtering (e.g., EKF/UKF) versus learned query-based tracking methods.

  • Review geometric and sensor fusion fundamentals

    Refresh your knowledge on LiDAR, radar, and camera calibration, including time-synchronization and spatial alignment. Prepare to explain how you have diagnosed and resolved sensor fusion discrepancies in previous robotics or AV deployments.

  • Develop a strategy for deploying foundation models on edge hardware

    Outline your approach to adapting VLM/VLA models for real-time robotics. Focus on techniques like distillation, quantization, and fine-tuning (e.g., LoRA) to meet the latency constraints of platforms like NVIDIA Orin.

  • Formulate questions regarding the perception-planning interface

    Prepare thoughtful questions about how the team handles uncertainty estimation in motion prediction and how perception outputs are structured for downstream planning and behavior modules.

  • Document your experience with production-grade robotics pipelines

    Prepare to discuss your workflow for moving models from research to production, specifically focusing on how you use simulation, log-driven root-cause analysis, and regression testing to maintain safety standards.

AI-generated from the job information · Prepared Oct 16, 2026 (UTC)Useful preparation, not a guarantee of eligibility or an offer.

Availability last checked: 18 Oct 2026. Status can change after a check; confirm on the employer’s website. Report an issue · Our checking policy

KEEP EXPLORING

Similar AI jobs

Related skills and specializations in Singapore. Matched to this role, not your profile.

Explore more jobs
Finding similar opportunities…