Self-Supervised Speed Breaker & Pothole Anticipation
Predicts unmarked speed breakers and potholes before impact using a phone's camera, GPS and motion sensors. Training labels come from the vehicle's own response to the road, so no manual labeling is needed.
Pipeline: Record, Detect the event, Label, Extract frames, Train, Anticipate.
Details
- Record. Phone camera, GPS and IMU on a rigid mount
- Detect the event. GPS speed dip plus accelerometer spike; gyroscope confirms
- Label. The vehicle's response marks the bump or pothole
- Extract frames. Video from 2 to 3 seconds before the event
- Train. A lean vision model learns what the road looks like before a hit
- Anticipate. Warn before impact and add the spot to a hazard map
- Problem
- Many speed breakers and potholes on Pakistani roads are unmarked and unmapped, so drivers and navigation apps cannot see them coming.
- Approach
- The vehicle's own response is used as the label. A dip in GPS speed together with a spike in the accelerometer marks a road event, and the gyroscope confirms it. Video frames from 2 to 3 seconds before the event are then extracted and used to train a lean vision model that recognises the road ahead.
- Data
- A phone fixed rigidly to the vehicle records camera video, GPS and IMU readings (accelerometer and gyroscope). A rigid mount is required, because a gimbal would remove the vibration signal the labels depend on.
- Why it matters
- No manual labeling is needed, and the model learns from local road conditions instead of foreign datasets.
- Status
- Data collection and sensor calibration are the next steps. No results are claimed yet.
- My MS thesis (in progress)
- Data collection with a rigidly mounted phone, sensor calibration, self-labeling pipeline, and the vision model.
- Research paper (planned)
- A paper by Rashid Liaquat (first author) and Umer Farooq (second author) on self-supervised road-hazard anticipation using vehicle response as the label, aimed at a computer vision or intelligent transport venue.
- Joint product (planned)
- A rider or fleet safety device: a small sensor unit with a GPS hazard map that warns before known bumps, built on the thesis models.





