Proof of concept

Data collection

Smartphone Motorola Moto G6 Sensors Data Collector App (Fast)

• BMI160 Accelerometer
• AK09918 Magnetometer
• BMI160 Gyroscope
• Rotation vector

TrackAddict Video

Laptop with Webcam

POC

Limitations:

• No vehicle sensors because we don't have OBD2 connectivity now
• Simulate car driving status

Release 1:

System: Laptop, Webcam

• Locate face
• Able to locate face with 30 fps
• Can handle head turn left/right x degrees
• Can handle head up/down x degrees
• Occlusion (face partially hiden by hands)
• Detect
  • Look forward
  • Look left/right/rear mirror
  • Closed eyes (sound alarm)

https://docs.openvinotoolkit.org/2021.1/omz_models_intel_driver_action_recognition_adas_0002_description_driver_action_recognition_adas_0002.html