VIGILANT: THREE-POINT HIGH RISK DRIVER DETECTION USING CONVOLUTIONAL NEURAL NETWORKS

In the United States, one of the leading causes of fatal vehicle accidents is distraction. According to the report filed by National Highway Traffic Safety Administration (NHTSA) in 2016, 6.2 percent and 2.5 percent of the fatal crashes were found to be caused by distraction and fatigue, respectively.

In this research, we examine the extent to which distracted driving can be measured from facial expressions, body activity, and eye movement. Through the use of several cameras, machine learning algorithms will take real-time data and detect whether a user is distracted.

Thus, we plan to collect the data on distracted drivers by having people simulate the distracted actions behind the wheel. In order to develop these algorithms, we need your help in obtaining this data.

CONSENT FORM

In this research program before recording any videos please read and sign the consent form and send it to nayeem@umd.edu

DATA COLLECTION - PARTICIPANT ROLE

Using a camera on a cellphone or a laptop, you will record yourself performing a sequence of actions in a parked car while seated in the driver seat and pretending to be driving. These actions are described in the videos, below. You are asked to perform these actions while saying a few sentences and in some cases, yawning. Each of these actions is going to take between half a minute and a minute.
Once the data has been collected, you simply need to upload the video files to your google drive and share that with nayeem@umd.edu. We will keep your data safe.

WARNING: Please record these actions while pretending to be driving in a parked car and NOT while actually driving. The car should be parked at all times when performing these actions.

Note: Please try to capture the full torso AND the face in every frame of the recorded video. It is very important that the camera is placed at an angle where the eyes and mouth are fully shown when the participant is facing forward.

The desired location and angle
of the camera.

A sample recommended angle
at which all the features of a
driver’s face are distinct when
facing forward.

Following the image above, please align the camera with the bottom of the frame ending at the driver’s waist, and the left side of the camera aligning with the left side of the driver’s seat.

We would like you to perform the following ten actions as shown in the videos below:

ACTION 1: Texting while driving (phone in left hand)
- General Idea:
  - While driving, try to act as if you were texting your friend and trying to drive at the same time.
- How?
  - Adjust right hand’s position on steering wheel.
  - Glance at the phone in the left hand once in a while, head pointing down at the phone.
- Requirement:
  - Keep the phone in your left hand and steer the wheel with the right hand only.
- file-name:
  - Name the file "texting-left”.

ACTION 2: Texting while driving (phone in right hand)
- General Idea:
  - While driving, try to act as if you were texting your friend and trying to drive at the same time.
- How?
  - Adjust left hand’s position on steering wheel.
  - Glance at the phone in the right hand once in a while, head pointing down at the phone.
- Requirement:
  - Keep the phone in your right hand and steer the wheel with the left hand only.
- file-name:
  - Name the file "texting-right”.

ACTION 3: Talking On the phone (phone in left hand)
- General Idea:
  - Act like you're talking with a friend on the phone and try to say some sentences.
- How?
  - You can use speaker phone and hold the phone in front of you with your left hand.
  - You can put the phone on your left shoulder and hold it down with your head.
  - You just hold it with your left hand and place the phone against your ear
- Requirement:
  - Phone must be held or supported by the left part of your body.
- file-name:
  - Name the file "phone-left”.

ACTION 4: Talking On the phone (phone in right hand)
- General Idea:
  - Act like you're talking with a friend on the phone and try to say some sentences.
- How?
  - You can use speaker phone and hold the phone in front of you with your right hand.
  - You can put the phone on your right shoulder and hold it down with your head.
  - Hold it with your right hand and place the phone against your ear
- Requirement:
  - Phone must be held or supported by the right part of your body.
- file-name:
  - Name the file "phone-right”.

ACTION 5: Adjust the radio/center console
- General Idea:
  - Act like you are changing the radio to a station you like or adjusting the temperature.
- How?
  - Reach towards the radio with your right hand and pretend to change the radio.
  - Reach towards the air conditioner and pretend to adjust the temperature.
  - Reach towards the air vents and move them.
  - Move your arms to different locations near the radio or reach for anything you would touch in a car normally in the center.
- Requirement:
  - You should only reach for stuff near the radio under the rearview mirror.
- file-name:
  - Name the file "radio”.

ACTION 6: Grabbing something from the back of the car
- General Idea:
  - Act as if you are grabbing something from the back of the car.
- How?
  - Turn around and reach for a seat behind you.
  - You can also try to look forward while reaching for something in the back.
- Requirement:
  - At least one hand should be behind the gap between the front seats.
- file-name:
  - Name the file "reaching”.

ACTION 7: Yawning while driving
- General Idea:
  - Yawn as if you were tired.
- How?
  - For the first 30-seconds of yawn, please don’t cover your mouth and yawn like you normally would; while yawning, turn your head left and right so that we can get different angles of the yawn.
  - For the next 30-seconds of yawn, yawn with your hand over your mouth; here, we would like you to keep your hand flat while yawning, then in a fist, and finally a mix of both where your hand is slightly curled.
- Requirement:
  - Mouth should be open when yawning.
  - Eyes should be almost closed, if not fully, while yawning
- file-name:
  - Name the file "yawning”.

ACTION 8: Driving without talking (Safe driving)
- General Idea:
  - This part will model what normal and safe driving looks like.
- How?
  - Drive as if you were in a car by yourself and do not talk during this part.
  - Check your side mirrors, rear view mirror, and straight ahead.
- Requirement:
  - No talking.
  - No signs of distraction.
- file-name:
  - Name the file "normal”.

Action 9: Driving while talking
- General Idea:
  - This part will model what normal and safe driving looks like, but with talking.
- How?
  - Say a few sentences.
  - Try moving your head and talking as if you were talking to other passengers in the car.
  - May talk, laugh, smile, scream, and sing as long as you're speaking.
- Requirement:
  - Mouth must be open.
- file-name:
  - Name the file "talking”.

ACTION 10: Passed out
- General Idea:
  - Act like you just passed out while driving.
- How?
  - Slouch, lower your head, fall to the side.
  - Tilt head, fall to the side, look down, slump over steering wheel.
- Requirement:
  - Signs of helplessness.
- file-name:
  - Name the file "passedout”.

ACTION 11: One assigned action without seatbelt
- General Idea:
  - This is a repetition of one action with no seatbelt on.
- How?
  - Our Research Assistant will asisgn an action to repeat without seat belt.
  - Perform the action using the instructions above.
- Requirement:
  - Follow the assigned action instructions without the seat belt.
- file-name:
  - Name the file "random”.

SHARING ACTION VIDEOS

Once you have recorded these videos, you may share them by uploading them to Google drive, and sharing them with nayeem@umd.edu and hkjoo@umd.edu.