SpaHeron_MachineLearning_UXIS

Lecture score calculator with iris location using madiapipe.

eye_tracking

• Based on https://github.com/antoinelame/GazeTracking
• Print pupil's position, using HOG + DNN(maybe?) face detection.
• Detect face with HOG. Try detecting face with DNN, if face is not detected.
• While HOG prints pupil properly, DNN prints only CENTER of eye.
• Webcam version.

mediapipe

• Based on https://github.com/google/mediapipe
• Edit iris_trakcing part.
• Calculate both eye's iris location.
• The result of output is as followed.
  
  OH MY GIRL - SEUNG

State Calculation

• Communicate with mediapipe program by 'Named pipe' to share iris's location(see mediapipe/pipe).
• State value: 0 - ATTEND, 1 - ABSCENT, 2 - CONCENTRATE, 3 - DISTRACT
• Structure
  

ML

• Score prediction using multiple linear regression.
• Input: an array with 4 states counted individually / output: lecture score.