Camera pointing to mouth: Smile detection?

[feklee]

I want to point the ESP-EYE directly at the mouth, then do detection of a smile or a frown. Any idea how this could be approached?

Note that the camera will only see the mouth, not the entire face.

[Momandai]

Maybe you can build a mouth landmarks regression network, and use these landmarks to judge the state of the mouth

[feklee]

Thank you for the suggestion, I'll look into that!