Eye and Face-Controlled Mouse Based on Human-Computer Interaction

Authors

  • Rakesh Koendar Assistant Professor, Computer Science, Kirti M. Doongursee College, Mumbai
  • Siddhesh Kadam Assistant Professor, Computer Science, Kirti M. Doongursee College, Mumbai

DOI:

https://doi.org/10.53032/tvcr/2025.v7n2.20

Keywords:

HCI, CNN, OpenCV

Abstract

In the current digital era, prospects for computer improvements are constantly presented by developments in the applied sciences. Hands-free computer solutions are becoming more and more popular these days, especially for people who have quadriplegia. A Human-Computer Interaction (HCI) system that is especially helpful for amputees and other people who might have trouble utilising their hands is presented in this study. Eye motions including blinking, looking, and squinting are translated into comparable mouse cursor operations via the created system's eye-tracking interface, which works similarly to a computer mouse.The gadget under discussion makes use of a regular camera, and it requires Python (3.6), OpenCV, NumPy, and a number of other facial recognition-related apps. The HOG (Histogram of Orientated Gradients) technique may be used to recognise faces by combining the sliding window approach with a deep learning algorithm (CNN) or linear classifier. Because it doesn't require any extra gear or sensors, this system is completely hands-free.

                                                                  

References

Adrian Rosebrock. “Detect eyes, nose, lips, and jaw” with dlib, OpenCV, and Python.”

. Anamika Mali, Ritisha Chavan, Priyanka Dhanawade, “Optimal System for Manipulating Mouse Pointer through Eyes”,in International Research Journal of Engineering and Technology (IRJET) March 2016.

. Vaibhav Nangare, Utkarsha Samant, Sonit Rabha , “Controlling Mouse Motions Using Eye Blinks, Head Movements and Voice Recognition”,in International Journal of Scientific and Research Publications, Volume 6, Issue 3, March 2016.

. Alex Poole and Linden J. Ball, “Eye Tracking in Human-Computer Interaction and Usability Research: Current Status and Future Prospects,”in Encyclopedia of Human Computer Interaction (30 December 2005) Key: citeulike:3431568, 2006, pp. 211-219.

. Margrit Betke,James Gips, “The Camera Mouse: Visual Tracking of Body Features to Provide Computer Access for People With Severe Disabilities”,in IEEE transactions on neural systems and rehabilitation.

. Robert Gabriel Lupu, Florina Ungureanu, Valentin Siriteanu, “Eye Tracking Mouse for Human Computer Interaction”,in The 4th IEEE International Conference on E-Health and Bioengineering - EHB 2013. [3] Prof. Prashant Salunkhe, Miss. Ashwini R. Patil , “A Device Controlled Using Eye Movement”,in International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT) - 2016.

Downloads

Published

2025-04-30

How to Cite

Koendar, R. ., & Kadam, S. . (2025). Eye and Face-Controlled Mouse Based on Human-Computer Interaction . The Voice of Creative Research, 7(2), 162–166. https://doi.org/10.53032/tvcr/2025.v7n2.20