ProctorAI: Intelligent Proctoring System Using OpenCV, Mediapipe, Dlib & Speech Recognition
ProctorAI is a real-time AI-based proctoring solution that uses computer vision and audio analysis to detect suspicious activities during exams or assessments.
🔍 Key Features
- Face detection and tracking using
MediapipeandDlib - Eye and pupil movement monitoring for head and gaze tracking
- Audio detection for identifying background conversation
- Multi-screen detection via active window tracking
- Real-time alert overlays on camera feed
- Interactive quit button on the camera feed
⚙️ How It Works
- Webcam feed is captured using
OpenCV - Face and eye landmarks detected using
Mediapipe Dlibtracks pupil movement from eye regions- System checks head movement, gaze, and face presence
- Running applications scanned using
PyGetWindow - Background audio analyzed using
SpeechRecognition - Alerts displayed in real time on suspicious activity
🧠 Tech Stack
OpenCV– Video capture and renderingMediapipe– Face and landmark detectionDlib– Pupil detection and geometrySpeechRecognition– Audio analysisPyGetWindow– Application window trackingThreading– Parallel detection modules
🚨 Alerts Triggered By
- Missing face (student leaves or covers webcam)
- Sudden or excessive head movement
- Unusual pupil movement
- Multiple open windows
- Background voice detection
📦 Installation
git clone https://github.com/anirbanduttaRM/ProctorAI
cd ProctorAI
pip install -r requirements.txt
Download shape_predictor_68_face_landmarks.dat from
dlib.net
and place it in the root directory.
▶️ Running the App
python main.py🖼️ Screenshots
🎥 Demo Video
📌 Future Improvements
- Face recognition for identity verification
- Web-based remote monitoring
- Data logging and analytics
- Improved NLP for audio context
🤝 Contributing
Pull requests are welcome. For major changes, open an issue first.
📄 License
Licensed under the MIT License — see the LICENSE file.
Made with ❤️ by Anirban Dutta