StorytellingSerious

International Journal of Human Computer Interaction and Data Mining ·

Temporal Attention-Based Multimodal Networks for Real-Time Proctoring of Online Examinations

BHVSP Subrahmanyam, Krishnakant Sharma, Shivam Saraswat, Satyam Pandey

Published · Journal · Computer vision

The study combines gaze, head pose, and facial cues to analyze online exam recordings.

Abstract

The growth of online education has driven the need for technologies that uphold academic integrity in remote online assessments. While traditional online proctoring methods may not be the most resource-efficient. This paper presents a multi-modal neural network based online proctoring that works on webcam recordings to detect suspicious device usage, This Neural Network has been trained on a dataset with 18 subjects, the videos have been annotated cheating & non-cheating labels manually, and various components have been extracted such as Head pose via 6DRepNet, Eye gaze using L2CS-Net, Facial landmarks using Media pipe library and cropped faces using the latest YOLO-v11, Subject Embeddings have been generated using ResNet50 to reduce the computational complexity along with using techniques like PCA. Our Multi Modal Neural Network achieves an overall accuracy of 85.74% with the late-fusion accuracy of our overall system components being 94%.

Abstract from ICETESS 2025 conference abstract · proceedings, page 46.

Findings

  • The conference abstract reports 85.74% neural-network accuracy and 94% late-fusion accuracy on its 18-subject dataset.
  • These figures describe the conference abstract; they do not establish performance beyond that evaluation.

Sources and citation

View BibTeX citation
@article{temporal-proctoring-2025,
  title = {{Temporal Attention-Based Multimodal Networks for Real-Time Proctoring of Online Examinations}},
  author = {BHVSP Subrahmanyam and Krishnakant Sharma and Shivam Saraswat and Satyam Pandey},
  journal = {International Journal of Human Computer Interaction and Data Mining},
  year = {2025},
  volume = {9},
  number = {1},
  pages = {1--4},
  publisher = {ADR Journals House},
  url = {https://scholar.google.com/citations?view_op=view_citation&hl=en&user=_kzC6EsAAAAJ&citation_for_view=_kzC6EsAAAAJ:d1gkVwhDpl0C}
}

What are you in the mood for?