MAI Tested a Proctoring System on Pre-Vocational Exams

25 May 2020

From May 18 to 22, the practical part of pre-vocational exams for schoolchildren was held in the online format at Moscow Aviation Institute as part of engineering classes. For the first time, proctoring was tested during the event. It is a system of monitoring and control when passing exams online. The partner of Moscow Aviation Institute is the domestic proctoring service Examus.

This year at Moscow Aviation Institute, the pre-vocational exams are held online in three areas:
  • Programming (Information Technology) - Python programming;
  • Programming (Robotics and Microelectronics) - programming devices based on Arduino;
  • Design (Modeling, prototyping, applied mathematics) - three-dimensional modeling and prototyping in SolidWorks.
“The proctoring system performed well. At the same time, 70 or more people were passing exams. Record was kept, there were no technical failures. Moreover, everything is visible and heard literally every “sneeze” in the system,” says Pyotr Ukhov, Head of the MAI E-Learning Support and Monitoring Department.

256 schoolchildren took part in certification. The exam lasts an hour. Thanks to the system, it takes an average of 5-15 minutes to review one account. The proctoring system gives a certain degree of trust, but you cannot only rely on it - you need a living person who can distinguish a real violation from innocent actions that can be mistaken for it. Automatic algorithms identify the student, analyze his behavior with regard to standards of violation threats for exams, and report the results of the test to the proctor - the person who controls and adjusts the operation of automation.

The system is able to work in several modes. You can immediately connect an observer who will give comments directly online, but it takes a lot of effort. At Moscow Aviation Institute the automatic proctoring was selected when the process is monitored by automation. It fixes violations, and then a specialist looks after it. For example, he sees the remark of the system "the examinee has left the frame." He scrolls the video for this period of time and sees that, in fact, the subject simply tilted his head unsuccessfully, and the system could not recognize his face.

“For us, the most important thing is to track that they do not copy answers from the Internet, do not use search engines and instant messengers in order to get a ready-made answer. But in general, all the tasks are unique, you cannot write it off - we look more so that someone else does not sit down to write the tasks for the student," says Pyotr Ukhov. “Now we are reviewing the latest work - so far we have not found any gross violations.”

Future plans include testing the proctoring system on exams of IT Master's degree students.
PR Department

Ask any question