Detection of Deceit Using Speech and Thermal Videos During Interactive Sessions: An Integrated Analysis

This study concentrated on the use of interrogation audio and thermal imaging to identify deception. In the present study, a real-life database has been generated by creating a real crime of stealing scenario. During the interrogation process the thermal video and audio recordings have been carried out simultaneously in a concealed manner. The police department has long used polygraphy as the gold standard for liar detection. In due course, several contemporary techniques for lying or deception detection have emerged that are more accurate and straightforward. One of them is the analysis of thermal video. Thermal footage is recorded during an interrogation and afterwards examined to look for signs of lying. Additionally, it is possible to assess a person's behavior from the audio recording, which might be a crucial hint for uncovering deception. The temperature of the forehead and periorbital areas is extracted to measure the blood flow rate. It was observed that in case of person who is lying, the temperature of these areas increased more than those of truth-tellers. Analysis of the speech of the subjects was also carried out to understand the difference in the pattern of speech attributes of liars and truth-tellers. It was found that liars take more silent pauses and have higher values of the pitch in their voice when they were being interrogated. Finally, we have combined the effect of thermal video and audio analysis for decision making.