Journal of Innovative Image Processing is accepted for inclusion in Scopus. click here
Home / Archives / Volume-7 / Issue-4 / Article-16
Multimodal Lie Detection Using Linguistic and Visual Cues: A Fusion of NLP and Facial Micro-Feature Analysis
Twisha Patel ,  Daxa Vekariya
Open Access
Volume - 7 • Issue - 4 • december 2025
1374-1397  460 pdf-white-icon PDF
Abstract

The research integrates Natural Language Processing (NLP) and facial micro-expressions recognition methods for analyzing deceptive behavior. Lie behavior analysis is enhanced by the incorporation of both verbal and non-verbal communication in the assessment as subtle non-verbal cues are hard to detect during scrutiny. Different machine learning algorithms were evaluated based on their ability to detect lies in this study. Several classic models like Nearest Neighbors, Linear SVM, Decision Tree, Random Forest and Extra Trees Classifier were tested using the Real-Life Deception Detection and Own Dataset student viva scenario data. Various accuracies were generated by different traditional ML models until researchers developed a lightweight Convolutional Neural Network (CNN) model designed to efficiently detect deception. The lite-CNN model achieved a successful 96% accuracy in both tests on the dataset. The lite-CNN model identifies deceptions through its high performance by combining verbal speech and facial behavioral patterns. It has been found that deception detection is successful when using NLP with facial expressions providing reasonable solutions in the fields of security, psychology, and human-computer interaction. The proposed lightweight CNN model is a proven solution compared to traditional models, as it is effective yet consumes fewer computing resources.

Cite this article
Patel, Twisha, and Daxa Vekariya. "Multimodal Lie Detection Using Linguistic and Visual Cues: A Fusion of NLP and Facial Micro-Feature Analysis." Journal of Innovative Image Processing 7, no. 4 (2025): 1374-1397. doi: 10.36548/jiip.2025.4.016
Copy Citation
Patel, T., & Vekariya, D. (2025). Multimodal Lie Detection Using Linguistic and Visual Cues: A Fusion of NLP and Facial Micro-Feature Analysis. Journal of Innovative Image Processing, 7(4), 1374-1397. https://doi.org/10.36548/jiip.2025.4.016
Copy Citation
Patel, Twisha, et al. "Multimodal Lie Detection Using Linguistic and Visual Cues: A Fusion of NLP and Facial Micro-Feature Analysis." Journal of Innovative Image Processing, vol. 7, no. 4, 2025, pp. 1374-1397. DOI: 10.36548/jiip.2025.4.016.
Copy Citation
Patel T, Vekariya D. Multimodal Lie Detection Using Linguistic and Visual Cues: A Fusion of NLP and Facial Micro-Feature Analysis. Journal of Innovative Image Processing. 2025;7(4):1374-1397. doi: 10.36548/jiip.2025.4.016
Copy Citation
T. Patel, and D. Vekariya, "Multimodal Lie Detection Using Linguistic and Visual Cues: A Fusion of NLP and Facial Micro-Feature Analysis," Journal of Innovative Image Processing, vol. 7, no. 4, pp. 1374-1397, Dec. 2025, doi: 10.36548/jiip.2025.4.016.
Copy Citation
Patel, T. and Vekariya, D. (2025) 'Multimodal Lie Detection Using Linguistic and Visual Cues: A Fusion of NLP and Facial Micro-Feature Analysis', Journal of Innovative Image Processing, vol. 7, no. 4, pp. 1374-1397. Available at: https://doi.org/10.36548/jiip.2025.4.016.
Copy Citation
@article{patel2025,
  author    = {Twisha Patel and Daxa Vekariya},
  title     = {{Multimodal Lie Detection Using Linguistic and Visual Cues: A Fusion of NLP and Facial Micro-Feature Analysis}},
  journal   = {Journal of Innovative Image Processing},
  volume    = {7},
  number    = {4},
  pages     = {1374-1397},
  year      = {2025},
  publisher = {Inventive Research Organization},
  doi       = {10.36548/jiip.2025.4.016},
  url       = {https://doi.org/10.36548/jiip.2025.4.016}
}
Copy Citation
Keywords
Lie Detection Natural Language Processing Facial Micro-Features Machine Learning Convolutional Neural Network
Published
25 November, 2025
×
Article Processing Charges

Journal of Innovative Image Processing (jiip) is an open access journal. When a paper is accepted for publication, authors are required to pay Article Processing Charges (APCs) to cover its editorial and production costs. The APC for each submission is 400 USD. There are no additional charges based on color, length, figures, or other elements.

Category Fee
Article Access Charge 30 USD
Article Processing Charge 400 USD
Annual Subscription Fee 200 USD
Payment Gateway
Paypal: click here
Townscript: click here
Razorpay: click here
After payment,
please send an email to irojournals.contact@gmail.com / journals@iroglobal.com requesting article access.
Subscription form: click here