Electric Network Frequency Optical Sensing Devices (2311.13954v1)
Abstract: Electric Network Frequency (ENF) acts as a fingerprint in multimedia forensics applications. In indoor environments, ENF variations affect the intensity of light sources connected to power mains. Accordingly, the light intensity variations captured by sensing devices can be exploited to estimate the ENF. A first optical sensing device based on a photodiode is developed for capturing ENF variations in indoor lighting environments. In addition, a device that captures the ENF directly from power mains is implemented. This device serves as a ground truth ENF collector. Video recordings captured by a camera are also employed to estimate the ENF. The camera serves as a second optical sensor. The factors affecting the ENF estimation are thoroughly studied. The maximum correlation coefficient between the ENF estimated by the two optical sensors and that estimated directly from power mains is used to measure the estimation accuracy. The paper's major contribution is in the disclosure of extensive experimental evidence on ENF estimation in scenes ranging from static ones capturing a white wall to non-static ones, including human activity.
- C. Grigoras, “Digital audio recording analysis: The electric network frequency (ENF) criterion,” Int. J. of Speech Language & the Law, vol. 12, no. 1, pp. 63–76, 2005.
- A. Hajj-Ahmad, A. Berkovich, and M. Wu, “Exploiting power signatures for camera forensics,” IEEE Signal Process. Letters, vol. 23, no. 5, pp. 713–717, 2016.
- S. Vatansever, A. E. Dirik, and N. Memon, “Detecting the presence of ENF signal in digital videos: A superpixel-based approach,” IEEE Signal Process. Letters, vol. 24, no. 10, pp. 1463–1467, 2017.
- D. Nagothu, Y. Chen, E. Blasch, A. Aved, and S. Zhu, “Detecting malicious false frame injection attacks on surveillance systems at the edge using electrical network frequency signals,” Sensors, vol. 19, no. 11, p. 2424, 2019.
- G. Karantaidis and C. Kotropoulos, “An automated approach for electric network frequency estimation in static and non-static digital video recordings,” Journal of Imaging, vol. 7, no. 10, 2021.
- C. Grigoras, “Applications of ENF criterion in forensic audio, video, computer and telecommunication analysis,” Forensic Sci. Int., vol. 167, no. 2-3, pp. 136–145, 2007.
- D. P. Nicolalde and J. A. Apolinario, “Evaluating digital audio authenticity with spectral distances and ENF phase change,” in Proc. IEEE Int. Conf. Acoustics, Speech and Signal Process., 2009, pp. 1417–1420.
- M. Huijbregtse and Z. Geradts, “Using the ENF criterion for determining the time of recording of short digital audio recordings,” in Proc. Int. Work. Computational Forensics, The Hague, The Netherlands), 2009, pp. 116–124.
- O. Ojowu, J. Karlsson, J. Li, and Y. Liu, “ENF extraction from digital recordings using adaptive techniques and frequency tracking,” IEEE Trans. Inf. Forensics and Security, vol. 7, no. 4, pp. 1330–1338, 2012.
- D. Bykhovsky and A. Cohen, “Electrical network frequency (ENF) maximum-likelihood estimation via a multitone harmonic model,” IEEE Trans. Inf. Forensics and Security, vol. 8, no. 5, pp. 774–753, 2013.
- A. Hajj-Ahmad, R. Garg, and M. Wu, “Spectrum combining for ENF signal estimation,” IEEE Signal Process. Letters, vol. 20, no. 9, pp. 885–888, 2013.
- G. Hua, Y. Zhang, J. Goh, and V. L. L. Thing, “Audio authentication by exploring the absolute-error-map of ENF signals,” IEEE Trans. Inf. Forensics and Security, vol. 11, no. 5, pp. 1003–1016, 2016.
- A. Skodras, A. Triantafyllopoulos, I. Krilis, and A. Foliadis, “A Hilbert-based approach to the ENF extraction problem,” IEICE Proc. Series, vol. 24, no. A3-3, 2016.
- A. Hajj-Ahmad, C. Wong, S. Gambino, Q. Zhu, M. Yu, and M. Wu, “Factors affecting ENF capture in audio,” IEEE Trans. Inf. Forensics and Security, vol. 14, no. 2, pp. 277–288, 2019.
- G. Karantaidis and C. Kotropoulos, “Blackman–Tukey spectral estimation and electric network frequency matching from power mains and speech recordings,” IET Signal Process., vol. 15, no. 6, pp. 396–409, 2021.
- R. Garg, A. L. Varna, A. Hajj-Ahmad, and M. Wu, ““seeing” ENF: Power-signature-based timestamp for digital multimedia via optical sensing and signal processing,” IEEE Trans. Inf. Forensics and Security, vol. 8, no. 9, pp. 1417–1432, 2013.
- S. Vatansever, A. E. Dirik, and N. Memon, “Analysis of rolling shutter effect on ENF-based video forensics,” IEEE Trans. Inf. Forensics and Security, vol. 14, no. 9, pp. 2262–2275, 2019.
- P. Ferrara, I. Sanchez, G. Draper-Gil, H. Junklewitz, and L. Beslay, “A MUSIC spectrum combining approach for ENF-based video timestamping,” in 2021 IEEE Int. Work. Biometrics and Forensics. IEEE, 2021, pp. 1–6.
- H. Su, A. Hajj-Ahmad, R. Garg, and M. Wu, “Exploiting rolling shutter for ENF signal extraction from video,” in Proc. IEEE Int. Conf. Image Process., 2014, pp. 5367–5371.
- A. Hajj-Ahmad, S. Baudry, B. Chupeau, and G. Doërr, “Flicker forensics for pirate device identification,” in Proc. 3rd ACM Work. Inf. Hiding and Multimedia Security, 2015, pp. 75–84.
- J. B. Allen and L. R. Rabiner, “A unified approach to short-time Fourier analysis and synthesis,” Proc. of the IEEE, vol. 65, no. 11, pp. 1558–1564, 1977.
- W. Hernandez, “Input-output transfer function analysis of a photometer circuit based on an operational amplifier,” Sensors, vol. 8, no. 1, pp. 35–50, 2008.
- A. Triantafyllopoulos et al., “Exploring power signatures for location forensics of media recordings,” IEEE Signal Processing Cup 2016, Tech. Rep., 2016.
- C. Moysiadis, “ENF Sensing Device,” accessed on October 10, 2023. [Online]. Available: https://github.com/chrismoi/ENF-Sensing-Device
- C. Moysiadis, G. Karantaidis, and C. Kotropoulos, “Video, Ground truth, and code,” accessed on October 10, 2023. [Online]. Available: https://github.com/chrismoi/Electric-Network-Frequency-Optical-Sensing-Devices