TapSnoop: Leveraging Tap Sounds to Infer Tapstrokes on Touchscreen Devices

Citations

WEB OF SCIENCE

7
Citations

SCOPUS

10

초록

We propose a novel tapstroke inference attack method, called TapSnoop, that precisely recovers what user types on touchscreen devices. Inferring tapstrokes is challenging owing to 1) low tapstroke intensity and 2) dynamically-changing noise. We address these challenges by revealing the unique characteristics of tapstrokes from audio recordings exploited by TapSnoop as a side channel of tapstrokes. In particular, we develop tapstroke detection and localization algorithms that collectively leverage audio features obtained from multiple microphones, which are designed to reflect the core properties of tapstrokes. Furthermore, we improve its robustness against environmental changes, by developing environment-adaptive classification and noise subtraction algorithms. Extensive experiments with ten real-world users on both number and QWERTY keyboards show that TapSnoop can achieve an inference accuracy of 85.4% and 75.6% (96.2% and 90.8% in best case scenarios) in stable environments, respectively. TapSnoop can also achieve a reasonable accuracy even with varying noise. For example, it shows an inference accuracy of 84.8% and 72.7% in a numeric keyboard when the noise level is varied from 37.9 to 51.2 dBA and 46.7 to 60.0 dBA, respectively. © 2013 IEEE.

키워드

acoustic sensors; Acoustic signal processing; mobile computing; privacy; side-channel attack; tapstroke inference; Acoustic noise; Acoustic signal processing; Data privacy; Mobile computing; Signal processing; Acoustic Sensors; Adaptive classification; Detection and localization; Environmental change; Inference attacks; Multiple microphones; Reasonable accuracy; tapstroke inference; Side channel attack
제목
TapSnoop: Leveraging Tap Sounds to Infer Tapstrokes on Touchscreen Devices
저자
Kim H.; Joe B.; Liu Y.
DOI
10.1109/ACCESS.2020.2966263
발행일
2020-01
유형
Article
저널명
IEEE Access
권
8
페이지
14737 ~ 14748