Abstract:

The number of everyday smart devices (such as smart TV, Samsung SmartThings, Nest, Google Home, etc.) is projected to grow to the billions in the coming decade. The Cyber-Physical Systems or Internet of Things systems that consist of these devices are used to obtain human information for various smart building applications. Different sensing approaches have been explored, including vision-, sound-, RF-, mobile-, and load-based methods. The general problems faced by these existing technologies are their sensing requirements (e.g., line-of- sight, high deployment density, carrying a device) and intrusiveness (e.g., privacy concerns).

In this talk, I will introduce my research on non-intrusive indoor human information acquisition through ambient structural vibration, which I call ’structures as sensors’. People’s interaction with structures in the ambient environment (e.g., floor, table, door) induces those structures to vibrate. By capturing and analyzing the vibration response of structures, we can indirectly infer information about the people causing it. However, challenges remain. Due to the complexity of the physical world (both structures and people), sensing data distributions can change significantly under different sensing conditions. Therefore, accurate information learning through a data-driven approach requires a large amount of labeled data, which is costly and difficult if not impossible to obtain in sensing applications. My research addresses these challenges by utilizing physical insights to guide the sensing process. Specifically, my system can robustly learn human information from limited labeled data distributions by iteratively expanding the labeled dataset. With insights into the relationship between changes of sensing data distributions and measurable physical attributes, the expansion order is guided by measured physical attributes to ensure a high learning accuracy in each iteration. 

Bio:

Shijia Pan received her Bachelor's degree in Computer Science and Technology from University of Science and Technology of China and will receive a Ph.D. degree in Electrical and Computer Engineering at Carnegie Mellon University in 2018. Her research interests include cyber-physical systems, Internet-of- Things (IoT), and ubiquitous computing. She worked in multiple disciplines and focused on indoor human sensing through ambient structural vibrations. She has published in both top-tier Computer Science ACM/IEEE conferences (IPSN, UbiComp) and high-impact Civil Engineering journals (Journal of Sound and Vibration, Frontiers Built Environment). She is the recipient of numerous awards and fellowships, including Nick G. Vlahakis Graduate Fellowship, Google Anita Borg Scholarship, Best Poster Awards (SenSys, IPSN), Best Demo Award (Ubicomp), Best Presentation Award (SenSys Doctoral Colloquium), and Audience Choice Award (BuildSys) from ACM/IEEE conferences.

Watch the seminar on our YouTube channel: https://youtu.be/1nAKUuvzUFc