Research Projects


I am a Smartwatch and I can Track my User’s Arm
University of Illinois at Urbana-Champaign

In this project, we explore the possibility of tracking the entire arm posture using only the IMU sensors on a smartwatch. We design ArmTrak, which fuses the data from IMU sensors and observations from human kinematics into a hidden Markov model to continuously estimate the 3D arm posture. We hope with some additional work, ArmTrak become a useful underlay to various practical applications.

Paper in ACM MobiSys 2016.

Matching Physical Sites with Web Sites for Semantic Localization
University of Illinois at Urbana-Champaign

In this project, we explore an opportunity for automatic semantic localization – the presence of a website corresponding to each physical store. We propose to correlate the information seen in a physical store with that found in websites of the stores around that location, to recognize that store. Specifically, we assume a repository of crowdsourced WiFi-tagged pictures from different stores. By correlating words inside the pictures, against words extracted from store websites, our proposed system can automatically label clusters of pictures, and the corresponding WiFi APs, with the store name. Later, when a user enters a store, her smartphone can scan the WiFi APs and consult a lookup table to recognize the store she is in.

Paper in WPA 2015.

Building Indoor 3D Map with Phones
Microsoft Research Asia

This project aimed at constructing the 3D map inside indoor environments by use of mobile phones. We utilized our accurate indoor localization techniques to boost depth point matching and multiple images based 3D reconstruction. Moreover, we achieved localization-based real-time rendering on Windows Phone devices.

Demo at Microsoft Techfest 2014.

ImDevice - Integrated Mobile Device
Microsoft Research Asia

This project aimed at integrating devices using virtualization technology, i.e., making phone and computer work together to extend capabilities and create rich scenarios using Virtual Device Driver technology. We developed several virtual drivers that seamlessly extended computer’s features using sensors on mobile devices such as GPS (Bing Map), accelerometer (Gaming), touchscreen (PowerPoint), etc. I developed a virtual display driver and incorporated a touch driver in order to turn mobile devices, such as a tablet, into an extra touchscreen of PC.

Demo at Microsoft Techfest 2014.

Indoor Localization Using Wi-Fi Signals
Microsoft Research Asia

GPS works well for localization in an outdoor environment, but the signal is too weak to penetrate roofs and walls, making it useless for indoor localization. Therefore, we proposed a WiFi-based positioning system to localize a mobile user inside indoor environments. Our localization technique was based on measuring the received signal strength (RSS), and we boosted localization accuracy by deriving and applying models that were adapted to local environmental properties. I was also designing semi-supervised learning algorithms that leverage both unlabeled data and user feedbacks to reduce training effort. We had achieved average distance error less that 3m in our building.

Research on Elastic Optical Networks
University of Science and Technology of China

I applied for an internship at Optical Network Lab in our university, where we mainly studied service provisioning in OFDM-based optical networks. In the project I analyzed routing, modulation and spectrum assignment under the advanced reservation traffic model, where requests specify their start and holding time in advance (such as video conferencing and grid applications), and proposed several efficient heuristics and theoretical analysis for the problem. Some of my results were accepted for ECOC 2013, in which I developed solutions for dynamic advanced reservation multicast by considering routing and spectrum assignment jointly to reduce blocking rate.

Paper in ECOC 2013.

Sheng Shen: ECE@UIUC