RICELab Rethinking Interaction Collaboration and Engagement

Although the computing power in mobile devices now far exceeds that which sent man to the moon, the ways in which we interact with these devices is limited by their physical form factor. For instance, before touch screens became cheap and widespread, we were limited to a 12-digit entry on most phones. Today, many of our smallest devices (e.g. a FitBit or a worn sensor) lack meaningful screens for output and/or do not have a meaningful way to input information or data. In this project, we explore how we can extend the input and output capabilities of mobile devices by: leveraging on-board sensor capabilities in novel ways [Seyed, T., Rodrigues, F., Maurer, F., and Tang, A. (2014). Exploring 3D volumetric medical data using mobile devices. In 3DUI 2014: 2014 IEEE Symposium on 3D User Interfaces, 173--174.] [Chen, X., Marquardt, N., Tang, A., Boring, S., and Greenberg, S. (2012). Extending a mobile device's interaction space through body-centric interaction. In MobileHCI '12: Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services, 151--160.] [Boring, S., Ledo, D., Chen, X., Marquardt, N., Tang, A., and Greenberg, S. (2012). The Fat Thumb: Using the Thumb's Contact Size for Single-handed Mobile Interaction. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services Companion, 207--208.] [Boring, S., Ledo, D., Chen, X., Marquardt, N., Tang, A., and Greenberg, S. (2012). The Fat Thumb: Using the Thumb's Contact Size for Single-handed Mobile Interaction. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services, 39--48.] , augmenting the output capabilities with in-world projection [Weigel, M., Boring, S., Steimle, J., Marquardt, N., Greenberg, S., and Tang, A. (2013). ProjectorKit: easing rapid prototyping of interactive applications for mobile projectors. In MobileHCI '13: Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services, 247--250.] [Weigel, M., Boring, S., Marquardt, N., Steimle, J., Greenberg, S., and Tang, A. (2013). From Focus to Context and Back: Combining Mobile Projectors and Stationary Displays. In GRAND 2013: RNote Proceedings of the GRAND NCE 2013 Meeting.] , or by reconsidering how information is tagged in the world [Miyaoku, K., Tang, A., and Fels, S. (2007). C-band: a flexible ring tag system for camera-based user interface. In ICVR'07: Proceedings of the 2nd international conference on Virtual reality, 320--328.] [Miyaoku, K., Tang, A., and Fels, S. (2007). C-Band: A Ring Tag System Using A Color Pattern Code. In Information Processing Society of Japan Journal, 1361--1371.] . For instance, in the FatThumb work [Boring, S., Ledo, D., Chen, X., Marquardt, N., Tang, A., and Greenberg, S. (2012). The Fat Thumb: Using the Thumb's Contact Size for Single-handed Mobile Interaction. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services Companion, 207--208.] [Boring, S., Ledo, D., Chen, X., Marquardt, N., Tang, A., and Greenberg, S. (2012). The Fat Thumb: Using the Thumb's Contact Size for Single-handed Mobile Interaction. In Proceedings of the 14th International Conference on Human-computer Interaction with Mobile Devices and Services, 39--48.] , touch screen devices make use of contact size (e.g. using the tip of your thumb vs. your whole thumb) to reinterpret input.

Publications