EECS 255: Advanced Human-Computer Interaction
SPRING 2018 (4 UNITS)
Explores the theory, design procedure, programming practices, and evaluation methods in Human-Computer Interaction (HCI), with a particular focus on input and interaction techniques. Introduces students to recent developments in the area and provides them with the methods to design, develop, and evaluate existing or novel interactive systems.
Lecture | Monday & Wednesday | 4:30pm - 5:45pm | COB2 263 |
Lab | Friday | 7:30pm - 10:30pm | Kolligian Library 208 |
Office Hours | Friday & By Appointment | 5:00pm - 7:00pm | SE2 212 / COB 374-376 |
Textbook
This course does not use textbooks. Students are expected to study recent publications and relevant books form the Suggested Reading in Human-Computer Interaction (HCI). However, the human aspect and research methods parts of this course are heavily based on the following two books.


Course Objectives
Primarily, the course covers the following topics.
- A brief overview of the historical development of major advances in the area.
- Recent developments and challenges in the area, focusing on input and interaction techniques, tangible and embodied user interactions, mobile interactions, augmented and virtual reality, game user interfaces, and/or interaction techniques for special user groups.
- Quantitative research methods, including experimental design, quantifying and modeling human and system factors, digital and physical prototyping, and statistical analysis.
- Research ethics and working with human subjects.
- Reporting research findings in scientific articles.
Course Learning Outcomes
Students participating in this course are expected to achieve the following learning outcomes through lectures, guest lectures, readings, and research projects. The ability to:
- Apply theory to design and develop useful, efficient, and enjoyable interactive systems.
- Evaluate interactive systems using empirical research methods.
- Practice a high standard of professional ethics.
- Report research findings in scientific articles.
Further, course learning outcomes 1 and 2 will require the students to adapt techniques, skills, and research tools to make discoveries, all of which are characteristics of lifelong learners.
Prerequisites
Strong skills in computer and/or Web programming strongly preferred.
Course Policies
Class participation is required. Late submission is not permitted.
-
Lecture. Typically, a lecture consists of the following.
- Weekly Inspiration. Each week a student(s) picks a recent, relevant research project or publication that has inspired him/her and briefly discusses it in the class.
- Lecture. The instructor delivers a lecture on a topic(s) listed in the Topics section.
- Discussion. The class engages in a discussion on the corresponding topic(s). Students must prepare for each lecture ahead of time by studying the corresponding reading material.
- Research Project. All students are required to work on a research project, approved by the instructor, individually. Group projects are acceptable only in special cases. This is to enable students to apply the new techniques and skills they have acquired in class. Each research project involves the design and development of a novel/existing input and interaction technique(s), which are then compared with other techniques in empirical studies. The data collected in the studies are analyzed using statistical tools. Students then report the complete research process and the findings of the studies in scientific articles.
- Lab. Labs are dedicated to research projects. The instructor meets with students to discuss their research progress, and provides them with feedback and guidance. Students may also seek assistance and resolutions to problems they are facing with their projects, including a design or development issue. Some lab sessions are dedicated to specific learning objectives, such as how to use common statistical analysis tools, how to create demonstration videos using popular video editing tools, and feedback on the first draft of students’ research papers.
Assessment & Grading Policy
Participation | 20% | Research Project | 80% |
---|---|---|---|
Active participation | 5% | Design | 20% |
Weekly inspiration | 5% | Development | 20% |
Reading | 5% | Evaluation | 20% |
Lab participation | 5% | Final report | 20% |
Today, we celebrated the completion of a productive academic year at the HCI Group Pizza Party. #HCI @UCMerced #UCMerced pic.twitter.com/h2fQKYNxVR
— HCI UC Merced (@HCI_UCM) May 5, 2018
Topics
-
Jan 17, 2018 - Lecture
- Student Background Form
- Introduction to EECS 255
- Introduction to Human-Computer Interaction (HCI)
-
Jan 19, 2018 - Lab, Mandatory
- Project Assignment
- Lab Rules
-
Jan 22, 2018 - Lecture
- Weekly Inspiration: Ashish Yadav, PaperID by Disney Research
- History of Human-Computer Interaction (HCI)
- Input and Interaction Techniques
-
Jan 24, 2018 - Lecture
- Weekly Inspiration: Azar Alizadeh, Silent Speech Interfaces
- Empirical Research Methods - Part 1
-
Jan 26, 2018 - Lab, Mandatory
- One-page project proposal due on Jan 26, 2018. Four paragraphs: Abstract, Problem/Motivation, Proposed Solution, Research Plan. Instructions on How to Submit Your Documents Using a Web Browser
- Project Supervision
-
Jan 29, 2018 - Lecture
- Weekly Inspiration: Mudit Misra, Reco: A Wearable App That Helps You to Recycle Better / Video
- Empirical Research Methods - Part 2
-
Jan 31, 2018 - Lecture
- Weekly Inspiration: Mudit Misra, Token: One Ring to Access Everything
-
Discussion - Mobile Interaction
- Ken Hinckley, Seongkook Heo, Michel Pahud, Christian Holz, Hrvoje Benko, Abigail Sellen, Richard Banks, Kenton O'Hara, Gavin Smyth, and William Buxton. 2016. Pre-Touch Sensing for Mobile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2869-2881.
- Jacob O. Wobbrock, Brad A. Myers, and Htet Htet Aung. 2008. The Performance of Hand Postures in Front- and Back-of-Device Interaction for Mobile Computing. Int. J. Hum.-Comput. Stud. 66, 12: 857-875.
- Daniel Wigdor, Clifton Forlines, Patrick Baudisch, John Barnwell, and Chia Shen. 2007. Lucid Touch: A See-through Mobile Device. In Proceedings of the 20th annual ACM symposium on User interface software and technology (UIST '07). ACM, New York, NY, USA, 269-278.
- I. Scott MacKenzie and R. William Soukoreff. 2002. Text Entry for Mobile Computing: Models and Methods, Theory and Practice. Human–Computer Interaction 17, 2-3: 147-198.
- Feb 2, 2018 - Lab, Do it yourself
-
Feb 5, 2018 - Lecture
- Weekly Inspiration: Mudit Misra, 3D Menu: New App Navigation Experience Based on Apple's 3D (Force) Touch Technology / Video
-
Research ethics
- Human-Subject Protections: Institutional Review Board (IRB)
-
CITI Program: Collaborative Institutional Training Initiative
- Complete the Social & Behavioral Responsible Conduct of Research Course 1 and upload the completion certificate to your OneDrive folder by Feb 16, 2018. Instructions on How to Submit Your Documents Using a Web Browser
- Experiment Design - Part 1
-
Feb 7, 2018 - Lecture
- Weekly Inspiration: Azar Alizadeh, Multi Calculator
- Experiment Design - Part 2
- Working with Human Subjects
-
Feb 9, 2018 - Lab, Mandatory
- Max. three-page literature review due today, Feb 9, 2018. Instructions on How to Submit Your Documents Using a Web Browser
- Literature Review
- Project Supervision
-
Feb 12, 2018 - Lecture
- Weekly Inspiration: Monwen Shen, Microsoft HoloLens: Mixed Reality Blends Holograms with the Real World / Video
- Experiment Design - Part 3
-
Feb 14, 2018 - Lecture
- Weekly Inspiration: Satvik Kulshreshtha, SixthSense: A Wearable Gestural Interface
- Hypothesis Testing - Part 1: Parametric Tests
- Related Notes
-
Feb 16, 2018 - Lab, Do it yourself
- The Social and Behavioral Responsible Conduct of Research Course 1 certificate is due today, Feb 16, 2018. Instructions on How to Submit Your Documents Using a Web Browser
- Feb 19, 2018 - No class, President's Day Holiday
-
Feb 21, 2018 - Lecture
- Weekly Inspiration: Satvik Kulshreshtha, Samsung SUR40 with Microsoft® PixelSense™
- Weekly Inspiration: Xiumin Shang, Amazon Go and the World's Most Advanced Shopping Technology / Video
- Reporting research findings: Writing a research paper
-
Feb 23, 2018 - Lab, Mandatory
- Study Design and Procedure
-
Feb 26, 2018 - Lecture
- Weekly Inspiration: Yusuke Niiro, Human-Robot Interaction Softbank Pepper / Video / Sony Aibo / Video / Henna-Hotel / Video
- Hypothesis Testing - Part 2: Non-Parametric Tests & Post-Hoc Analysis
-
Feb 28, 2018 - Lecture
- Weekly Inspiration: Azar Alizadeh, Zcan Wireless Scanner Mouse
-
Discussion - Input and Interaction Techniques
- Gordon Kurtenbach and William Buxton. 1994. User Learning and Performance with Marking Menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94), Beth Adelson, Susan Dumais, and Judith Olson (Eds.). ACM, New York, NY, USA, 258-264.
- Paul Dietz and Darren Leigh. 2001. DiamondTouch: A Multi-User Touch Technology. In Proceedings of the 14th annual ACM symposium on User interface software and technology (UIST '01). ACM, New York, NY, USA, 219-226.
- Meredith Ringel Morris, Jacob O. Wobbrock, and Andrew D. Wilson. 2010. Understanding Users' Preferences for Surface Gestures. In Proceedings of Graphics Interface 2010 (GI '10). Canadian Information Processing Society, Toronto, ON, Canada, 261-268.
- Kent Lyons, Thad Starner, Daniel Plaisted, James Fusia, Amanda Lyons, Aaron Drew, and E. W. Looney. 2004. Twiddler Typing: One-Handed Chording Text Entry for Mobile Phones. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, New York, NY, USA, 671-678.
-
Mar 2, 2018 - Lab, Do it yourself
- Complete the Social/Behavioral Research Course and upload the completion certificate to your OneDrive "IRB" folder by Mar 2, 2018. Instructions on How to Submit Your Documents Using a Web Browser
- Mar 5, 2018 - Lecture
-
Mar 7, 2018 - Lecture
- Weekly Inspiration: Gulnar Rakhmetulla, Touchless interactions Soli
- Human Factors - Part 1
-
Mar 9, 2018 - Lab, Mandatory
- Introduction, Related Work, User Study Apparatus, Design, and Procedure in ACM (as assigned) format is due today, Mar 9, 2018. Instructions on How to Submit Your Documents Using a Web Browser
- Project Supervision
- Mar 12, 2018 - Lecture
- Mar 14, 2018 - No class
- Mar 16, 2018 - Lab, Do it yourself
-
Mar 19, 2018 - Lecture
- Weekly Inspiration: Ashish Yadav, Eye Tracking: History and Applications
- Interaction Elements - Part 1
-
Mar 21, 2018 - Lecture
- Weekly Inspiration: Gulnar Rakhmetulla, 3D Printing / Video
-
User Studies for Course Projects
- Study Timeline
- Participant Recruitment
- Study Inventory
- Procedure
- Logging
- Privacy
- Interaction Elements - Part 2
- Mar 23, 2018 - Lab, Do it yourself
- Mar 26 - Mar 29, 2018 - Spring Recess
- Mar 30, 2018 - No lab, Cesar Chavez Holiday
-
Apr 2, 2018 - Lecture
- Weekly Inspiration: Xiumin Shang, Teslasuit for VR / Video
-
Discussion - Augmented and Virtual Reality
- Valentin Schwind, Pascal Knierim, Cagri Tasci, Patrick Franczak, Nico Haas, and Niels Henze. 2017. "These are not my hands!": Effect of Gender on the Perception of Avatar Hands in Virtual Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 1577-1582.
- Samuel B. Schorr and Allison M. Okamura. 2017. Fingertip Tactile Devices for Virtual Object Manipulation and Exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3115-3119.
- Ana Javornik, Yvonne Rogers, Delia Gander, and Ana Moutinho. 2017. MagicFace: Stepping into Character through an Augmented Reality Mirror. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4838-4849.
- Dirk Wenig, Johannes Schöning, Alex Olwal, Mathias Oben, and Rainer Malaka. 2017. WatchThru: Expanding Smartwatch Displays with Mid-air Visuals and Wrist-worn Augmented Reality. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 716-721.
-
Apr 4, 2018 - Lecture
- Weekly Inspiration: Yusuke Niiro, Yoichi Ochiai / Digital Nature Group / Digital Nature Group Exhibition / Fairy Light / Video / Holographic Whisper / Video
-
Discussion - User Interface for Games
- Raine Kajastila, Leo Holsti, and Perttu Hämäläinen. 2016. The Augmented Climbing Wall: High-Exertion Proximity Interaction on a Wall-Sized Interactive Surface. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 758-769.
- Martijn J.L. Kors, Gabriele Ferri, Erik D. van der Spek, Cas Ketel, and Ben A.M. Schouten. 2016. A Breathtaking Journey. On the Design of an Empathy-Arousing Mixed-Reality Game. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '16). ACM, New York, NY, USA, 91-104.
- Janne Paavilainen, Hannu Korhonen, Kati Alha, Jaakko Stenros, Elina Koskinen, and Frans Mayra. 2017. The Pokémon GO Experience: A Location-Based Augmented Reality Mobile Game Goes Mainstream. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 2493-2498.
- Kathrin Maria Gerling, Jonas Schild, and Maic Masuch. 2010. Exergame Design for Elderly Users: The Case Study of SilverBalance. In Proceedings of the 7th International Conference on Advances in Computer Entertainment Technology (ACE '10). ACM, New York, NY, USA, 66-69.
- Apr 6, 2018 - Lab, Mandatory
- Apr 9, 2018 - No class
- Apr 11, 2018 - No class
- Apr 13, 2018 - Lab, Do it yourself
-
Apr 16, 2018 - Lecture
- Weekly Inspiration: Gulnar Rakhmetulla, Cozmo: The AI Robot with Emotions
-
Discussion - Child-Computer Interaction
- Steve Benford, Benjamin B. Bederson, Karl-Petter Åkesson, Victor Bayon, Allison Druin, Pär Hansson, Juan Pablo Hourcade, Rob Ingram, Helen Neale, Claire O'Malley, Kristian T. Simsarian, Danaë Stanton, Yngve Sundblad, and Gustav Taxén. 2000. Designing Storytelling Technologies to Encouraging Collaboration Between Young Children. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems (CHI '00). ACM, New York, NY, USA, 556-563.
- Ahmed Sabbir Arif and Cristina Sylla. 2013. A Comparative Evaluation of Touch and Pen Gestures for Adult and Child Users. In Proceedings of the 12th International Conference on Interaction Design and Children (IDC '13). ACM, New York, NY, USA, 392-395.
- Lesley Xie, Alissa N. Antle, and Nima Motamedi. 2008. Are Tangibles More Fun?: Comparing Children's Enjoyment and Engagement Using Physical, Graphical and Tangible User Interfaces. In Proceedings of the 2nd international conference on Tangible and embedded interaction (TEI '08). ACM, New York, NY, USA, 191-198.
- Janet C. Read and Stuart MacFarlane. 2006. Using the Fun Toolkit and Other Survey Methods to Gather Opinions in Child Computer Interaction. In Proceedings of the 2006 conference on Interaction design and children (IDC '06). ACM, New York, NY, USA, 81-88.
-
Apr 18, 2018 - Lecture
- Weekly Inspiration: Monwen Shen, Brain-Computer Interface — Hands-Free Typing: Facebook's Brain-to-Text Initiative / Video / Virtual Hand Demo
- Weekly Inspiration: Ashish Yadav, Zwift
- Statistical Tests — Demonstration, Part 1
-
Discussion - Accessibility Research
- Shaun K. Kane, Jeffrey P. Bigham, and Jacob O. Wobbrock. 2008. Slide Rule: Making Mobile Touch Screens Accessible to Blind People Using Multi-Touch Interaction Techniques. In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility (Assets '08). ACM, New York, NY, USA, 73-80.
- Jennifer Mankoff, Anind Dey, Udit Batra, and Melody Moore. 2002. Web Accessibility for Low Bandwidth Input. In Proceedings of the 5th international ACM conference on Assistive technologies (Assets '02). ACM, New York, NY, USA, 17-24.
- Caleb Southern, James Clawson, Brian Frey, Gregory Abowd, and Mario Romero. 2012. An Evaluation of BrailleTouch: Mobile Touchscreen Text Entry for the Visually Impaired. In Proceedings of the 14th international conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '12). ACM, New York, NY, USA, 317-326.
- Sushant Kafle and Matt Huenerfauth. 2017. Evaluating the Usability of Automatically Generated Captions for People who are Deaf or Hard of Hearing. In Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17). ACM, New York, NY, USA, 165-174.
-
Apr 20, 2018 - Lab, Mandatory
- Statistical Tests — Demonstration, Part 2 (Hands-On)
- Apr 23, 2018 - No class
- Apr 25, 2018 - No class
- Apr 27, 2018 - Lab, Do it yourself
-
Apr 30, 2018 - Lecture
-
Discussion - Usable Security
- Ahmed Sabbir Arif, Ali Mazalek, and Wolfgang Stuerzlinger. 2014. The Use of Pseudo Pressure in Authenticating Smartphone Users. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (MOBIQUITOUS '14). ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), ICST, Brussels, Belgium, Belgium, 151-160.
- Alina Hang, Alexander De Luca, Emanuel von Zezschwitz, Manuel Demmler, and Heinrich Hussmann. 2015. Locked Your Phone? Buy a New One? From Tales of Fallback Authentication on Smartphones to Actual Concepts. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '15). ACM, New York, NY, USA, 295-305.
- Alexander De Luca, Marian Harbach, Emanuel von Zezschwitz, Max-Emanuel Maurer, Bernhard Ewald Slawik, Heinrich Hussmann, and Matthew Smith. 2014. Now You See Me, Now You Don't: Protecting Smartphone Authentication from Shoulder Surfers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 2937-2946.
- Yomna Abdelrahman, Mohamed Khamis, Stefan Schneegass, and Florian Alt. 2017. Stay Cool! Understanding Thermal Attacks on Mobile-based User Authentication. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 3751-3763.
-
Discussion - Usable Security
-
May 2, 2018 - Lecture
- Weekly Inspiration: Satvik Kulshreshtha, TBD
- Weekly Inspiration: Monwen Shen, TBD
- Reminder: Course evaluation system closes on May 4, 2018
- Reflect on the Course
- Collect Feedback
-
May 4, 2018 - Lab, Mandatory
- Project discussion
- The inaugural HCI Group Pizza Party: We will meet in SE2 224 at 7:30pm to celebrate a successful completion of the course. There will be pizzas (pepperoni, beef, chicken, and vegetarian/vegan), soda (Coke, Diet Coke, and Fanta), and water.
- May 11, 2018 - Lab, Final report/paper due today, May 11, 2018. Instructions on How to Submit Your Documents Using a Web Browser