Pebbles PC
SlideShowCmd
RemoteCmd
RemoteClipBook
WebAssist
PebblesChat
Scribble
Switcher
MultiCursor
ShortCutter
ButtonScrl
RateScrl
SlideScrl

Announcing the release of Version 5.0 of the Pebbles software.
See the change log for the new features!
Go to the download page to get it.


The Pebbles project is exploring how

handheld devices, such as Personal Digital Assistants (PDAs) including devices running PalmOS or Pocket PCs, and mobile phones, can be used when they are communicating with a "regular" personal computer (PC), with other handhelds, and with computerized devices such as telephones, radios, microwave ovens, automobiles, and factory equipment.

 


Project Summary

With the coming wireless technologies, such as BlueTooth and IEEE 802.11, connecting hand-held computers and conventional computers together will no longer be an occasional event for synchronization. Instead, the devices will frequently be in close, interactive communication. Many environments, such as offices, meeting rooms and classrooms, already contain computers, and the smart homes of the future will have ubiquitous embedded computation. When the user enters one of these environments carrying a hand-held or wearable computer, how will that computer interact with the environment? The Pebbles project is exploring the many ways that small handheld Personal Digital Assistants (PDAs) such as 3Com Palm Pilots or Windows CE devices can serve as a useful adjunct to the "fixed" computers in those situations. One set of applications supports meetings where the participants are co-located. All participants' PDAs are in continuous two-way communication with each other, and with the main computer which is often projected on a screen to serve as the focal point of the discussion. For classrooms, we are investigating how the student's hand-helds can enhance testing and notetaking when they are connected to the instructor's PC. Another set of applications supports a single user using the PDA as an extra input and output device. In the future, we will also explore the use of the PDA as a customizable, intelligent front end to other applications and devices.

Funding

  • Partially funded by a grant from NSF.
    2003-2006. "Using Handhelds to Help People with Motor Impairments."
    This research is funded in part by the National Science Foundation under Grant No. UA-0308065. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect those of the National Science Foundation. 
  • Partially funded by a grant from NSF.
    2001-2004. "Making it Easier to Interact with Technology Through Handheld Personal Universal Controllers."
    This research is funded in part by the National Science Foundation under Grant No. IIS-0117658.  Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect those of the National Science Foundation.
  • Partially funded by grants from MICROSOFT.
    This research is also partially funded by five generous grants from Microsoft (in 1998, 1999, 2000, 2001 and 2002), sponsored by Microsoft Research, and by the Windows CE development group.
  • Partially funded by two  grants from General Motors, as part of the CMU General Motors Collaborative Laboratory, for Summer, 2002, and calendar year 2003.
  • Partially funded by a grant from NEC Foundation of America. "Handhelds as Assistive Technologies for People with Muscular Disabilities." 2003.  See the NEC Foundation page for this project.
Former Funding Grants:
  • Partially funded by a grant from DARPA.
    1998-2002. This research was performed in part in connection with Contract number DAAD17-99-C-0061 with the U.S. Army Research Laboratory. The views and conclusions contained in this document are those of the authors and should not be interpreted as presenting the official policies or position, either expressed or implied, of the U.S. Army Research Laboratory or the U.S. Government unless so designated by other authorized documents. Citation of manufacturer's or trade names does not constitute an official endorsement or approval of the use thereof. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation hereon.
  • Partially funded by a grant from the Pittsburgh Digital Greenhouse.
    2000-2002.  This grant, in collaboration with Maya Design focused on the "Personal Universal Controller".
Equipment Grants:

We welcome funding from other sources. Please contact Brad Myers for more information.

Papers and Talks about Pebbles

    The first  one is the best current reference to use for Pebbles:

  1. Brad A. Myers. "Using Hand-Held Devices and PCs Together," Communications of the ACM. Volume 44, Issue 11. November, 2001. pp. 34 - 41. Adobe Acrobat (pdf)
  2. Talks and Videos:

  3. "Mobile Devices for Control", talk given as part of: CS547: Stanford University Human-Computer Interaction Seminar on People, Computers, and Design, November 22, 2002, Palo Alto, CA. Available as streaming video (86min)  (warning: streaming video link crashes Netscape 4.7!)
  4. "Using Handheld Computers and PCs Together" (an overview of the Pebbles project). 90 minute talk given to the HCI Seminar Series, Carnegie Mellon University, 11-17-1999. Click here to see a video of this talk
    These are in forward chronological order
  5. Brad A. Myers, Herb Stiel, and Robert Gargiulo. "Collaboration Using Multiple PDAs Connected to a PC." Proceedings CSCW'98: ACM Conference on Computer-Supported Cooperative Work, November 14-18, 1998, Seattle, WA. pp. 285-294.
    Postscript (about 4.4 megabytes) or Adobe Acrobat (pdf) (about 400K)
  6. Brad A. Myers. An Implementation Architecture to Support Single-Display Groupware. Carnegie Mellon University School of Computer Science Technical Report, no. CMU-CS-99-139 and Human Computer Interaction Institute Technical Report CMU-HCII-99-101. May, 1999. Available in postscript or pdf formats.
  7. Robert C. Miller and Brad A. Myers, "Synchronizing Clipboards of Multiple Computers," CHI Letters: ACM Symposium on User Interface Software and Technology, UIST'99, vol. 1, no. 1. November 7-10, 1999. Asheville, NC. pp. 65-66.
  8. Brad Myers, Kin Pou Lie and Bo-Chieh ("Jerry") Yang, "Two-Handed Input Using a PDA and a Mouse", Proceedings CHI'2000: Human Factors in Computing Systems. April 1-6, 2000. The Hague, The Netherlands. pp. 41-48. Postscript or Acrobat (pdf).
  9. Karen Cross and Adrienne Warmack. "Contextual Inquiry: Quantification and Use in Videotaped Analysis". (Student Poster) Adjunct Proceedings CHI'2000: Human Factors in Computing Systems. April 1-6, 2000. The Hague, The Netherlands. pp. 317-318. pdf (Acrobat).
  10. Brad Myers, "The Pebbles Project: Using PCs and Hand-held Computers Together; Demonstration Extended Abstract." Adjunct Proceedings CHI'2000: Human Factors in Computing Systems. April 1-6, 2000. The Hague, The Netherlands. pp. 14-15.
  11. Franklin Chen, Brad Myers and David Yaron, Using Handheld Devices for Tests in Classes. Carnegie Mellon University School of Computer Science Technical Report, no. CMU-CS-00-152 and Human Computer Interaction Institute Technical Report CMU-HCII-00-101. July, 2000. pdf or postscript
  12. Brad A. Myers, Robert C. Miller, Benjamin Bostwick, and Carl Evankovich, "Extending the Windows Desktop Interface With Connected Handheld Computers," 4th USENIX Windows Systems Symposium, August 3-4, 2000, Seattle, WA. pp. 79-88. postscript or Adobe Acrobat (pdf).
  13. Brad A. Myers. "Collaboration Using Multiple PDAs Connected to a PC," Workshop on Shared Environments to Support Face-to-Face Collaboration at CSCW'2000, Philadelphia, PA. html
  14. Brad A. Myers. "Using Multiple Devices Simultaneously for Display and Control." IEEE Personal Communications special issue on "Networking the Physical World." vol. 7, no. 5, Oct. 2000. pp. 62-65.
  15. Brad A. Myers, Jeff Nichols, Rob Miller. "User Interfaces that Span Hand-Held and Fixed Devices" Workshop on Distributed and Disappearing User Interfaces in Ubiquitous Computing at CHI'2001, Seattle, WA. Albrecht Schmidt, Peter Ljundgstrand, and Anind Dey, editors. University of Karlsruhe Faculty of Information Technical Report 2001-6. ISSN 1432-7864. html
  16. Jeffrey Nichols, Brad A. Myers, Rob Miller. "Personal Interfaces in Ubiquitous Environments". Workshop on Building the Ubiquitous Computing User Experience at CHI'2001, Seattle, WA. html
  17. Choon Hong Peck, "Useful Parameters for the Design of Laser Pointer Interaction Techniques." ACM CHI'2001 Student Posters. Seattle, WA. March 31-April 5, 2001. pp. 461-462. Adobe Acrobat (pdf)
  18. Jeffrey W. Nichols. "Using Handhelds as Controls for Everyday Appliances: A Paper Prototype Study." ACM CHI'2001 Student Posters. Seattle, WA. March 31-April 5, 2001. pp. 443-444. Adobe Acrobat (pdf)
  19. Brad A. Myers, Choon Hong Peck, Jeffrey Nichols, Dave Kong, and Robert Miller, "Interacting At a Distance Using Semantic Snarfing," ACM UbiComp'2001, Sept 30 - Oct 2, 2001, Atlanta, Georgia. pp. 305-314. Adobe Acrobat (pdf)
  20. Brad A. Myers and Jeffrey Nichols, "Communication Ubiquity Enables Ubiquitous Control." 'Boaster' for Human-Computer Interaction Consortium (HCIC'2002). Winter Park, CO, Feb, 2002.  html
  21. Brad A. Myers, Rishi Bhatnagar, Jeffrey Nichols, Choon Hong Peck, Dave Kong, Robert Miller, and A. Chris Long. "Interacting At a Distance: Measuring the Performance of Laser Pointers and Other Devices." Proceedings CHI'2002: Human Factors in Computing Systems. Minneapolis, Minnesota, April 20-25, 2002. pp. 33-40. Adobe Acrobat (pdf)
  22. Jeffrey Nichols. "Informing Automatic Generation of Remote Control Interfaces with Human Designs" CHI'2002 Student Posters. Minneapolis, Minnesota, April 20-25, 2002. pp. 864-865. Adobe Acrobat (pdf)
  23. Brad A. Myers, Jacob O. Wobbrock, Sunny Yang, Brian Yeung, Jeffrey Nichols, and Robert Miller. "Using Handhelds to Help People with Motor Impairments," Fifth International ACM SIGCAPH Conference on Assistive Technologies; ASSETS 2002. July 8-10, 2002. Edinburgh, Scotland. pp. 89-96. Adobe Acrobat (pdf) or html
  24. Brad A. Myers. "Mobile Devices for Control," The Fourth Symposium on Human-Computer Interaction for Mobile Devices, Mobile HCI'02. (Keynote speech), September 18-20, 2002, Pisa, Italy. pp. 1-8. pdf
  25. Jeffrey Nichols, Brad Myers, Thomas K. Harris, Roni Rosenfeld, Stefanie Shriver, Michael Higgins, Joseph Hughes. "Requirements for Automatically Generating Multi-Modal Interfaces for Complex Appliances," IEEE Fourth International Conference on Multimodal Interfaces, ICMI'02. Pittsburgh, PA. October 14-16, 2002. pp. 377-382. pdf
  26. Brad Myers, Robert Malkin, Michael Bett, Alex Waibel, Ben Bostwick, Robert C. Miller, Jie Yang, Matthias Denecke, Edgar Seemann, Jie Zhu, Choon Hong Peck, Dave Kong, Jeffrey Nichols, Bill Scherlis. "Flexi-modal and Multi-Machine User Interfaces," IEEE Fourth International Conference on Multimodal Interfaces, ICMI'02, Pittsburgh, PA. October 14-16, 2002. pp. 343-348. pdf
  27. Jeffrey Nichols, Brad A. Myers, Michael Higgins, Joe Hughes, Thomas K. Harris, Roni Rosenfeld, Mathilde Pignol. "Generating Remote Control Interfaces for Complex Appliances." CHI Letters: ACM Symposium on User Interface Software and Technology, UIST'02, 27-30 Oct. 2002, Paris, France. pp. 161-170. pdf
  28. Jacob O. Wobbrock, Jodi Forlizzi, Scott E. Hudson, Brad A. Myers, "WebThumb: Interaction Techniques for Small-Screen Browsers," CHI Letters: ACM Symposium on User Interface Software and Technology, UIST'02, 27-30 Oct. 2002, Paris, France. pp. 205-208. pdf
  29. Brad A. Myers, Jeffrey Nichols, Jacob O. Wobbrock, Kevin Litwack, Michael Higgins, Joe Hughes, Thomas K. Harris, Roni Rosenfeld, Mathilde Pignol. "Handheld Devices for Control". Human-Computer Interaction Consortium (HCIC'2003), Winter Park, CO, Feb 5-9, 2003. pdf
  30. Jeffrey Nichols, Brad A. Myers, Michael Higgins, Joseph Hughes, Thomas K. Harris, Roni Rosenfeld, Kevin Litwack. "Personal Universal Controllers: Controlling Complex Appliances With GUIs and Speech," Extended Abstract CHI'2003: Human Factors in Computing Systems. (Demonstration Abstract). Fort Lauderdale, Florida, April 5-10, 2003. pp. 624-625. pdf
  31. Jacob O. Wobbrock. "The Benefits of Physical Edges in Gesture-Making: Empirical Support for an Edge-Based Unistroke Alphabet." Extended Abstracts of the ACM Conference on Human Factors in Computing Systems (CHI '03). Ft. Lauderdale, FL, April 2003. pp. 942-943. pdf or ACM
  32. Jeffrey Nichols and Brad A. Myers. "Studying The Use of Handhelds to Control Smart Appliances". International Workshop on Smart Appliances and Wearable Computing. IWSAWC 2003. In the Proceedings of the 23rd IEEE Conference on Distributed Computing Systems Workshops (ICDCS'03). May 19-22, 2003, Providence, Rhode Island. pp. 274-279. pdf
  33. Jacob O. Wobbrock, Brad A. Myers, and Scott E. Hudson. "Exploring Edge-based Input Techniques for Handheld Text Entry". International Workshop on Smart Appliances and Wearable Computing. IWSAWC 2003. In the Proceedings of the 23rd IEEE Conference on Distributed Computing Systems Workshops (ICDCS'03). May 19-22, 2003, Providence, Rhode Island. pp. 280-282. pdf
  34. Jacob O. Wobbrock, Brad A. Myers, and John Kembel. "EdgeWrite: A High-Accuracy Stylus Text Entry Method," CHI Letters: ACM Symposium on User Interface Software and Technology, UIST'03, Nov. 2-5, 2003, Vancouver, British Columbia, Canada. To appear. pdf
    Submitted for Publication
  35. Brad A. Myers. "Handheld Devices for Control of PCs and Appliances." pdf
    Unpublished
  36. Karen Cross, Adrienne Warmack, and Brad Myers. "Lessons Learned: Using Contextual Inquiry Analysis to Improve PDA Control of Presentations". postscript or pdf.
  37. Brad A. Myers, Yu Shan A. Chuang, Marsha Tjandra, Mon-chu Chen, and Chun-Kwok Lee. "Floor Control in a Highly Collaborative Co-Located Task." pdf or Postscript.
Articles about the Pebbles project by others (oldest to newest)
  1. Paul Beebe, "Software Marketed to trade under CMU brand name," Pittsburgh Tribune-Review, vol. 112, no. 285, Nov. 14, 2000.
  2. Jennie Borodko Stack, "Palm Pilot Connects Girl with Classroom," QUEST, Volume 8, Number 1, February 2001. html
  3. Catherine Zandonella, "How to Snarf with the Geeks," New Scientist, London, October 6, 2001, p. 24.
  4. John Zyskowski, "Handhands in a new world order," Federal Computer Week, March 18, 2002. html
  5. Mike Crissey, "Designers Work on All-in-One Remote," Associated Press, August 27, 2002. html
  6. WPXI, Channel 11 news at 11:00pm on October 15, 2002. (Includes a brief shot of Jeff and a PUC interface). mpg
  7. Michael Yeomans, "CMU Scientists Improving Computers' People Skills," Pittsburgh Tribune-Review, Tuesday, October 22, 2002. pages B7, B10. html
  8. Ann Light, "Pebbles Project connects PDAs up Smartly," UsabilityNews.com, 17 December 2002. html
  9. Walter McKenzie, "PDAs in the Classroom," Innovative Teaching Newsletter, Vol. 5, no. 15, January 6, 2003, html
  10. Kimberly Patch, "Handhelds Gain Space," Technology Research News, February 26/March 5, 2003, p. 4. html
  11. Dan Gillmore, "Dan Gillmor: Designing new handhelds to improve human-computer interaction," SiliconValley.Com; The San Jose Mercury News, April 9, 2003. html

Future Work

We plan to continue to work on Pebbles project. Let us know what would be useful.

If you have ideas or requests, please email them to us at bam at cs.cmu.edu.

Please also consider supporting the Pebbles project by providing a research grant. This will help us continue this research. The companies that are "affiliates" of the Pebbles projects will be given advance notice of future directions, and will be asked for advice on future directions. They will also have access to source code. We would also be interested in gifts of equipment, especially additional PDAs or wireless technologies for connecting them.

Related Projects at CMU

Maintained by: Brad A. Myers
Page design by:
Joonhwan Lee