Monday, May 4, 2009
Fitts' Law
The Inmates are Running the Asylum
Providing Dynamically Changeable Physical Buttons on a Visual Display

Human Centered Design Considered Harmful
Usability Evaluation Considered Harmful
Saul Greenberg Bill Buxton
In this paper, Greenberg and Buxton discuss some problems that are associated with current methods of user interface evaluation, namely an overuse of quantitative usability studies in cases where other methods of evaluation might be more appropriate.
I find this particularly interesting as it brings up the question (to me) of whether CHI truly is a "hard science" where specific testing methods are generally sufficient and indeed necessary to evaluate a solution. Because of the great variety of goals in systems developed in CHI it is easy to see that one testing methodology is not going to be sufficient to test the usefulness of all systems.
A somewhat disturbing point that the authors bring up to support this claim, is the trend of researchers designing systems with the idea of qualitative evaluation in mind. If you are designing a system so that it specifically does well in the tests you plan to put it through, doesn't that really invalidate the tests you are going to perform? What does that prove about the system, that it performs exactly as hoped in the specific highly controlled environment you put it in. Even then, is it actually a system that should be evaluated in this way?
I agree with the authors that testing should be more flexible and actually fit the problem that is being addressed, and thus not necessarily quantifiable. Perhaps a new testing system should be created for each new system instead of recycling old test and trying to recast the problem into an existing mold.
Ethnography Considered Harmful
Andy Crabtree, Tom Rodden, Peter Tolmie Graham Button
This paper is essentially a caution written towards interactive designers about the dangers of the wholesale use of sociological ethnographic methods. The authors feel that even though computing is moving into a new level of ubiquitousness it does not mean that designers should throw away old task and work specific study methods. They feel that the new methods being employed are too centered on creating a story and not on focusing on applications and uses of technology.
I feel that these arguments are certainly fair, but that in finding new places to apply technology designers can't just look for existing tasks and work but have to create a broader picture of their target. Just as it makes no sense to only ask a user what they want and not considering what they might need, it makes little sense to study only what people are currently doing without asking what their goals and beliefs are and whether there is some system or solution that could fit those goals better than adapting what they already use.
Still, I can see that it is dangerous to only rely on a highly qualitative study of a group as this can lead to conclusions that are difficult to back up. Without well aimed quantitative study, working results that are gleaned from an ethnography could essentially be considered conjecture and do little to provide scientific proof.
Sunday, May 3, 2009
CHI 2007: Software or Wetware
CHI 2007
Software or Wetware? Discovering When
and Why People Use Digital Prosthetic Memory
Vaiva KalnikaitÄ— , Steve Whittaker
This paper investigates the use of prosthetic memory (both electronic and traditional) vs the use of organic memory. They compared usage of their journaling system, ChittyChatty, an audio recorder, organic memory and pencil and paper notes. They evaluated the four over a period of 1 to 30 days, asking users about the perceived efficiency, usability and accuracy of the systems.
As a result, the studies found that people like the ease of use of organic memory and pencil and paper over the short term, but that these degraded quickly in their usability and accuracy over time. They also found that their system ChittyChatty was generally well liked.
While their studies are interesting, especially for design of memory aid devices, I found their ChittyChatty system most interesting. It is a free hand note taking software that also records audio simultaneously, associating text notes with the audio recorded at the time. I think that would be extremely useful in the context of classes because you could essentially manually index the audio so you know where certain events occurred. Then you can quickly go back and listen to the audio for more details instead of having to write all the details at once.
UIST 2007: Gaze-enhanced Scrolling Techniques
Manu Kumar, Terry Winograd