Twitter Updates

    follow me on Twitter

    March 2014

    Sun Mon Tue Wed Thu Fri Sat
                1
    2 3 4 5 6 7 8
    9 10 11 12 13 14 15
    16 17 18 19 20 21 22
    23 24 25 26 27 28 29
    30 31          

    « Incorporating Gestalt Principles at Work | Main | Adapting the Iterative Design Process to Video Tutorial Development »

    September 19, 2010

    TrackBack

    TrackBack URL for this entry:
    http://www.typepad.com/services/trackback/6a01127908c29528a40133f46299d6970b

    Listed below are links to weblogs that reference Small Sample, Big ROI:

    Comments

    Great article Erin. I just stumbled on it from your Facebook mention.

    The statistical significance of usability studies is a hot topic, perhaps more so in engineering-driven cultures, which are inherently quantitative.

    I appreciate your article and mathematical acumen, but to defend small-group usability studies with statistical arguments misses the point and exacerbates number fetishism. The real point, in my view at least, is that small-scale qualitative usability studies demonstrate the existence of problems, whereas larger-scale quantitative studies demonstrate significance. (Or as Nielsen puts it, the former produce qualitative insights and the latter quantitative statistics. Furthermore, quantitative studies require more participants, more careful experimental design, more time, and more money.)

    So next time someone disputes the statistical significance of usability study results, ask them the following: "We're a quality-driven company. How many people need to trip over the product that we just released before we fix it?" One person is usually enough : )

    The comments to this entry are closed.

    RSS Feed

    • Subscribe