Twitter Updates

    follow me on Twitter

    March 2014

    Sun Mon Tue Wed Thu Fri Sat
                1
    2 3 4 5 6 7 8
    9 10 11 12 13 14 15
    16 17 18 19 20 21 22
    23 24 25 26 27 28 29
    30 31          

    « Incorporating Gestalt Principles at Work | Main | Adapting the Iterative Design Process to Video Tutorial Development »

    September 19, 2010

    TrackBack

    TrackBack URL for this entry:
    http://www.typepad.com/services/trackback/6a01127908c29528a40133f46299d6970b

    Listed below are links to weblogs that reference Small Sample, Big ROI:

    Comments

    Great article Erin. I just stumbled on it from your Facebook mention.

    The statistical significance of usability studies is a hot topic, perhaps more so in engineering-driven cultures, which are inherently quantitative.

    I appreciate your article and mathematical acumen, but to defend small-group usability studies with statistical arguments misses the point and exacerbates number fetishism. The real point, in my view at least, is that small-scale qualitative usability studies demonstrate the existence of problems, whereas larger-scale quantitative studies demonstrate significance. (Or as Nielsen puts it, the former produce qualitative insights and the latter quantitative statistics. Furthermore, quantitative studies require more participants, more careful experimental design, more time, and more money.)

    So next time someone disputes the statistical significance of usability study results, ask them the following: "We're a quality-driven company. How many people need to trip over the product that we just released before we fix it?" One person is usually enough : )

    Verify your Comment

    Previewing your Comment

    This is only a preview. Your comment has not yet been posted.

    Working...
    Your comment could not be posted. Error type:
    Your comment has been saved. Comments are moderated and will not appear until approved by the author. Post another comment

    The letters and numbers you entered did not match the image. Please try again.

    As a final step before posting your comment, enter the letters and numbers you see in the image below. This prevents automated programs from posting comments.

    Having trouble reading this image? View an alternate.

    Working...

    Post a comment

    Comments are moderated, and will not appear until the author has approved them.

    RSS Feed

    • Subscribe