|When planning an experiment it is essential also to know that the results can be analysed. Planing the statistical analysis is an integral part of planning the experiment. So these pages give a brief introduction to the main statistical methods of analysing designed experiments. Details are given in the sub-pages.
What is a “statistical analysis”
An experiment usually results in some means or proportion affected of different groups such as control and treated animals. Means will differ because each animal is different. Proportions affected could differ by chance. Means and proportions may also differ as a result of the treatment. The aim of the statistical analysis is to calculate the probability that differences as great as or greater than those observed could be due to chance. If this probability is high, then chance may be the explanation, if it is low then a treatment effect may be the explanation. These days the actual calculations are almost always done using a computer.
Most measurement data where the aim is to compare means can be analysed using an analysis of variance (ANOVA), a t-test or a non-parametric method. Scores and proportions often use a chi-squared test, while dose-response relationships use regression analysis. Other methods may be needed when there are multiple outcomes. The methods described in the sub-pages give a brief introduction.
Note that this page has five sub-pages accessed by clicking on “more details”. Return from the sub-pages by clicking on 11. Statistical analysis on the main navigation bar.
The statistical analysis
Data checking and summarisation
The ANOVA and Student’s t-test are often the best way of analysing quantitative (i.e. measurement) data , provided certain assumptions are met. When there are only two treatment groups the ANOVA and the t-test are mathematically identical, but the ANOVA will also accommodate more than two groups and more complex designs involving blocking and additional factors. The t-test is not discussed here as the ANOVA can replace it.
In some cases a scale transformation is necessary in order for the assumptions required for a valid ANOVA are met. This is also covered in the section. More details
- ..Hot being where users are actively involved (e.g. user testing / shadowing) and cold being without users (e.g. an… twitter.com/i/web/status/8… 2 days ago
- In our #UX training @stuartdn co-opted #MarshallMcLuhan's idea of hot and cold media to explain the amount of user… twitter.com/i/web/status/8… 2 days ago
- Happy Birthday to visionary #MarshallMcLuhan who theorised most of today's connected society, the global village etc. 2 days ago
- Acquisition ACRE Action research actor Agile behaviour closed comscore content context Contribute-To end Links definition Dissertation easywinwin ethical ethnography evaluations focus groups functional Global navigation goals groupware hci Heuristic evaluation i* IA Idealism Information Architecture Interaction Design Interviews Literature review Local navigation metrics negotiation Norman object observation open paper Personas porfolio Prototypes Qualitative data Questionnaires Realism Requirements Research result RSS scenarios SDM social-technical SRM Storyboards system Task analysis tasks technical thinkalouds three circles type UI Usability Usability testing Use cases User User-Centred design User Interface Technology users User stories validation viewpoints VOLERE Web analytic wireframes
- Gone Fishin' August 18, 2014After years of loyal service, findability.org has retired. This is the last post. Thanks for all of your support and encouragement over the past nine years. Peter Morville is now blogging over at intertwingled.org. See you there!
- Finding Intertwingled August 14, 2014Intertwingled is now available in print and digital formats on Amazon. Ironically, it's hard to find via Amazon's search. In the US, the ebook is hidden. In the UK, it's the paperback that's unfindable. But I'm not upset. Amazon is in the process of linking the print and Kindle versions. This happens with every book. Most authors are […]
- Gone Fishin' August 18, 2014