Types of Studies
Important medical questions are typically studied more than once, often by different research teams in different locations.
A systematic review is a comprehensive survey of a topic in which all of the primary studies of the highest level of evidence have been systematically identified, appraised and then summarized according to an explicit and reproducible methodology.
A meta-analysis is a survey in which the results of all of the included studies are similar enough statistically that the results are combined and analyzed as if they were one study. In general a good systematic review or meta-analysis will be a better guide to practice than an individual article.
Pitfalls specific to meta-analysis include:
Randomized Controlled Studies
A randomized controlled study is one in which:
Assigning patients at random reduces the risk of bias and increases the probability that differences between the groups can be attributed to the treatment.
Having a control group allows us to compare the treatment with alternative choices. For instance, the statement that a particular medication cures 40% of cases tells us very little unless we also know how many cases get better on their own! (Or with a different treatment).
With certain research questions, randomized controlled studies cannot be done for ethical reasons. For instance, it would be unethical to attempt to measure the effect of smoking on health by asking one group to smoke two packs a day and another group to abstain, since the smoking group would be subject to unnecessary harm.
Randomized controlled trials are the standard method of answering questions about the effectiveness of different therapies. If you have a therapy question, first look for a randomized controlled trial, and only go on to look for other types of studies if you don't find one.
A double blind study is one in which neither the patient nor the physician knows whether the patient is receiving the treatment of interest or the control treatment.
For example, studies of treatments that consist essentially of taking pills are very easy to do double blind - the patient takes one of two pills of identical size, shape, and color, and neither the patient nor the physician needs to know which is which.
A double blind study is the most rigorous clinical research design because, in addition to the randomization of subjects which reduces the risk of bias, it can eliminate the placebo effect which is a further challenge to the validity of a study.
The placebo effect could be thought of in this way:
Cohort Studies
A Cohort Study is a study in which patients who presently have a certain condition and/or receive a particular treatment are followed over time and compared with another group who are not affected by the condition under investigation.
For instance, since a randomized controlled study to test the effect of smoking on health would be unethical, a reasonable alternative would be a study that identifies two groups, a group of people who smoke and a group of people who do not, and follows them forward through time to see what health problems they develop.
Cohort studies are not as reliable as randomized controlled studies, since the two groups may differ in ways other than in the variable under study. For example, if the subjects who smoke tend to have less money than the non-smokers, and thus have less access to health care, that would exaggerate the difference between the two groups.
The main problem with cohort studies, however, is that they can end up taking a very long time, since the researchers have to wait for the conditions of interest to develop. Physicians are, of course, anxious to have meaningful results as soon as possible, but another disadvantage with long studies is that things tend to change over the course of the study. People die, move away, or develop other conditions, new and promising treatments arise, and so on. Even so, cohort studies are generally preferred to case control studies , since they involve far fewer statistical problems and generally produce more reliable answers.
Case Controlled Studies
Case series and case reports consist either of collections of reports on the treatment of individual patients, or of reports on a single patient.
For example: one of your patients has a condition that you have never seen or heard of before and you are uncertain what to do. A search for case series or case reports may reveal information that will assist in a diagnosis. However, for any reasonably well-known condition you should be able to get better evidence. Case series and case reports, since they use no control group with which to compare outcomes, have no statistical validity .