From a theoretical perspective, the risk of bias from selective reporting in the parapsychology literature is high, as there are not measures in place to reduce the risk of this bias. And we see that this high risk of bias is expressed by finding numerous examples where selective reporting is present. This is a list of some specific examples of different types of selective reporting. Please note that this is merely a tiny, illustrative sample, not a complete listing.
Selective reporting refers to between-study selection (often referred to as publication bias) and within-study selection (which includes selective outcome reporting and selective reporting of sub-group analyses).
"Publication bias" doesn't just involve a failure to publish a study. It also refers to a failure to include relevant studies and outcomes in meta-analyses, among other things.
http://www.koestler-parapsychology.psy.ed.ac.uk/cwatt/Documents/WattJP07.pdf
A survey of student projects, including ganzfeld experiments, some of which were published and some not. The results in the unpublished studies are different from those in the published studies.
http://deanradin.com/evidence/Storm2010MetaFreeResp.pdf
http://forum.mind-energy.net/forum/...l-biases-in-parapsycholgy?p=212817#post212817
Ganzfeld meta-analysis which is missing studies and whose results are different from the included studies.
http://deanradin.com/evidence/Shiah2013.pdf
http://deanradin.blogspot.com/2013/11/metaphysics-of-tea-ceremony.html (comments section)
Failure to report the main outcome (difference in mood between intentional tea and a control group - reported difference is on a small subset only) of the study in the report. Subsequent questioning of the author revealed that this outcome was not significant.
"Robertson, T. J. and Roy, A. E. (2004) Results of the application of the Robertson-Roy Protocol to a series of experiments with mediums and participants. JSPR 68.1"
Failure to report the main outcome (reading accuracy between recipients and non-recipients of mediumship readings under blind conditions). The authors have not provided these results subsequently, and my requests for this information from the authors have been unanswered.
http://www.skepticreport.com/download/Part3b.pdf (under "Studies 101-105: Novice studies")
The reported results on Julliard students from Honorton's autoganzfeld studies was a post-hoc selection from two experiments rather than the original, full experimental results. The results of the original planned experiments are not reported.
http://naturalismisuseful.blogspot.com/2014/03/outcomes-part-1.html
Multiple measured outcomes in mediumship research, only some of which are reported. Of the 21 different outcomes measured in the 3 studies, all three were reported in the Robertson-Roy study (but only for 1 of the 8 different experiments which were carried out (experiment 5)), 3 out of 12 were reported in the Beischel study, and 1 out of 3 outcomes for study 1 and parts of 2 out of 4 outcomes for study 2. To be fair, Beischel states that their item-by-item scoring will be published later. So we are missing the results from 7 of the 8 experiments in Robertson-Roy (including Experiment 1 which was the only one which followed the Robertson-Roy blinded protocol), and 4 of the 7 outcomes from Kelly.
