http://skeptoid.com/episodes/4179
"Due to the large number of investigators and sitters involved, the number and consistency of paranormal episodes observed during the seances, and the lack of any finding of fraud, many believers often point to the Scole Experiment as the best scientific evidence that spirits do survive in the afterlife, and can and do come back and interact with the living, demonstrating an impressive array of conjuring powers."
"Unfortunately, the Scole Experiment was tainted by profound investigative failings. In short, the investigators imposed little or no controls or restrictions upon the mediums, and at the same time, agreed to all of the restrictions imposed by the mediums. The mediums were in control of the seances, not the investigators. What the Scole Report authors describe as a scientific investigation of the phenomena, was in fact (by any reasonable interpretation of the scientific method)
hampered by a set of rules which explicitly prevented any scientific investigation of the phenomena."
"If I go to Penn & Teller's magic show to look for evidence of deception, but I impose the rule that I have to stay in my seat and watch the show as presented, and I'm not allowed to go onstage and examine the performers or the equipment, or watch from behind, or observe the preparations, I guarantee you that I also will find no evidence of deception."
"A third red flag is the fact that there's been no followup. If amazing phenomena truly did happen at the Scole Experiment, it would have changed the world. Mainstream psychologists and other academics would have gotten in on it, it would have made worldwide headlines, and it would be repeated in labs everywhere and become mainstream science. They did have the opportunity: experimental psychologist and author Richard Wiseman provided secure envelopes for the film rolls to the experimenters, within which film always failed to be exposed. Rather than coming away impressed and spreading the word, Wiseman summed it up to me in six words: "It was a load of rubbish!"
"This same principle explains why we don't see articles from the Proceedings of the SPR, like the Scole Report, republished in scientific journals. A scientific investigation of a strange phenomenon assumes the null hypothesis unless the phenomenon can be proven to exist. But the authors of the Scole Report, with complete credulity, did the exact opposite: Their stated position is that the lack of disproof means their seances were real supernatural events. But a primary feature of good research is the elimination of other possible explanations, at which the Scole investigators made no competent effort. Many of the investigators expressed that they were not very convinced by what they witnessed, and it is to the credit of the Scole Report authors that they fairly reported this. But this raises the question: Why then write such a lengthy and credulous report, making such obvious conclusions that these phenomena were real? The lesson to take away from the Scole Experiment is a simple one. Although we all have preconceived notions, we have to put them aside and follow the evidence when we investigate."
http://skeptoid.com/episodes/4179