Pseudoscience

Phrenology is regarded today as a classic example of pseudoscience

Pseudoscience--combining the Greek pseudo (false) and the Latin scientia (knowledge)--refers to a variety of theories and claims which, in the opinion of their critics, falsely claim to be scientific. As such it presumes a certain understanding of "science" which may also be vulnerable to counter-criticism. The term, with its suggestion of error and / or fraud, is often received as something of a pejorative.

In popular usage, "pseudoscience" may also encompass certain theories and claims related to history (e.g., the idea that the Great Pyramid was built by space aliens) or religion (e.g., Spiritualist mediumship).

Paradigmatic Examples

Numerous theories, claims, and practices have been attacked as pseudo-scientific. Some — including the theory of evolution, plate tectonics, the Big Bang (a term originally chosen by Fred Hoyle to poke fun at the idea[6]) and quantum mechanics — have since won general acceptance. In retrospect, the delay was clearly a result of the challenges that they posed to the accepted doctrines of the time, and of the difficulty in gathering evidence for new theories. Following are some selected areas which, rightly or wrongly, are often discussed in connection with pseudo-science today:

Astrology

Astrology, (not to be confused with the science of astronomy) refers to a species of fortune-telling based on the position (relative to earth) of the sun, moon, stars, and / or constellations. The term is primarily associated primarily with several established traditions such as Western, Chinese, or Indian astrology. Some astrologers claim scientific status for their discipline, or some aspects of it; the activity at least makes certain assumptions which ought to be subject to scientific testing.

In principle, various astrological claims might, for all anyone knows, turn out to be true. (Certainly many genuine observations of cyclic influence of, for example, the sun or moon on human activity or emotions could be made.) The major criticism of astrology is that there is no good evidence for its most characteristic claims; and that astrology as a discipline has not incorporated any serious means of self-criticism. (In fact it often functions essentially as a religious activity, impervious to research.)

Astrological researchers often complain that they cannot receive a fair hearing in scientific circles, and find it hard to have their research published in scientific journals owing to the prejudice toward their topic. They claim that their scientific critics have wrongly dismissed studies which do support astrology. An example would be Michel Gauquelin's purported discovery of correlations between some planetary positions and certain human traits such as vocations.

ESP

The category of extra-sensory perception, or ESP, encompasses claims of telepathy, telekenesis, clairvoyance, astral projection, and other unrecognized psychic abilities. Scientific study of ESP was organized in the late nineteenth-century by the Society for Psychical Research, and in the 1930's, by Duke University parapsychology pioneers J.B. Rhine and Louisa Rhina. Contemporary researchers include Dean Radin and Rupert Sheldrake.

Scientific critics of ESP research complain of several types of methodological flaws including fraud, reliance on anecdotes, a "file drawer" effect (in which studies not supporting ESP are left to languish), and the misuse of statistics. Proponents insist that at least some ESP reseach meets acceptable scientific standards, and suggest that some forms of ESP might resist being studied under laboratory conditions.

Complementary and Alternative Medicine

In contrast to the mainstream Western medical tradition variously known as scientific medicine, evidence-based medicine, or allopathy, there exist a number of medical traditions and theories called alternative or complementary medicine, (cf. holistic health) whose relationship with the mainstream is strained. For example, the nineteenth-century Western traditions of osteopathy and chiropractic champion certain practices which the mainstream rejects as ineffective, and inconsistent with scientific understandings. (NB: Osteopaths insist that they too form part of the medical "mainstream," as their credentials have received equivalent recognition in many countries.) Medical activists often protest the popularity of such alternatives, decrying many of them as examples of quackery.

The field of medicine is methodologically vexed by the fact that many of its techniques, by their very nature, do not lend themselves to systematic testing, but are learnt as part of a practical body of tradition which is assumed to be generally efficacious. Thus for example practitioners of Traditional Chinese Medicine (TCM) insist that their practices are equally valid, having withstood the tests of time and experience. If certain aspects of TCM turn out to be unhelpful (at least for some patients), the same may be said of Western medicine. And if their theoretical underpinnings (involving for example a kind of energy called qi) seem widely divergent from Western scientific understandings, this too is permissible as science is always in flux; and in any case, doctors must prefer practical utility over theoretical consistency.

Many regard the diversity of medical traditions as roughly analogous to religious or cultural diversity--i.e. a matter of personal choice, not subject to oversight by scientific authorities from outside the tradition. Certainly religion itself has long enjoyed a close relationship with healing, as witnessed by the ubiquity of spiritual healing. Some attempts (e.g. prayer studies) have been made to evaluate the efficacy of spiritual practices for health, with mixed results.

IQ Studies

Cognitive scientists do not agree on what, if anything, intelligence is, let alone how to test for it. Nevertheless one particular measure--scores from a range of standardized Intelligence Quotient (IQ) tests--is widely used. Originally designed for educational and military use, the classic Stanford-Benet Intelligence Scale and its offshoots measure several cognitive capabilities such as language fluency, or three-dimensional thinking. While these may seem unrelated, test scores do in fact tend to correlate. The premise of IQ tests is that such capabilities all depend on some underlying factor, called the general intelligence factor. To critics, the concept smacks of metaphysics. Does "IQ" in fact measure anything at all?

Subsidiary questions relating to intelligence and IQ involve the relative importance of nature vs. nurture; and the distribution of IQ between men and women, and among the various races (cf. intelligence and race). Accusations of pseudo-science are not difficult to find in these discussions.

Psychotherapy

Freud's proposal that mental illness might be treated through talk rather than surgery, drugs, or hypnosis was only one of the startling features of psychoanalysis contrasting it to earlier conceptions of psychiatry. The concept remains controversial today. Does psychotherapy "work"? Is it any more effective than ordinary talk?

Critics additionally wonder precisely what ontological status is being claimed for various abstract entities beloved of psychological theory, such as Freud's ego and id, which would seem unavailable for scientific inspection. In what way do psychoanalysis and its successors differ from religions? The question is even more sensitive in the case of Jungian psychology and Transpersonal psychology, which are more interested in the spiritual dimension.

In The Myth of Mental Illness and other works, Thomas Szasz proposes that the entire concept of "mental illness" is a tool of social control at the hands of a "pharmacracy." In his view, a disease must be something concrete and measurable, not an abstract condition which comes into existence by vote. In this light, current attitudes toward mental illness are no more rational than nineteenth-century campaigns against onanism.

Intelligent Design

Intelligent Design, as promoted by members of the Discovery Institute, argues that the complexity and harmony of the universe (cf. irreducable complexity, specified complexity, fine-tuned universe), and especially of life on earth, implies the existence of an intelligent creator (the watchmaker argument or teleological argument). In answer to the objection this is essentially a religious doctrine, proponents point out that the designer need not be the Judeo-Christian God, suggesting UFO-based theories as an alternative.

To its critics, the theory was designed to circumvent U.S. prohibitions against the teaching of Creation Science as part of the scientific curricula of public schools. If so, the strategy did not work. In his decision for Kitzmiller v. Dover Area School District, Judge John E. Jones III agreed that Intelligent Design is--"a mere re-labeling of creationism, and not a scientific theory" (p. 43). He went on to say that

"...ID is not science. We find that ID fails on three different levels, any one of which is sufficient to preclude a determination that ID is science. They are: (1) ID violates the centuries-old ground rules of science by invoking and permitting supernatural causation; (2) the argument of irreducible complexity, central to ID, employs the same flawed and illogical contrived dualism that doomed creation science in the 1980's; and (3) ID's negative attacks on evolution have been refuted by the scientific community." (page 64)

Other

Hypnosis, handwriting analysis, polygraph analysis, the Japanese blood type theory of personality, cold fusion,

have all been attacked as examples of pseudo-science.

Timeline

While skeptical criticism of superstition dates back to ancient times (e.g., the writings of Lucian), the concept of "pseudoscience" had to await the rise of "science" as a source of authority. The term itself appears to have been used first in 1843 by Magendie, who referred to phrenology as "a pseudo-science of the present day"

1784 Louis XIV of France names a scientific committee to investigate mesmerism. Lavoisier, Benjamin Franklin, and Joseph Ignace Guillotin participate. The Committee organizes what some regard as the first placebo-controlled trial, finding Mesmer's claims baseless.

1885 The Society for Psychical Research (London) publishes the "Hodgson Report" declaring the Mahatma Letters of Madame Blavatsky fraudulent.

1910 The Carnegie Foundation publishes the (Abraham) Flexner Report recommending the closure of many U.S. medical schools, the survivors to be supervised by state branches of the American Medical Association. Among its targets are osteopathic, chiropractic, and naturopathic colleges.

1920's The Scientific American offers a cash-prize for successful demonstration of mediumship; illusionist Harry Houdini contributes his expertise in order to expose trickery.

1968 Charged with evaluating U.S. Air Force Project Blue Book, the (Edward) Condon Report concludes--amidst committee in-fighting and mutual accusations of bad science--that UFO's are not worth studying.

1969 Founding of two major ufology-promoting organizations: CUFOS (the J. Allen Hynek Center for UFO Studies) and MUFON (Mutual UFO Network).

1972 Stage magician James Randi "debunks" telekenetic Uri Geller, leading to mutual lawsuits.

1974 The American Association for the Advancement of Science organizes a symposium attacking the catastrophist theories of Immanuel Velikovsky. Astronomer Carl Sagan participates.

1976 Philosopher Paul Kurtz founds CSICOP, the Committee for the Scientific Investigation of Claims of the Paranormal (now known as the Committee for Skeptical Inquiry)

1976 Beginning of the antitrust case Wilk v. American Medical Association, which would ultimately find the AMA guilty of conspiracy and restraint of trade. At issue was whether the AMA had the right to forbid medical doctors from cooperating with chiropractors. Appeals continued until 1990, by which time the AMA had changed its policy.

1991 The United States government establishes an Office of Alternative Medicine (now the National Center for Complementary and Alternative Medicine) as part of the National Institutes of Health. The center supports research into CAM.

2006 20 Idaho State University faculty members sign a petition protesting their university's support for "fringe science." Their target is Bigfoot researcher, biologist D. Jeffrey Meldrum.

The Nature of Science

Main article: Philosophy of Science

Because science is so diverse, it is hard to find any rules that will distinguish between what is scientific and what is not that can be applied consistently to all disciplines at all times. The philosopher Imre Lakatos proposed that, while it is difficult to generalise about what makes a field scientific from its methodology, it might be possible to distinguish between 'progressive' and 'degenerative' research programs, those which continue to evolve, expanding our understanding, and those which stagnate.

Thagard proposed more formally that a theory which has pretensions to be scientific can be regarded as pseudoscientific if "it has been less progressive than alternative theories over a long period of time, and faces many unsolved problems; but the community of practitioners makes little attempt to develop the theory towards solutions of the problems, shows no concern for attempts to evaluate the theory in relation to others, and is selective in considering confirmations and disconfirmations"

Kuhn saw a circularity in this, and asked 'Does a field make progress because it is a science, or is it a science because it makes progress?' He also questioned whether scientific revolutions were in fact progressive, noting that Einstein's general theory of relativity is in some ways closer to Aristotle's than either is to Newton's. Most progress in science, according to Kuhn, is not at times of scientific revolution, when one theory is replacing another, but when one paradigm is dominant, and when scientists who share common goals and understanding fill in the details by puzzle solving. He argued that, when a theory is discarded, it is not always the case (at least not at first), that the new theory is better at explaining facts. Which of two theories is 'better' is largely a subjective judgement. The reasons for discarding a theory may be that more and more anomalous findings become apparent, that reveal its weaknesses, but there is no point at which the followers of one theory abandon it in favour of a new one; instead, they cling tenaciously to the old theory, while seeking fresh explanations for the anomalies. Thus, a new theory becomes dominant not by 'converting' followers of the old theory to the new, but rather because, over time, the new view gains more and more followers until it becomes the dominant paradigm, while the older view is held in the end only by a few 'elderly hold outs'. Kuhn argued that such resistance is not unreasonable, or illogical, or wrong; instead the conservative nature of science is an essential part of what enables it to progress. At most, it might be said that the man who continues to resist the new view long after the rest of his profession has adopted a new view "has ipso facto ceased to be a scientist"

Details that could throw doubt on your interpretation must be given, if you know them. You must do the best you can — if you know anything at all wrong, or possibly wrong — to explain it. If you make a theory, for example, ... then you must put down all the facts that disagree with it, as well as those that agree with it

As Kuhn described them to be, the motives of the true scientist are to gain the respect and approval of his or her peers. When technical jargon is misused, or when scientific findings are represented misleadingly, to give particular claims the superficial trappings of science for some commercial or political gain, this is easily recognised as an abuse of science ; it is not an abuse that is confined to popular literature however.

What makes a body of knowledge 'scientific' might seem to vary from field to field, but usually is judged by to what extent evidence from experiments is important, and how evidence changes the nature of the current theories. If evidence is important, then it needs to be reliable and reproducible, and so scientists take care to describe their methods precisely, and for example include 'control experiments' to check that their interpretation is accurate, and open what they do and think to criticism by others. Things that we believe are true regardless of any evidence are not scientific truths; these things we might sometimes call dogma, or faith, or superstition. Things that we believe from the evidence of our senses are not scientific truths either, but merely facts, or deductions from facts. 'If it walks like a duck and talks like a duck, it's a duck' is not a scientific statement, and it's no more scientific if we make it seem more profound, 'If its gait is like that of Anatidae, and it vocalises like Anatidae...'. However, 'If it walks like a duck and talks like a duck, it has the genes of a duck' is a scientific statement, because it seeks to tell us much more than we can see for ourselves; it might be wrong, but it expresses a theory that what makes a species distinctive is encoded in genes that are, in some ways, distinctive to that species. It's a bold speculation, but it's embedded in a body of understanding about how bodies are built, about natural selection, and about molecular biology. It might still be wrong, but it is not trivial and, most importantly, it can be tested by experiments.

Science has acquired its authority from its successes in changing our world, and when that authority is claimed without being earned, other scientists tend to get upset. When language is used that apes that of conventional scientists but without respect for its meaning, when claims are built on disputed dogma, when inconvenient evidence is ignored, or when grandiose theories are proposed that yield no non-trivial predictions and which seem to be incapable of proper test, then sometimes these things are called 'pseudoscience.'

Defining science by the scientific method

In the mid-20th Century, the philosopher Karl Popper published "The Logic of Scientific Discovery," a book that Sir Peter Medawar, a Nobel Laureate in Physiology and Medicine, called "one of the most important documents of the twentieth century". Popper explained that science does not advance because we learn more and more facts, but because the theories that it develops make better sense of the world, and lead to new and ever deeper questions. Popper analysed why theories are so important, how they are chosen, and how eventually they are discarded.

Scientists do not start with facts and then somehow assemble them to provide a theory; any attempt to do so would be logically unsound, because many different theories might be consistent with any particular facts. "Out of uninterpreted sense-experiences science cannot be distilled, no matter how industriously we sort them". Instead, scientists interpret nature through "Bold ideas, unjustified anticipations, and speculative thought". For Popper, the good scientist proposes an idea, as bold and exciting as he can, and then, instead of seeking evidence in favour of his idea - he tries as hard as he can to disprove it. For Popper, the ideas that can withstand determined attacks upon them are the most valuable, and so the 'content' of a theory can be gauged by the opportunities that it offers for experimental testing. If our ideas are worth anything, they will withstand the tests and challenges that they are exposed to; conversely, "those who are unwilling to expose their ideas to the hazard of refutation do not take part in the scientific game".

For Popper, there is no sense in which any theory can be proved to be true; a theory comes to be accepted because of its power to explain things, and because it has survived determined attempts to disprove it, but it is only accepted provisionally, until something better comes along. Accordingly, a 'pseudo-science' was a theory with a superficial resemblance to science, but which was empty, in being in principle incapable of disproof. He argued that astrology, Marxism, and Freudian psychoanalysis were all empty 'pseudo-scientific' theories because they allowed no possibility of falsification by experimental tests. Theories that cannot be falsified, he argued, have no connection with the real world. Popper argued that the explanations of Freudian psychoanalysis, of Marxism, and of astrology, were all unscientific in this sense.

Popper's arguments have been summarised succinctly by Peter Singer: "That an interpretation of history is capable of ordering a good many facts does not demonstrate its truth, any more than do similar claims about past conjunctions between the positions of the planets and events on earth demonstrate the truth of astrology. The historicist, like the astrologer, must say what future developments, or new discoveries about the past, would refute his theory; and if he cannot or will not do so, his claim to scientific knowledge need not be taken seriously." [7]

Defining science by the behavior of scientists

Suppose Galileo were here and we were to show him the world today and try to make him happy, or see what he finds out. And we would tell him about the questions of evidence, those methods of judging things which he developed. And we would point out that we are still in exactly the same tradition, we follow it exactly — even to the details of making numerical measurements and using those as one of the better tools, in the physics at least. And that the sciences have developed in a very good way directly and continuously from his original ideas, in the same spirit he developed. And as a result there are no more witches and ghosts. (Richard Feynman 'What is and what should be the role of scientific culture in modern society' 1964)

Popper's vision of the scientific method was soon itself tested by Thomas Kuhn. Kuhn concluded, from studying the history of science, that science does not progress linearly, but undergoes periodic 'revolutions', which he called 'paradigm shifts', in which the nature of scientific inquiry in a field is abruptly transformed. He argued that falsification had played little part in such revolutions, and concluded that this was because rival paradigms are incommensurable - that it is not possible to understand one paradigm through the concepts and terminology of another.

For Kuhn, whatever we mean by scientific progress, we must account for it by examining how scientists behave, and by discovering what they value, what they tolerate, and what they disdain. What they value most, according to Kuhn, is the respect of their peers, and they achieve this by success in solving difficult 'puzzles', while working with shared rules, a shared theoretical understanding, and towards shared objectives. Kuhn maintained that typical scientists are not objective, independent thinkers, but conservative individuals who largely accept what they have been taught. Most aim to discover what they already know - "The man who is striving to solve a problem ... knows what he wants to achieve, and he designs his instruments and directs his thoughts accordingly."

Such a closed group imposes its own expectations of rigor, and disparages claims that are, by their conventions, vague, exaggerated or untestable. Within any field of science, scientists develop a technical language that can be specific to that field, and to a lay reader, their papers may seem full of jargon, pedantry and obscurantism. No doubt what seems to be bad writing is often just bad writing, but these things also reflect an obsession with using words precisely, according to the conventions of the field. Sometimes the technical terms have strict definitions in terms of things that can be measured ('operational definitions'), but not always; many terms 'stand for' things not yet understood in mechanistic detail, and even in theoretical physics for instance, although most terms have some connection with observables, they are seldom of the sort that would enable them to be used as operational definitions. As Churchland observed "If a restriction in favor of operational definitions were to be followed ... most of theoretical physics would have to be dismissed as meaningless pseudoscience!" Scientists also expect any claims to be subject to peer review before publication and acceptance, and demand that any claims are accompanied by enough detail to enable them to be verified and if possible, reproduced. Some proponents of unconventional 'alternative' theories avoid this often ego-bruising process, sometimes arguing that peer review is biased in favour of established paradigms, or that assertions that lie outside what is conventionally accepted cannot be evaluated fairly using methods designed for a conventional paradigm.

Popper saw dangers in the closed worlds of specialists, but while admitting that at any one moment we are 'prisoners caught in the framework of our theories', he denied that different frameworks are like mutually untranslatable languages, and argued that clashes between frameworks have stimulated some of the greatest intellectual advances. Popper accepted that he had overlooked what Kuhn called 'normal science', but for him, such 'normal' science was the activity of "the not-too critical professional, of the science student who accepts the ruling dogma of the day;... who accepts a new revolutionary theory only if almost everybody else is ready to accept it." Popper acknowledged its existence, but saw it as the product of poor teaching, and also doubted whether 'normal' science was indeed normal. Whereas Kuhn had pictured science as progressing steadily during long periods of stability within a dominant paradigm, punctuated occasionally by scientific revolutions, Popper thought that it was rare for a single paradigm to be so dominant, and that there was always a struggle between sometimes several competing theories.

Popper's analysis of science was prescriptive, he described what he thought scientists ought to do, and claimed that this is what the best scientists did. Kuhn on the other hand claimed to be describing what scientists in fact did, not what he thought they ought to do, but nevertheless he argued that it was rational to attribute the success of science to the ways that scientists behaved. Whereas Popper was scathing about the conservative scientist who accepted the dogma of the day, Kuhn proposed that this very conservatism might be important for progress to occur. He suggested that, for science to progress, it might be important that scientists agree to accept, for the moment, a certain framework, and resist attempts to question it. According to Kuhn, during normal science, scientists do not try to overthrow theories, but rather they try to bring the accepted theory into closer agreement with observed facts and other areas of knowledge and understanding. Accordingly, they tend to ignore research findings that seem to threaten the existing paradigm, and "novelty emerges only with difficulty, manifested by resistance, against a background provided by expectation."

Nevertheless, there are controversies in every area of science, and these lead to continuing change and development. In this internal debate, scientists do not behave as irrational and tenacious adherents to a fixed mode of thinking, indeed, they are scornful of the selective use of experimental evidence - presenting data that seem to support claims while suppressing or dismissing data that contradict them - and peer-reviewed journals generally insist that published papers cite others in a balanced way. The philosopher Imre Lakatos attempted to accommodate this in what he called 'sophisticated falsification', arguing that it is only a succession of theories and not one given theory which can be appraised as scientific or pseudoscientific. A series of theories usually have a continuity that welds them into a research programme; the programme has a 'hard core' surrounded by a 'auxilliary hypotheses' which bear most tests, but which can be modified or replaced without threatening the core understanding.

Criticisms of the concept of pseudoscience

There is considerable disagreement not only about whether 'science' can be distinguished from 'pseudoscience' in any reliable and objective way, but also about whether even trying to do so is useful. The philosopher of science Paul Feyerabend argued that all attempts to distinguish science from non-science are flawed. "The idea that science can, and should, be run according to fixed and universal rules, is both unrealistic and pernicious. ... the idea is detrimental to science, for it neglects the complex physical and historical conditions which influence scientific change. It makes our science less adaptable and more dogmatic:"   Often the term "pseudoscience" is used simply as a pejorative to express a low opinion of a given field, regardless of any objective measures; thus according to McNally, "The term 'pseudoscience' has become little more than an inflammatory buzzword for quickly dismissing one’s opponents in media sound-bites." Similarly, Larry Laudan has suggested that 'pseudoscience' has no scientific meaning: "If we would stand up and be counted on the side of reason, we ought to drop terms like ‘pseudo-science’ and ‘unscientific’ from our vocabulary; they are just hollow phrases which do only emotive work for us".

Feyeraband's argument is essentially that propounded by John Stuart Mill (1806–1873)

First, if any opinion is compelled to silence, that opinion may, for aught we can certainly know, be true. To deny this is to assume our own infallibility. Secondly, though the silenced opinion be an error, it may, and very commonly does, contain a portion of truth; and since the general or prevailing opinion on any subject is rarely or never the whole truth, it is only by the collision of adverse opinions that the remainder of the truth has any chance of being supplied. Thirdly, even if the received opinion be not only true, but the whole truth; unless it is suffered to be, and actually is, vigorously and earnestly contested, it will, by most of those who receive it, be held in the manner of a prejudice, with little comprehension or feeling of its rational grounds. And not only this, but, fourthly, the meaning of the doctrine itself will be in danger of being lost, or enfeebled, and deprived of its vital effect on the character and conduct: the dogma becoming a mere formal profession, inefficacious for good, but cumbering the ground, and preventing the growth of any real and heartfelt conviction, from reason or personal experience

The sociologist Marcello Truzzi distinguished between 'skeptics' and 'scoffers'. Skepticism is an essential part of science, but skepticism is properly defined as doubt, not denial. Scientists who are scoffers, according to Truzzi, fail to apply the same professional standards to their criticism of unconventional ideas that would be expected in their own fields; they appear more interested in discrediting claims of the extraordinary than in disproving them, using poor scholarship, substandard science, ad hominem attacks and rhetorical tricks rather than solid falsification. He quotes the philosopher Mario Bunge as saying: "the occasional pressure to suppress it [dissent] in the name of the orthodoxy of the day is even more injurious to science than all the forms of pseudoscience put together."

[The National Science Foundation stated that, in the USA, 'pseudoscientific' habits and beliefs are common in the USA [8]

National Science Board. (2006) Science and Engineering Indicators 2006 Two volumes. Arlington, VA: National Science Foundation (volume 1, NSB-06-01; NSB 06-01A)

Beyerstein BL (1995) Distinguishing science from pseudoscience

Hewitt GC (1988) Misuses of biology in the context of the paranormal Experientia 44:297-303 PMID 3282905

Musch J, Ehrenberg K (2002) Probability misjudgment, cognitive ability, and belief in the paranormal Br J Psychol 93:169-77 PMID 12031145

Martin M (1994) Pseudoscience, the paranormal, and science education Science & Education 3:1573-901 [9]

Sagan C (1996) The Demon-Haunted World: Science As a Candle In the Dark

Lilienfeld SO (2004) Teaching Psychology Students to Distinguish Science from Pseudoscience: Pitfalls and Rewards [teachpsych.lemoyne.edu/ teachpsych/eit/eit2004/eit04-06.rtf]</ref>