The Prosecutor’s Fallacy

There are 175 accredited law schools in the United States. Only one of these schools requires a basic course in statistics or research methods.1 This is unfortunate as this deficiency in education has had adverse effects on justice. Prosecutors have even had a statistical fallacy named after them, the Prosecutor’s Fallacy. Here is the Prosecutor’s Fallacy:

p(match) is mistaken for p(not guilty|match).

 Suppose that you have been charged with first degree murder, a capital offense. You undergo DNA testing. Your DNA is found to match a DNA sample taken from the scene of the crime. The expert witness testifies that only one person in 100,000 would be able to match the DNA sample. You might conclude that it is all over for you. Many prosecutor’s would conclude that they had an open and shut case. But suppose that you lived in New York City and that the crime took place in New York. I believe that the population of the metropolitan New York is around eight million. So within the metropolitan New York area there are about eighty other individuals who could provide matching samples. So, given no other evidence against you, the probability is only 1/80 (0.0125) that you are the murderer.

DNA evidence can be more beneficial to the defense than than to the prosecution. For example, if the DNA from the semen sample taken from a rape victim does not match that of the accused, it is fairly certain that the accused is not guilty. It is difficult to understand how judges, if they are truly interested in justice, would ever deny DNA tests for rapists convicted before DNA testing had advanced to its present state.

A related fallacy in statistical reasoning can be found in the O.J. Simpson case. Simpson’s lawyer, Alan Dershowitz presented the data that as many as four million women are battered annually by husbands and boyfriends in the United States in 1992. In 1992 913 women were killed by their husbands and 519 were killed by boyfriends. So out of these four million cases of abuse, there were only1,432 homicides. From this Dershowitz concluded that there is less than 1 homicide per 2,500 cases of abuse. If you do the computations, you will find that this is still a conservative estimate. Although this is a conservative estimate, it is the wrong statistic. What we need to know is of the battered, murdered women, how many were killed by someone other than their husband or boyfriend. When this is considered we find that 89% of these women were murdered by their husband or boyfiend and only 11% by someone else. This statistic casts a dramatically different light on the probability of Simpson’s guilt. Yet the prosecution let this past without offering this relevant statistic.

Courts are frequently given the responsibility of determining whether violent people should be released back into the community. Psychiatrists are given a difficult task when they need to render an opinion as to whether a violent or potentially violent person should be released. The American Psychiatric Association provided this statement to the Supreme Court of the United States: “our best estimate is that two out of three predictions of long-term future violence are wrong.” Still the Supreme Court of the United States has ruled that such testimony is legally admissible as evidence. Here is their reasoning, “mental health professionals are not always wrong…only most of the time.”

1Faigman, D. L. (1999). Legal Alchemy: The Use and Misuse of Science in the Law. New York: Freeman and Co.

Tags: , ,

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: