(Un-)Interpretability in Expert Evidence: An Inquiry into the Frontiers of Evidential Assessment
Downloads
Abstract
Evidence law regimes across several contemporary legal orders provide a host of doctrinal devices designed to probe various sorts and sources of information, especially with respect to their accuracy and reliability. These legal provisions, however, are vulnerable to or even tolerant towards uninterpretable evidence, that is evidence whose probative value cannot be assessed. This article critically examines and discusses the “littering paths” of uninterpretable evidence in legal proceedings. We point out the misinformative character and potentially misleading impact on criminal adjudication when using scientific evidence for purposes that, strictly speaking, the evidence cannot help with. We identify common causes and possible remedies and argue that to track uninterpretability, it is necessary to understand what exactly it means to say that a piece of evidence is probative in the procedural space of reasons, and how to draw the line between informative and non-informative items of evidence.
Keywords
Scientific evidence, Interpretability, Probative value, Propositions, Forensic scienceReferences
American Academy of Forensic Sciences (AAFS) Standards Board. (2020). Standard for Validation of Probabilistic Genotyping Systems, ASB Standard 018 (1st ed.). https://www.asbstandardsboard.org (last accessed March 7 2021).
Aitken, C. (1995). Statistics and the Evaluation of Evidence for Forensic Scientists. John Wiley & Sons.
Aitken, C., Berger, C., Buckleton, J., Champod, C., Curran, J., Dawid, A., Evett, I., Gill, P., González-Rodríguez, J., Jackson, G., Kloosterman, A., Lovelock, T., Lucy, D., Margot, P., McKenna, L., Meuwly, D., Neumann, C., Daéid, N., Nordgaard, A., Puch-Solis, R., Rasmusson, B., Redmayne, M., Roberts, P., Robertson, B., Roux, C., Sjerps, M., Taroni, F., k Tjin-A-Tsoi, T., Vignaux, G., Willis, S. M. & Zadora G. (2011). Expressing evaluative opinions: a position statement. Science & Justice, 51, p. 1-2.
Aitken, C., Roberts, P. & Jackson, G. (2010). Fundamental of Probability and Statistical Evidence in Criminal Proceedings. Royal Statistical Society’s Working Group on Statistics and the Law.
Aitken, C. & Stoney, D. A. (eds.). (1991). The Use of Statistics in Forensic Science. Ellis Horwood.
Aronson, J. D. (2007). Genetic Witness: Science, Law, and Controversy in the Making of DNA Profiling. Rutgers University Press.
Association of Forensic Science Providers (AFSP). (2009). Standards for the formulation of forensic science expert opinion. Science & Justice, 49, p. 161-164.
Biedermann, A., Kotsoglou, K. N. (2018). Decisional dimensions in expert witness testimony—A structural analysis. Frontiers in Psychology, 9. https://www.frontiersin.org/articles/10.3389/fpsyg.2018.02073/full
Biedermann, A., Taroni, F. & Thompson, W. C. (2011). Using graphical probability analysis (Bayes nets) to evaluate a conditional DNA inclusion. Law, Probability and Risk, 10, p. 89-121.
Bright, J.-A., Taylor, D., McGovern, C., Cooper, S., Russell, L., Abarno, D. & Buckleton, J. (2016). Developmental validation of STRmixTM, expert software for the interpretation of forensic DNA profiles. Forensic Science International: Genetics, 23, p. 226-239.
Buckleton, J. S., Bright, J.A., Gittelson, S., Moretti, T. R., Onorato, A. J., Bieber, F. R., Budowle, B. & Taylor, D. (2019). The probabilistic genotyping software STRmix: utility and evidence for its validity. Journal of Forensic Sciences, 64, p. 393-405.
Buckleton, J. S. & Triggs, C. M. (2005). Relatedness and DNA: are we taking it seriously enough? Forensic Science International, 152, p. 115-119.
Champod, C., Lennard, C., Margot, P. & Stoilovic, M. (2016). Fingerprints and other Ridge Skin Impressions (2nd ed.). CRC Press.
Coble, M. D. & Bright, J.-A. (2019). Probabilistic genotyping software: an overview. Forensic Science International: Genetics, 38, p. 219-224.
Cole, S. A. & Biedermann, A. (2020). How can a forensic result be a “decision”? A critical analysis of ongoing reforms of forensic reporting formats for federal examiners. Houston Law Review, 57, p. 551-592.
Cook, R., Evett, I. W., Jackson, G., Jones, P. J. & Lambert, J. A. (1998a). A hierarchy of propositions: deciding which level to address in casework. Science & Justice, 38, p. 231-239.
Cook, R., Evett, I. W., Jackson, G., Jones, P. J. & Lambert, J. A. (1998b). A model for case assessment and interpretation. Science & Justice, 38, p. 151-156.
Dennis, I. (2017). The Law of Evidence (6th ed.). Sweet & Maxwell Ltd.
Edmond, G., Thompson, M. B. & Tangen, J. M. (2014). A guide to interpreting forensic testimony: scientific approaches to fingerprint evidence. Law, Probability and Risk, 13, p. 1-25.
European Network of Forensic Science Institutes (ENFSI). (2015). ENFSI Guideline for Evaluative Reporting in Forensic Science. http://enfsi.eu/wp-content/uploads/2016/09/m1_guideline.pdf (last accessed July 6 2021).
Evett, I. W. (1991). Interpretation: a personal odyssey. In C. Aitken & D. A. Stoney (eds.), The Use of Statistics in Forensic Science (p. 9-22). Ellis Horwood.
Evett, I. W. (2009). Evaluation and professionalism. Science & Justice, 49, p. 159-160.
Evett, I. W., Berger, C. E. H., Buckleton, J. S., Champod, C. & Jackson, G. (2017). Finding the way forward for forensic science in the US—A commentary on the PCAST Report. Forensic Science International, 278, p. 16-23.
Evett, I. W., Gill, P. D., Jackson, G., Whitaker, J. & Champod, C. (2002). Interpreting small quantities of DNA: the hierarchy of propositions and the use of Bayesian networks. Journal of Forensic Sciences, 47, p. 520-530.
Evett, I. W., Jackson, G. & Lambert, J. A. (2000). More on the hierarchy of propositions: exploring the distinction between explanations and propositions. Science & Justice, 40, p. 3-10.
Evett, I. W. & Weir, B. S. (1998). Interpreting DNA Evidence. Sinauer Associates Inc.
Fienberg, S. E. (ed.). (1989). The Evolving Role of Statistical Assessments as Evidence in Courts. Springer.
Finkelstein, M. O. & Fairley, W. B. (1970). A Bayesian approach to identification evidence. Harvard Law Review, 83, p. 489-517.
Friedman, R. D. (2017). The Elements of Evidence. West Academic Publishing.
Gastwirth, J. L. (1988). Statistical Reasoning in Law and Public Policy. Cambridge Academic Press.
Gill, P. (2014). Misleading DNA Evidence: Reasons for Miscarriages of Justice. Cambridge Academic Press.
Gill. P., Hicks, T., Butler, J. M., Connolly, E., Gusmão, L., Kokshoorn, B., Morling, N., van Oorschot, R. A. H., Parson, W., Prinz, M., Schneider, P. M., Sijenj, T. & Taylor, D. (2018). DNA Commission of the International Society for Forensic Genetics: assessing the value of forensic biology evidence—Guidelines highlighting the importance of propositions, Part I: evaluation of DNA profiling comparisons given (sub-)source propositions. Forensic Science International: Genetics, 36, p. 189-202.
Gill. P., Hicks, T., Butler, J. M., Connolly, E., Gusmão, L., Kokshoorn, B., Morling, N., van Oorschot, R. A. H., Parson, W., Prinz, M., Schneider, P. M., Sijenj, T. & Taylor, D. (2020). DNA Commission of the International Society for Forensic Genetics: assessing the value of forensic biological evidence—Guidelines highlighting the importance of propositions. Part II: evaluation of biological traces considering activity level propositions. Forensic Science International: Genetics, 44, p. 102-186.
Gittelson, S., Kalafut, T., Myers, S., Taylor, D., Hicks, T., Taroni, F., Evett, I. W., Bright, J.- A. & Buckleton, J. (2016). A practical guide for the formulation of propositions in the Bayesian approach to DNA evidence interpretation in the adversarial environment. Journal of Forensic Sciences, 61, p. 186-195.
Heard, B. J. (2008). Handbook of Firearms and Ballistics (2nd ed.). John Wiley & Sons.
Heard, B. J. (2013). Forensic Ballistics in Court, Interpretation and Presentation of Firearms Evidence. John Wiley & Sons.
Imwinkelried, E. J. (2020). The admissibility of scientific evidence: exploring the significance of the distinction between foundational validity and validity as applied. Syracuse Law Review, 70, p. 817-849.
Jackson, G. (2000). The scientist and the scales of justice. Science & Justice, 40, p. 81-85.
Jackson, G., Aitken, C. & Roberts, P. (2014). Case Assessment and Interpretation of Expert Evidence. Royal Statistical Society’s Working Group on Statistics and the Law.
Jackson, G. & Biedermann, A. (2019). “Source” or “Activity”. What is the level of issue in a criminal trial? Significance, 16, p. 36-39.
Jackson, G. & Jones, P. J. (2009). Case assessment and interpretation. In A. Jamieson & A. Moenssens (eds.), Wiley Encyclopedia of Forensic Science (p. 1-15). John Wiley & Sons.
Kaye, D. H. (1987). The validity of tests: caveant omnes. Jurimetrics Journal, 27, p. 349-361.
Koehler, J. J. (2013). Proficiency tests to estimate error rates in the forensic sciences. Law, Probability and Risk, 12, p. 89-98.
Kotsoglou, K. N. (2013). How to become an epistemic engineer: what shifts when we change the standard of proof? Law, Probability and Risk, 12, p. 275-298.
Kotsoglou, K. N. (2021). Zombie forensics. The use of polygraph and the integrity of the criminal justice system. International Journal of Evidence & Proof, 25, p. 16-35
Kotsoglou, K. N. & McCartney, C. (2021). To the exclusion of all others? DNA profile and transfer mechanics—R v Jones (William Francis) [2020] EWCA Crim 1021 (03 Aug 2020). The International Journal of Evidence & Proof, 25, p. 135-140.
Lander, E. S. (2017). Response to the ANZFSS council statement on the President’s Council of Advisors on Science and Technology Report. Australian Journal of Forensic Sciences, 49, p. 366-368.
Lempert, R. O. (1977). Modeling relevance. Michigan Law Review, 75, p. 1021-1057.
Lempert, R. O. (1986). The new evidence scholarship: analyzing the process of proof. Boston University Law Review, 66, p. 439-477.
National Commission on Forensic Science, Human Factors Subcommittee. (2015). Views of the Commission Ensuring That Forensic Analysis is Based Upon Task-Relevant Information, Approved 12/08/2015, https://www.justice.gov/archives/ncfs/file/ 818196/download (last accessed March 12, 2021).
Parmigiani, G. (2002). Modeling in Medical Decision Making: A Bayesian Approach. John Wiley & Sons.
Pearl, J. & Mackenzie, D. (2018). The Book of Why, The New Science of Cause and Effect. Penguin Books.
President’s Council of Advisors on Science and Technology (PCAST). (2016). Forensic Science in Criminal Courts: Ensuring Scientific Validity of Feature-Comparison Methods. Executive Office of the President.
Scientific Working Group on DNA Analysis Methods (SWGDAM). (2015). Guidelines for the Validation of Probabilistic Genotyping Systems. https://www.swgdam.org/publications (last accessed March 7 2021).
Schwoeble, A. J. & Exline, D. L. (2000). Current Methods in Forensic Gunshot Residue Analysis. CRC Press.
Stephen, J. F. (1948). Digest of the Law of Evidence (12th ed.). Macmillan.
Stoney, D. A. (1994). Relaxation of the assumption of relevance and an application to one-trace and two-trace problems. Journal of the Forensic Science Society, 34, p. 17-21.
Thayer, J. B. (1892). Select Cases on Evidence at the Common Law. C. W. Sever.
Thayer, J. B. (1898). A Preliminary Treatise on Evidence at the Common Law. Little Brown.
Thompson, W. C. (2018). How should forensic scientists present source conclusions? Seton Hall Law Review, 48, p. 773-813.
Thompson, W. C. & Schumann, E. L. (1987). Interpretation of statistical evidence in criminal trials: the prosecutor’s fallacy and the defense attorney’s fallacy. Law and Human Behavior, 11, p. 167- 187.
Tribe, L. H. (1971). Trial by mathematics: precision and ritual in the legal process. Harvard Law Review, 84, p. 1329-1393.
Trimpe, M. A. (2011). The current status of GSR examinations. FBI Law Enforcement Bulletin, May, p. 24-32.
U.S. Department of Justice. (2020). Uniform Language for Testimony and Reports for the Forensic Latent Print Discipline (ULTR, vers. 08.15.20). https://www.justice.gov/olp/page/file/1284786/download (last accessed 05 March 2021).
Williams, M. (1995). Problems of Knowledge. Oxford University Press.
Wittgenstein, L. (1958). Preliminary Studies for the “Philosophical Investigations”. Generally known as The Blue and Brown Books. Blackwell Publishers Ltd.
Yeroulanos, M. (ed.). (2016). A Dictionary of Classical Greek Quotations. Bloomsbury.
DOI
https://doi.org/10.33115/udg_bib/qf.i3.22599Published
How to Cite
Issue
Section
License
Copyright (c) 2021 Alex Biedermann & Kyriakos N. Kotsoglou
This work is licensed under a Creative Commons Attribution 4.0 International License.