Ever since the United States Supreme Court handed down its decision in Daubert v. Merrell Dow Pharmaceuticals, 509 U.S. 579, 113 S.Ct. 2786. 125 L.Ed.2d 469 (1993), the questioned document examination field has been challenged as not meeting the Daubert factors required for the admissibility of scientific evidence. Elsewhere on this web site we have discussed several of the cases involving handwriting identification testimony. The challenges intensified after Kumho Tire v. Carmichael, 526 U.S. 137, 119 S.Ct. 1167, 143 L.Ed.2d 238 (1999) expanded the Daubert applicability to all forms of expert opinion testimony, requiring that the reliability of the evidence be determined in a pre-trial hearing conducted by a judge – the gatekeeper – in those cases where a serious challenge to the reliability of the evidence was presented.

Yet, these challenges have been largely ineffective in terms of barring the experts' testimony. In the majority of cases where handwriting evidence was challenged, the evidence was admitted as comporting with the Daubert/Kumho Tire criteria. In a few cases, discussed and dismissed in the Prime opinion that follows, the ultimate opinions of the experts were deemed not admissible although they were permitted to testify to the similarities and differences between writing samples that had been studied.. In only four federal trial court decisions did the judge rule that the evidence of a forensic document examiners was fully excluded..

Recently, two cases were decided by judges who, after carefully considering all of the prior judicial holdings, pro and con, came to the conclusion that the offered expert testimony on handwriting identification, including the ultimate opinion of a "match," was fully admissible as meeting both the Daubert and the Kumho Tire requirements. The cases are United States v. Prime, 220 F.Supp.2d 1203 (W.D. Wash., Sept. 20, 2002), and United States v. Thornton, ..... F.Supp.2d ......, Case No. 02-M-9150-01, decided by the United States District Court for the District of Kansas on Jan. 24, 2003.

Since they provide a good overview of all of the issues that are traditionally raised, and were cases where the courts considered the criticism leveled against handwriting evidence by Dr. Michael Saks, we will reprint here significant portions of the opinions that place the controversy in its proper perspective. This story gives the readers the bulk of the opinion in the Prime case. The next story on the site [see link at the end of this story] deals with the Thornton decision. In reprinting both decisions, we have omitted some internal quotations and footnotes where they do not affect the substance of the arguments.

=====

UNITED STATES v. PRIME
220 F. Supp.2d 1203 (W.D.Wash. 2002)

Order regarding Defendant's Motion In Limine

LASNIK, District Judge.

"On October 3, 2001, Michael S. Prime ("Prime") moved in limine to exclude expert testimony on handwriting identification at his trial or, in the alternative, for a hearing to determine the admissibility of such evidence pursuant to Daubert v. Merrell Dow Pharmaceuticals (1993) and Kumho Tire v. Carmichael (1999). Prime's motion brought into issue the testimony of Kathleen Storer ("Storer"), a forensic document examiner ("FDE" or "examiner") working for the United States Secret Service in Washington, D.C. Storer was to testify for the government that, in her opinion, Prime's handwriting appeared on counterfeit money orders and other documents. . . . The Court held a Daubert hearing on March 18, 2002, and issued an order denying Prime's motion on April 2, 2002....

I. THE APPLICABLE STANDARD

Until the Supreme Court issued its opinion in Daubert, the trial courts determined the admissibility of scientific evidence by applying the "general acceptance" test, . . . first articulated by the Court of Appeals of the District of Columbia in Frye v. United States (App. D.C. 1923) [which held that] expert opinion based on a scientific technique was inadmissible unless the technique was generally acceptable as reliable in the relevant scientific community. In Daubert, the Supreme Court held that this "rigid" requirement had been superceded by Rule 702 of the Federal Rules of Evidence. * * *

In Daubert, the Supreme Court created a gatekeeping role for trial judges as to the admissibility of scientific expert testimony. The Supreme Court envisioned that trial courts would conduct a factor based analysis when determining whether the testimony was reliable: (1) "whether the theory of technique can be and has been tested" (2) "whether the theory or technique has been subjected to peer review and publication" (3) "the known or potential rate of error" (4) "the existence and maintenance of standards controlling the technique's operation" and, finally, (5) "'general acceptance' can yet have a bearing on the inquiry." However, the opinion noted that the factors did not comprise a definitive checklist or test: "The inquiry envisioned by Rule 702 is, we emphasize, a flexible one. It's overarching subject is the scientific validity and thus the evidentiary relevance and reliability of the principles that underlie a proposed submission."

Subsequently, in Kumho Tire, the Supreme Court expanded this gatekeeper function to all expert testimony–i.e., not just that based on science. . . . Perhaps anticipating the problems that would follow if any particular Daubert factor was rigidly applied, the Supreme Court emphasized the flexibility that was inherent in the analysis: "We can neither rule out, nor rule in, for all cases and for all time the applicability of the factors mentioned in Daubert, nor can we now do so for subsets of cases categorized by category of expert or by kind of evidence. Too much depends upon the particular circumstances of the particular case at issue. * * * A flexible approach does not, however, imply a lax one. Even if testimony is based upon professional studies or personal experience, trial courts are to ensure that the expert employs in the courtroom the same intellectual rigor that categorizes the practice of an expert in the relevant field."

In Kumho Tire, the Supreme Court also clarified that the application of Daubert by trial courts was to be case- and fact-specific. * * * Finally, in Kumho Tire, the Supreme Court reaffirmed that trial courts enjoy a certain amount of latitude in their admissibility decisions. A trial court's decision on whether or not to include expert testimony was to be reviewed under the abuse of discretion standard. . . .

II. STORER'S ANALYSIS

According to Storer, the premises underlying handwriting examination and identification are that (1) "No two writers share the same combination of handwriting characteristics" and (2) "Each writer has a range of variation centered within his/her basic writing habits." A proper examination requires sufficient samples of comparable "questioned" and "known" handwriting that are naturally executed. If adequate samples are available, an examiner conducts a side-by-side comparison, including a visual and a microscopic study. The comparison made is of several handwriting features such as style, smoothness, size relationships, slant, spacing, curvature, angularity, punctuation, etc. Similarities and differences in various features have varying levels of significance, and the latter influence the conclusion that is drawn. After the examination, an opinion is expressed on a nine point scale: "identification," "strong probability of identification," "probable indications," "no conclusion," "indications did not," "probably did not," "strong probability did not," and "elimination." In the Secret Service, a second examiner conducts an independent examination without knowledge of the conclusion of the first.

In the case before the Court, the questioned documents comprised 76 exhibits such as envelopes, postal forms, money orders, post-it notes, express mail labels and postal box applications. The "known" handwriting came from three suspects in the case: 114 pages from David Hiestand ("Hiestand"), 14 pages from Jeff Hardy ("Hardy") and 112 pages from Prime. In Storer's opinion, Hiestand wrote portions of eight documents, Hardy wrote portions of one of the questioned documents and Prime wrote portions of 45 documents. These opinions ranked the highest in the nine-point scale (i.e. identification). As to portions of 14 questioned documents, Storer rendered an "indications" opinion, i.e., that there were "few features which are of significance for handwriting comparison purposes . . ." As to 38 signatures, Storer rendered a "could not be determined" opinion and the remainder of the material has "no evidence of significance" according to her.

In December 2001, Storer issued a second report based on additional questioned material (two brown envelopes with hand printing). She was of the opinion that Prime was the writer of the material on the new exhibits.

III COURT TREATMENT OF HANDWRITING IDENTIFICATION

[The first paragraph of the opinion, dealing with early (1902-1993) case law, is omitted as only of historical interest and irrelevant to the current issues. The opinion then continues as indicated hereafter. Editor]

The world appears to have changed with Daubert, after which district courts began to cast a suspicious eye at the discipline of forensic document analysis. After Daubert, but prior to Kumho Tire, district courts had the option of analyzing handwriting comparison testimony under two alternative strands: They could either look at the area of forensic document examination as being grounded in scientific knowledge and apply Daubert, or treat it as nonscientific expert testimony, i.e., falling under the "technical, or other specialized knowledge" prong of Fed.R.Evid 702. Analysis under both approaches was conducted in United States v. Starzecpyzel, 880 F.Supp. 1027 (S.D.N.Y. 1995). After a Daubert hearing in which Judge McKenna himself occasionally questioned the examiner, the court treated the testimony as science-based and then applied the Daubert factors. Noting that two ongoing studies were being conducted by the U.S. Postal Laboratory and the Immigration and Naturalization Service ("INS") Laboratory, the court ruled, first, that the discipline of handwriting analysis was "amenable" to testing. Second, the court found that the field had not, in fact, actually been subjected to rigorous testing and, therefore, the error rate as to any conclusions testified to by examiners was unknown. [In footnote 2, the Court indicated that the Postal Service and INS studies were incomplete at the time the Starzecpyzel opinion was rendered. Editor] As to the third Daubert factor, the court noted that FDEs published in several journals. However, the court found the articles "to be significantly different from scholarly articles in such fields as medicine and physics, in their lack of critical scholarship." Finally, the court found that the field did indeed receive general acceptance within the community of examiners and the legal community, but not from "financially disinterested parties, such as academics." In sum, the court concluded that "forensic document examination, despite the existence of a certification program, professional journals and other trappings of science, cannot, after Daubert, be regarded as "scientific . . . knowledge."

However, this did not result in an automatic ruling of inadmissibility. The [Starzecpyzel] court went on to state that Daubert did not apply to forensic document examiner testimony. The court rules that such testimony was not based on science but on "technical, or other specialized knowledge." After outlining what FDEs actually do, the Court held that forensic document examiner testimony was admissible, largely on the grounds that (1) the jury could visually confirm the first part of an FDE's analysis in which the examiner identifies significant similarities and differences between genuine and challenged handwriting examples, and (2) the other, unverifiable portion of the analysis, in which the examiner draws inferences, was dependent on the first part, and the testimony was, in any event, subject to cross-examination.

After Kumho Tire, all expert testimony, whether based on science or not, is subjected to the Daubert screen. Circuit courts [of appeal], admonished by the Supreme Court to review a district court's decision deferentially, generally have upheld district courts' decisions. * * *

Among district courts [trial courts], handwriting comparison testimony as fared unevenly since Kumho Tire. Much of the evidence presented to the courts is the same (and indeed, mirrors that presented to this Court). Yet, after applying Daubert, courts have reached varying conclusions as to the reliability of such testimony.

In United States v. Gricco, 2002 WL 746037 (E.D.Pa. 2002) (issued after the Daubert hearing in the case before the Court) the court found that testimony of an expert's opinion that there was a handwriting match between the defendant's exemplars and two government exhibits, including a handwritten list of materials allegedly used in manufacturing methamphetamine and a handwritten list of alleged laboratory supplies, was "sufficiently reliable for purposes of Rule 702." The court . . . found that the case for admissibility was clear. In reaching its conclusion that handwriting analysis was based on "valid reasoning and reliable methodology," the court noted the pedigree of such evidence in courtrooms across the country that had been established under the approving eye of the circuit courts. . . .

In contrast, in U.S. v. Saelee, 162 F.Supp.2d 1097 (D.Alaska 2001), the trial court ruled such evidence inadmissible. The questioned writing in the case involved address labels on packages, which the court presumed "would be considered a very small quantity of printing" and the defendant was an Asian whose first language was not known. In that case, the government sought to have its expert "testify only about the similarities and differences between the known writing and the questioned writing and not have [the expert] testify about his ultimate conclusions as to whether defendant authored the questioned documents. Acknowledging that it was taking "one step further than other courts," the [Saelee] court concluded that after applying Daubert that the expert testimony "is as likely to mislead a jury as to assist it in determining the facts of this case. It is therefore excluded entirely."

In United States v. Rutherford, 104 F.Supp.2d 1190 (D.Neb. 2000), the court found it helpful to break down the expert testimony into two components: (1) The comparison of the "stylistics of the defendant's handwriting" with the "handwriting(s) on the questioned documents" and (2) conclusions that the defendant was "the author of a signature or other writing on a questioned document." The former was not challenged by the defendant. The court found that the latter did not meet Daubert/Kumho Tire requirements and was therefore excluded.

Similarly, in United States v. Santillan, 1999 WL 1201765 (N.D.Cal. 1999), the district court limited the testimony to "the mechanics and characteristics of handwriting and testimony as to comparison of similarities between defendant's known handwriting and the handwriting on the 'questioned' documents, and barred any testimony concerning the expert's belief that the handwriting on the questioned documents is in fact handwriting of the defendant." [A similar conclusion was reached in United States v. Hines, 55 F.Supp. 62 (D.Mass. 1999).]

Trial court rulings reach one of three conclusions: (1) exclusion of all forms of expert testimony on handwriting comparison; (2) inclusion of the testimony on similarities and differences but exclusion of the expert's conclusions; and (3) inclusion of comparison and expert testimony.

IV. APPLICATION OF DAUBERT/KUMHO TIRE IN THE CASE BEFORE THE COURT

The challenge to handwriting evidence by Prime is two-fold. In 1998, in response to the Starzecpyzel decision, the U.S. Department of Justice issued a solicitation to conduct more studies to "determine the scientific validity of handwriting identification." Prime moved to exclude Storer's testimony on the ground that this solicitation was an admission by the Department that "in its present state, handwriting analysis cannot pass muster under Daubert/Kumho Tire. This argument is clearly without merit. A solicitation to gather further data on handwriting examination is not an admission that the testimony fails to meet current requirements. Therefore, Storer's testimony is not to be excluded on this ground.

The heart of Prime's challenge, however, goes to the government's claim that handwriting and handprinting identification testimony meets the requirements of Daubert/Kumho Tire.

Before the Court applies the Daubert factors to assess the admissibility of Storer's testimony, a few general observations are in order. First: Daubert and Kumho Tire were opinions issued in response to the increasing efforts to introduce novel theories in civil trials. By issuing these landmark opinions, the Supreme Court attempted to strike a balance between wholesale exclusion of most forms of non-scientific expert testimony, even that based on sound principles, versus liberal inclusion of such testimony, including that based on untested theories of highly dubious merit. Therefore, in Daubert, the Supreme Court overturned the trial court's exclusion of expert evidence based on the general acceptance test, but in Kumho Tire, upheld the exclusion of testimony based on a tire failure expert's obviously flawed methodology. These rulings have been used by some trial courts to exclude not just novel theories, but also time-tested techniques used almost universally by law enforcement, such as fingerprint and handwriting analysis. The Court believes that the outright exclusion of such evidence is a mistake. While the Court agrees that the Daubert analysis needs to be applied to all expert testimony, the test "depends upon the particular circumstances of the particular case at issue." [Kumho Tire.] Where a novel theory is presented to a court, it makes sense to demand proof of statistically significant results and strict compliance with scientific methods. However, where a technique has been repeatedly applied and tested by law enforcement and by courts for over a century, the Court does not believe that the absence of scientific data, without more, should be the death knell for such testimony. In United States v. Llera Plaza, 188 F.Supp.2d 549 (E.D.Pa. 2002) Judge Louis H. Pollak reached a similar conclusion where the testimony at stake was fingerprint identification based on a regimen known as "ACE-V." Judge Pollak acknowledged that such testimony did not satisfy all the Daubert factors. Nevertheless, he concluded that such testimony was admissible based largely on its historical acceptance by law enforcement and by English and American Courts:

I am not persuaded that courts should defer admission of testimony with respect to fingerprinting . . . until academic investigators financed by the National Institute of Justice have made substantial headway on a "verification and validation" research agenda. For the National Institute of Justice, or other institutions both public and private, to sponsor such research would be all to the good. But to postpone present in-court utilization of this "bedrock forensic identifier" pending such research would be to make the best the enemy of the good. . . . The ACE-V regime that is sufficiently reliable for an English court is, I conclude, a regime whose reliability should, subject to a similar measure of trial court oversight, be regarded by the federal courts of the United States as satisfying the requirements of Rule 702 as the Supreme Court has explicated that rule in Daubert and Kumho Tire.

The Court agrees with Judge Pollak's conclusion and reasoning.

Second: The Court also believes that the Daubert inquiry is not intended to ask the "larger question" regarding the reliability of a particular technique in general. Rather, the inquiry is case specific. In other words, all applications of handwriting identification are not at issue in the motion before the Court. Rather, the Court will evaluate the reliability of handwriting testimony within the confines of the facts of this case. * * * The Supreme Court made clear, therefore, that even in the context of evaluating expert testimony, the focus of a trial court should be on the facts of the dispute before it rather than on theoretical issues that may be relevant to discussions in other contexts.

With these principles in mind, the Court will proceed to apply the Daubert factors to the expert testimony at hand.

The most important line of inquiry under Daubert for present purposes–and one that appears to have foiled the testimony of many a handwriting expert in other district courts–is whether the theory and technique of handwriting has been, or is capable of being, tested and whether handwriting identification has an acceptable error rate. The Court understands this inquiry to include the following prongs: (a) whether the premises of handwriting identification are sound given the facts of this case; i.e., given the number of known samples of handwriting in this case, whether characteristics individual to Prime can be identified and used by a trained forensic examiner such as Storer; and (b) whether the work of professional forensic examiners, such as Storer, can be, and has been, tested for accuracy and proficiency and what the error rates are in such tests.

The government and Storer have cited to several different sources as support for the proposition that handwriting is unique. Among the evidence were results from research conducted by the Center for Excellence for Document Analysis and Recognition ("CEDAR") at the State University of New York at Buffalo. The CEDAR research results were accepted for publication in the Journal of Forensic Sciences prior to the Daubert hearing. . . . Professor [Sargur N.] Srihari [the principal author-investigator in the study. Editor] testified about his research at the Daubert hearing. His project was undertaken with the purpose of testing the hypotheses underlying forensic document examination. A portion of Professor Srihari's study looked at the process of examining two writing samples and determining whether they were written by the same of a different writer. Professor Srihari and his colleagues extracted features of handwriting–both "macro" features such as slant, and "micro" features such as the presence of openings in characters–and utilized these to compare documents using computer software. According to Professor Srihari, he obtained a 96 percent accuracy rate within his sample, which was "statistically inferable over the entire population." His conclusion was that "handwriting is individualistic."

The government also refers to databases maintained by the Secret Service and the German law enforcement agency, Bundeskriminalamt ("BKA"). These so-called "Forensic Information System for Handwriting" ("FISH") databases of letters convert handwriting features into mathematical algorithms. The government claims that of the 90,000 writers in the German database, "the system has determined that no two writers write alike, nor do they share the same combination of handwriting characteristics." The same conclusion can be reached from an analysis of the Secret Service's slightly smaller database of 9,000 writers, according to the government.

In addition, Storer refers in her affidavit to studies which show that the handwriting of twins can be distinguished. She cites numerous articles published in forensic science journals that conclude that handwriting is a distinguishable, individual trait. She also testified that her own personal experience showed that "every writer does have their [sic] own combination of individual characteristics."

As the Court has already noted, it nee not address the reliability of handwriting evidence generally. However, within the confines of this case, the Court has no trouble concluding that the premises of handwriting identification are sound. Storer states she received as many as 112 pages containing specimen writing from Prime, samples that the defense itself characterizes as "extensive." Storer's training credentials are, furthermore, impeccable: She received a Master of Forensic Science degree from George Washington University in 1988. From 1989 to the present she has been employed as an FDE with the Secret Service in Washington, D.C. At the Secret Service, she underwent a three-year apprenticeship or training program in document examination leading up to a certification on July 1, 1992. The training program in the Secret Service involves writing 18 research papers in the area of document examination and presenting them to peers for discussion. It also entails working alongside senior examiners who impart knowledge of their craft to the apprentices. Storer continues to take internal proficiency tests twice a year. Storer testified that she had never failed any of the in-house tests she was required to take by the Secret Service. In 1997, she was certified by the certifying body for forensic document examiners, the American Board of Forensic Document Examiners. The certification process included a three-part test: a practical, written, and an oral test. With this extensive level of training by the examiner and the array of available writing samples, the Court has no trouble concluding that unique characteristics of Prime's handwriting may be established.

[Editor's Note: At this point in the opinion, the Court included an extensive footnote 5, which is included herein in full since it deals with the defense testimony of a well-known critic of handwriting reliability: Professor Michael J. Saks.]

The Court's Footnote 5. The Court's conclusion is supported in general by the results of Professor Srihari's research. However, the Court acknowledges the limitations on the inferences that can be drawn from the study. Even if handwriting is individualistic when the examination is conducted by a computer, this does not necessarily establish it will be so when subjected to human examination. Moreover, the evidence provided of the BKA and Secret Service databases, while marginally probative, appears to beg the question it is presented to answer, as pointed out by Professor Michael J. Saks ("Saks"), professor of law and of psychology at Arizona State University, who testified at the Daubert hearing for the defendant. The uniqueness and individuality cannot be established simply by stating that different writers generate different algorithms. It is clear that individuality is an attribute that depends on the criteria used to judge the writing's characteristics: the more thorough the examination, the more likely that writings will appear unique (even if written by the same person). Dealing with the uniqueness question in a particular situation requires determining the criteria used to determine uniqueness, whether such criteria are reliable and whether these criteria were in fact applied in the case. Professor Saks' criticisms as to the studies on twins are also well taken. That the writing of twins can be distinguished cannot be said to stand for the principle that writing is unique to every individual. However, at least some of Professor Saks' criticism is more properly directed to the field of forensic document examination in general rather than being specifically applicable in the case before the Court. For instances, Saks cites to a 1958 study of signatures as being "extremely cautionary, if not devastating" to the hypothesis of individuality. (John J. Harris, How Much Do People Write Alike: A Study of Signatures, 48 J.Crim.L. & Criminology 647 (1958) ("Harris Study").) However, the Harris signature study has little bearing on the current case. In that study, the last names of people were cut out from handwriting on voter registration records. Examiners were then asked to compare the writing of the same last name, e.g., two different samples of the word "Smith" were compared. While Harris concluded that many of the signatures lacked individuality, the Court does not feel that the results of a one-word comparison can be extended to cover a case with the depth and breath of questioned and known documents as the one before the Court. The availability of a large number and variety of samples of handwriting makes this situation different not merely in degree, but in kind, from the research published in the 1958 article. Saks' criticism is a warning, well taken, that trial courts should be wary of identification based on small samples of handwriting.


As far as the proficiency and accuracy of FDEs are concerned, directly relevant to these issues are studies conducted in the 1990s by Professor Moshe Kam of the Electrical and Computer Engineering Department at Drexel University. [Editor's Note: Here again, the Court included its footnote 6, which it is important to relate, since it compares the Kam research to the handwriting critics' frequent assertion that old proficiency test data of the 1980s – thus, pre-Daubert – shows a lack of reliability in handwriting comparisons:]

The Court's Footnote 6: The Court finds that the studies conducted by Professor Kam are more relevant to its analysis than the statistical manipulation of data from proficiency tests conducted by the Forensic Sciences Foundation in the 1980s. The tests were not conducted using control groups; neither were the testing conditions taken into account. Moreover, the tests contained photographs, not original documents, and were administered to anyone who paid a fee. Given the availability of newer and more reliable data by Professor Kam, the Court finds that reliance on the proficiency tests is unnecessary.


In his studies, Professor Kam compared the performance of professional forensic document examiners with non-professionals in matching handwriting. Professor Kam testified in court that the first of his studies that lay persons made far more types of errors than professional examiners. The second study showed that as a group, examiners' performance was different from that of lay persons: Lay persons rivaled professional examiners in being able to select different documents written by one person. However, lay persons also claimed erroneously that documents written by different people had the handwriting of the same person 38 percent of the time, whereas experts made the same mistake 6.5 percent of the time. As Professor Kam stated: "It struck me very quickly that lay persons tend to see similarities and jump to a conclusion . . . whereas document examiners always started the analysis–when I asked why did you make the decision–by trying to show me [sic] what's different." The third [Kam] study showed that a different incentive scheme did not make a difference in the results; it apparently also showed an unexplained improvement in the ability of lay persons to avoid false positives. The fourth study showed that professionals and lay persons did not differ significantly in detecting forgeries, but professionals were better at finding genuine signatures. Professionals erroneously concluded that forgeries were genuine 0.5 percent of the time whereas lay persons did so 6.5 percent of the time; professionals mistakenly concluded that genuine signatures were forgeries 7.1 percent of the times, lay persons did so 26.1 percent of the time.

The Kam studies indicate that handwriting identification is not error-free; however, the differences in error rates and results between professionals versus lay persons show that the field is one that is amenable to developing an expertise and that, with proper training, professionals can improve their accuracy. For the purposes of this case, the Court considers the expertise and testimony of Storer to be adequately tested. Further scientific testing on handwriting comparison would undoubtedly aid in gauging the field's legitimacy; however, as a legal matter, the field has been sufficiently tested by its long-established use, and the research that already has been concluded. Daubert does not require more: The test of admissibility is not whether a particular scientific opinion has the best foundation or whether it is demonstrably correct. Rather, the test is whether the particular opinion is based on valid reasoning and reliable methodology.

The Saelee court's problem with the Kam studies was that "they did not conclusively establish that forensic document examiners can reliably do what they say they do." However, the context of the Saelee court's ruling was entirely different: As already noted, the court was dealing with a writer whose native language was not known and with a small quantity of questioned writing. The Saelee court specifically noted that:

The court would point out that it is not holding that handwriting analysis can never be a field of expertise under the Federal Rules of Evidence. The court is merely holding that the Government has failed to meet its burden of establishing that the proffered expert testimony in this case is admissible under Rule 702.

In any event, the Court disagrees with the Saelee's court assumption that Daubert requires that the reliability of a process or technique be established "conclusively.": As noted by the Supreme Court in Daubert itself: "It would be unreasonable to conclude that the subject of scientific testimony must be 'known' to a certainty; arguable, there are no certainties in science. To the extent that there are gaps in the research–and there are–they need to be filled. The Court encourages the profession to respond forthrightly to Professor Saks' criticism and urges Professor Kam to reveal his data for the purpose of re-analysis. However, the fact that additional research can be done does not mean that FDE testimony should now be inadmissible on the ground that it has not been adequately tested. Such as ruling "would be to make the best the enemy of the good.: [Quoting Judge Pollak in Llera Plaza, supra.]

The other Daubert factors also are satisfied in the case before the Court. It is clear to the Court that the forensic sciences, including document examination, are subject to extensive peer review. Storer testified at the Daubert hearing that journals publishing articles in this area include: The Journal of Forensic Sciences, the Journal of the American Society of Questioned Document Examiners, the International Journal of Forensic Document Examiners, the Canadian Society of Forensic Science Journal, the Journal of Forensic Identification and Forensic Science International. Articles sent for publication in the Journal of Forensic Sciences are reviewed not just by handwriting experts but by others in the forensic sciences community. Even if this form of peer review is not conducted by academics, it does not mean that it is devoid of utility. As Professor Kam's testimony shows, forensic document examiners have a legitimate expertise based on years of experience and training. Their review of articles submitted for publication provides oversight on research in the field. The Court agrees with Judge Pollak in Llera Plaza that just because peer review is not conducted by scientists, this need not "militate against the utility of the identification procedures. . . ."

Furthermore, at least in the case of Secret Service examiners, the process of document identification goes through an "internal" peer review as well, since every document reviewed by such examiners is subject to a second, independent examination. Finally, it cannot be ignored that handwriting evidence has been tested and reviewed in the courtroom for decades. This usage itself provides some assurance of reliability. Cf. United States v. Havvard, 117 F.Supp.2d 848, 854 (S.D.Ind. 2000) (nothing that "latent fingerprint identification has been subject to adversarial testing for roughly 100 years," a "track record [which] provides far greater assurance of reliability than, for example, publication of one peer-reviewed article describing a novel theory about the cause of a particular disease at issue in a civil lawsuit.")

Storer's testimony also showed that the field of document examination is moving toward establishing standards controlling the technique's operation. For one, the Secret Service laboratory where she works has maintained its accreditation with the American Society of Crime Laboratory Directors since 1998. This accreditation process requires an annual external proficiency test. Further, the nine-point scale for expressing opinions by the FDE's was established under the auspices of the American Standards and Testing Organization ("ASTM"). Perhaps in response to the enhanced scrutiny it was receiving, a working group was formed in 1997 by the industry in order to standardize many of the processes utilized. Standards already established by ASTM include the terminology used in the profession, and the practice for receiving, documenting, storing and retrieving evidence in a laboratory. According to Storer, eight proposed guidelines are undergoing peer review. One of the standards that is being formalized is the comparison process itself. Under these circumstances, the Court finds that forensic document examination is making strides toward standardization. The fact that the document examination process has not completely standardized is not necessarily a bar to admissibility in court. Not all expert testimony must be backed up by a standard procedure. Moreover, if a fact-finder is fully apprized of the process that is actually followed, and the expert is subject to cross-examination and to being countered by other experts, the lack of standardization can hardly be said to require exclusion.

Finally, it is clear to the Court that handwriting analysis has received broad acceptance. Law enforcement agencies such as Interpol, Scotland Yard, the Central Intelligence Agency, the Federal Bureau of Investigation and the United States Postal Inspection service use handwriting analysis. In addition, Storer listed 15 universities in the United States that offer Masters degrees in forensic science with courses that include document examination. As has already been noted, handwriting analysis has long been used in American courts. Even after Daubert and Kumho Tire, most district courts have admitted such evidence, albeit with limitations. Therefore, the general acceptance prong of Daubert is satisfied.

In sum, the Court is persuaded of the reliability of Storer's testimony; it was properly admitted and presented to the jury at trial. The Court acknowledges that had it required extensive scientific testing as exists in other fields, forensic document examination would come up short at the present time. However, the Daubert hearing made it very clear that the profession is in the process of making giant strides toward objective testing and standardization. The question before the Court, then, is whether in the interim period in which complete data are not available, the Court should exclude all FDE testimony as inadmissible. The Court is persuaded that, under Daubert, such testimony, including conclusions based on examinations, is reliable and admissible. Prime can present his own expert to dispute Storer's findings and/or to attack the entire field of forensic document examination as illegitimate. However, the apparent trend to exclude FDE testimony is a result, the Court believes, of an excessively-rigid application of Daubert. Since Daubert applies in both criminal and civil cases, such an approach may, one day, result in unfortunate consequences for a criminal defendant who is denied the ability to present the best evidence that he did not author an extortion demand or pen a forged signature. The Court declines to follow this trend on the record before it.

V. CONCLUSION

For the foregoing reasons, the Court denies the motion in limine and holds that Storer's testimony was properly admitted at trial.

END

See also, "The Thornton Handwriting Examination Decision." (link provided below)


Additional Articles in Identification Evidence.......

Friction Ridge Evidence:

Creating A Record on Critical Fingerprint “Scholarship”? New 06/16/07
Erroneous Fingerprint Individualizations - Why do they occur? 04/05/06
Did the Partial Fingerprint Lie? 04/05/06
Court Challenges to Friction Ridge Impression Evidence - How Long Will They Last?
Validating Friction Ridge Examination Techniques
Court Rejects Challenge To Fingerprint Identification Testimony
Court Excludes Fingerprint Critic's Testimony as "Junk Science"
The Reliability of Fingerprint Identification - A Case Report
Fingerprint Evidence In The U.K.
Is Fingerprint Identification a "Science"?
Fingerprint Identification....More On "Is It A Science?"
Deciphering Latent Fingerprints: Sandwich Method Revisited
Phenotype v. Genotype: Why Identical Twins Have Different Fingerprints

Handwriting and Forensic Document Examination:

Palmprint and Handwriting I.D. Satisfy Daubert Rule
Handwriting Identification Meets Daubert.....Again!
The Thornton Handwriting Examination Court Decision
Meeting the Daubert Challenge To Handwriting Evidence...Preparing for A Daubert Hearing
Handwriting Identification Evidence Meets Dauber-Kumho Tire Test
Handwriting Evidence Meets Reliability Criteria (on U.S. v. Paul)
E-Signatures...Bane or Boon To Handwriting Experts?
The "Gatekeeper" At Work - (on U.S. v. Haines)
Graphology / Graphoanalysis - What is it?

Bite Mark Identification:

Man Convicted on Erroneous Bite Mark Identification Evidence Finally Free

Firearm and Toolmark Evidence:

Toolmark Identification Received A (Frye-Daubert) Body Blow In Florida
Fully Automated GSR Package Developed

Lip Prints, Ear Prints, and Other Less Well-known Marks:

Alphonse Bertillon and Ear Prints
Ear Identification In The News Again
Ear Identification Based On Surveillance Camera's Images
Are Dutch Ears Different From American Ears?
Court Holds Earprint Identification Not Generally Accepted In Scientific Community
Protocol For Ear Identification Research
Ear Print Case Commentary Blames "Forensic Science"
DNA Evidence Proves Ear ID Wrong
Another Ear Print Conviction Reversed!
Lip Print Identification Anyone? (on People v. Davis --Ill.)
Lip Print Conviction Reversed - New Trial Ordered 04/05/06
Can Shoes Catch A Culprit? or Does A Shoeprint Lie? 04/05/06

Miscellaneous Identification and Biometric Evidence:

Dog Scent Evidence...Is it Scientific?
Forensic Stylistics in the Courts
Biometric Identification
Personal Identification by the Iris of the Eye
Facial Recognition Systems