The Rigor of Research Design and “Forensic” Publications in Neuropsychological Research

Seven neuropsychology journals that publish on topics relevant to clinical neuropsychology were examined for their experimental rigor according to the standards of the American Academy of Neurology (AAN) in their Clinical Practice Guidelines. By using a keyword approach on topics relevant to forensic neuropsychology, all articles that reported empirical findings from 2003 through 2008 were identified. Each study was rated by AAN classification criteria that ranged from a level I classification (prospective, most rigorous, and independent) to level IV (least rigorous). The typical forensic neuropsychological study averaged a class III ranking. Few studies were based on large sample sizes or utilized a reported masking or blind technique with regards to subject selection and how diagnostic criteria were met and/or data analyzed. While the authors for the average study reported a university affiliation, few reported explicit Institutional Review Board statements. Considerable variability across these seven journals with regards to conflict of interest (COI) disclosure policies was observed and only a few studies reported explicit statements about funding or COI issues. These observations suggest that neuropsychological research on forensic topics currently has many limitations and that future research needs to address these issues.