The importance of residue-level filtering, and the Top2018 best-parts dataset of high-quality protein residues

We have curated a high-quality, "best parts" reference dataset of about 3 million protein residues in about 15,000 PDB-format coordinate files, each containing only residues with good electron density support for a physically acceptable model conformation. The resulting pre-filtered data typically contains the entire core of each chain, in quite long continuous fragments. Each reference file is a single protein chain, and the total set of files were selected for low redundancy, high resolution, good MolProbity score, and other chain-level criteria. Then each residue was critically tested for adequate local map quality to firmly support its conformation, which must also be free of serious clashes or covalent-geometry outliers. The resulting Top2018 pre-filtered datasets have been released on the Zenodo online web service and is freely available for all uses under a Creative Commons license. Currently, one dataset is residue-filtered on mainchain plus C{beta} atoms, and a second dataset is full-residue filtered; each is available at 4 different sequence-identity levels. Here, we illustrate both statistics and examples that show the beneficial consequences of residue-level filtering. That process is necessary because even the best of structures contain a few highly disordered local regions with poor density and low-confidence conformations that should not be included in reference data. Therefore the open distribution of these very large, pre-filtered reference datasets constitutes a notable advance for structural bioinformatics and the fields that depend upon it. The Top2018 dataset provides the first representative sample of 3D protein structure for which excellence of experimental data constrains the detailed local conformation to be correct for essentially all 3 million residues included. Earlier generations of residue-filtered datasets were central in developing MolProbity validation used worldwide, and now Zenodo has enabled anyone to use out latest version as a sound basis for structural bioinformatics, protein design, prediction, improving biomedically important structures, or other applications.