Repository: Freie Universität Berlin, Math Department

Critical Assessment of Metagenome Interpretation - the second round of challenges

Meyer, F. and Fritz, A. and Deng, Z.-L. and Koslicki, D. and Gurevich, A. and Robertson, G. and Alser, M. and Antipov, D. and Beghini, F. and Bertrand, D. and Brito, J. J. and Brown, C.T. and Buchmann, J. and Buluç, A. and Chen, B. and Chikhi, R. and Clausen, P. T. and Cristian, A. and Dabrowski, P. W. and Darling, A. E. and Egan, R. and Eskin, E. and Georganas, E. and Goltsman, E. and Gray, M. A. and Hansen, L. H. and Hofmeyr, S. and Huang, P. and Irber, L. and Jia, H. and Jørgensen, T. S. and Kieser, S. D. and Klemetsen, T. and Kola, A. and Kolmogorov, M. and Korobeynikov, A. and Kwan, J. and LaPierre, N. and Lemaitre, C. and Li, C. and Limasset, A. and Malcher-Miranda, F. and Mangul, S. and Marcelino, V. R. and Marchet, C. and Marijon, P. and Meleshko, D. and Mende, D. R. and Milanese, A. and Nagarajan, N. and Nissen, J. and Nurk, S. and Oliker, L. and Paoli, L. and Peterlongo, P. and Piro, V. C. and Porter, J. S. and Rasmussen, S. and Rees, E. R. and Reinert, K. and Renard, B. and Robertsen, E. M. and Rosen, G. L. and Ruscheweyh, H.-J. and Sarwal, V. and Segata, N. and Seiler, E. and Shi, L. and Sun, F. and Sunagawa, S. and Sørensen, S. J. and Thomas, A. and Tong, C. and Trajkovski, M. and Tremblay, J. and Uritskiy, G. and Vicedomini, R. and Wang, Zi. and Wang, Zhe. and Wang, Zho. and Warren, A. and Willassen, N. P. and Yelick, K. and You, R. and Zeller, G. and Zhao, Z. and Zhu, S. and Zhu, J. and Garrido-Oter, R. and Gastmeier, P. and Hacquard, S. and Häußler, S. and Khaledi, A. and Maechler, F. and Mesny, F. and Radutoiu, S. and Schulze-Lefert, P. and Smit, N. and Strowig, T. and Bremges, A. and Sczyrba, A. and McHardy, A. C. (2022) Critical Assessment of Metagenome Interpretation - the second round of challenges. Nature Methods, 19 (4). pp. 429-440. ISSN 1548-7091

Full text not available from this repository.

Official URL:


Evaluating metagenomic software is key for optimizing metagenome interpretation and focus of the community-driven initiative for the Critical Assessment of Metagenome Interpretation (CAMI). In its second challenge, CAMI engaged the community to assess their methods on realistic and complex metagenomic datasets with long and short reads, created from ∼1,700 novel and known microbial genomes, as well as ∼600 novel plasmids and viruses. Altogether 5,002 results by 76 program versions were analyzed, representing a 22x increase in results. Substantial improvements were seen in metagenome assembly, some due to using long-read data. The presence of related strains still was challenging for assembly and genome binning, as was assembly quality for the latter. Taxon profilers demonstrated a marked maturation, with taxon profilers and binners excelling at higher bacterial taxonomic ranks, but underperforming for viruses and archaea. Assessment of clinical pathogen detection techniques revealed a need to improve reproducibility. Analysis of program runtimes and memory usage identified highly efficient programs, including some top performers with other metrics. The CAMI II results identify current challenges, but also guide researchers in selecting methods for specific analyses. Competing Interest Statement: A.E.D. co-founded Longas Technologies Pty Ltd, a company aimed at development of synthetic long-read sequencing technologies.

Item Type:Article
Subjects:Mathematical and Computer Sciences > Computer Science
Divisions:Department of Mathematics and Computer Science > Institute of Computer Science > Algorithmic Bioinformatics Group
ID Code:2605
Deposited By: Anja Kasseckert
Deposited On:21 Sep 2021 14:25
Last Modified:05 Sep 2022 10:34

Repository Staff Only: item control page