Some scientific studies involve huge amounts of bioinformatics data that cannot be analyzed on personal computers usually employed by researchers for day-to-day activities but rather necessitate effective computational infrastructures that can work in a distributed way. For this purpose, distributed computing systems have become useful tools to analyze large amounts of bioinformatics data and to generate relevant results on virtual environments, where software can be executed for hours or even days without affecting the personal computer or laptop of a researcher. Even if distributed computing resources have become pivotal in multiple bioinformatics laboratories, often researchers and students use them in the wrong ways, making mistakes that can cause the distributed computers to underperform or that can even generate wrong outcomes. In this context, we present here ten quick tips for the usage of Apache Spark distributed computing systems for bioinformatics analyses: ten simple guidelines that, if taken into account, can help users avoid common mistakes and can help them run their bioinformatics analyses smoothly. Even if we designed our recommendations for beginners and students, they should be followed by experts too. We think our quick tips can help anyone make use of Apache Spark distributed computing systems more efficiently and ultimately help generate better, more reliable scientific results.

Chicco, D., Ferraro Petrillo, U., Cattaneo, G. (2023). Ten quick tips for bioinformatics analyses using an Apache Spark distributed computing environment. PLOS COMPUTATIONAL BIOLOGY, 19(7), 1-16 [10.1371/journal.pcbi.1011272].

Ten quick tips for bioinformatics analyses using an Apache Spark distributed computing environment

Chicco D.
Primo
;
2023

Abstract

Some scientific studies involve huge amounts of bioinformatics data that cannot be analyzed on personal computers usually employed by researchers for day-to-day activities but rather necessitate effective computational infrastructures that can work in a distributed way. For this purpose, distributed computing systems have become useful tools to analyze large amounts of bioinformatics data and to generate relevant results on virtual environments, where software can be executed for hours or even days without affecting the personal computer or laptop of a researcher. Even if distributed computing resources have become pivotal in multiple bioinformatics laboratories, often researchers and students use them in the wrong ways, making mistakes that can cause the distributed computers to underperform or that can even generate wrong outcomes. In this context, we present here ten quick tips for the usage of Apache Spark distributed computing systems for bioinformatics analyses: ten simple guidelines that, if taken into account, can help users avoid common mistakes and can help them run their bioinformatics analyses smoothly. Even if we designed our recommendations for beginners and students, they should be followed by experts too. We think our quick tips can help anyone make use of Apache Spark distributed computing systems more efficiently and ultimately help generate better, more reliable scientific results.
Articolo in rivista - Articolo scientifico
Apache Spark; distributed computing; bioinformatics; computational biology.
English
20-lug-2023
2023
19
7
1
16
e1011272
open
Chicco, D., Ferraro Petrillo, U., Cattaneo, G. (2023). Ten quick tips for bioinformatics analyses using an Apache Spark distributed computing environment. PLOS COMPUTATIONAL BIOLOGY, 19(7), 1-16 [10.1371/journal.pcbi.1011272].
File in questo prodotto:
File Dimensione Formato  
Chicco-2023-Plos Computat Biol-VoR.pdf

accesso aperto

Descrizione: Article
Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Creative Commons
Dimensione 903.36 kB
Formato Adobe PDF
903.36 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/435418
Citazioni
  • Scopus 2
  • ???jsp.display-item.citation.isi??? 1
Social impact