Show simple item record

dc.contributor.authorAgafonov, Aleksander
dc.contributor.authorMattila, Kimmo
dc.contributor.authorTuan, Cuong Duong
dc.contributor.authorTiede, Lars
dc.contributor.authorRaknes, Inge Alexander
dc.contributor.authorBongo, Lars Ailo Aslaksen
dc.date.accessioned2019-03-04T14:00:49Z
dc.date.available2019-03-04T14:00:49Z
dc.date.issued2018-01-18
dc.description.abstractMETA-pipe is a complete service for the analysis of marine metagenomic data. It provides assembly of high-throughput sequence data, functional annotation of predicted genes, and taxonomic profiling. The functional annotation is computationally demanding and is therefore currently run on a high-performance computing cluster in Norway. However, additional compute resources are necessary to open the service to all ELIXIR users. We describe our approach for setting up and executing the functional analysis of META-pipe on additional academic and commercial clouds. Our goal is to provide a powerful analysis service that is easy to use and to maintain. Our design therefore uses a distributed architecture where we combine central servers with multiple distributed backends that execute the computationally intensive jobs. We believe our experiences developing and operating META-pipe provides a useful model for others that plan to provide a portal based data analysis service in ELIXIR and other organizations with geographically distributed compute and storage resources.en_US
dc.description.sponsorshipELIXIR EGI-Engage UiT The Arctic University of Norwayen_US
dc.descriptionSource at <a href=https://doi.org/10.12688/f1000research.13204.2> https://doi.org/10.12688/f1000research.13204.2</a>.en_US
dc.identifier.citationAgafonov, A., Mattila, K., Tuan, C.D., Tiede, L., Raknes, I.A. & Bongo, L.A. (2018). META-pipe cloud setup and execution. <i>F1000Research, 6</i>. https://doi.org/10.12688/f1000research.13204.2en_US
dc.identifier.cristinIDFRIDAID 1561115
dc.identifier.doi10.12688/f1000research.13204.2
dc.identifier.issn2046-1402
dc.identifier.urihttps://hdl.handle.net/10037/14818
dc.language.isoengen_US
dc.publisherF1000Researchen_US
dc.relation.journalF1000 Research
dc.relation.projectIDinfo:eu-repo/grantAgreement/RCN/IKTPLUSS/270675/Norway/End-to-End Data Analysis for Accessible Cancer Diagnosis Tests//en_US
dc.relation.projectIDinfo:eu-repo/grantAgreement/EC/H2020-EU.1.4.1.1./676559/EU/ELIXIR-EXCELERATE: Fast-track ELIXIR implementation and drive early user exploitation across the life-sciences./ELIXIR-EXCELERATE/en_US
dc.relation.projectIDinfo:eu-repo/grantAgreement/EC/H2020-EU.1.4.1.3./654142/EU/Engaging the EGI Community towards an Open Science Commons/EGI-Engage/en_US
dc.rights.accessRightsopenAccessen_US
dc.subjectVDP::Technology: 500::Information and communication technology: 550en_US
dc.subjectVDP::Teknologi: 500::Informasjons- og kommunikasjonsteknologi: 550en_US
dc.subjectELIXIRen_US
dc.subjectPortabilityen_US
dc.subjectMETA-pipeen_US
dc.subjectOpenStacken_US
dc.subjectEGI Federated Clouden_US
dc.subjectAmazon Web Servicesen_US
dc.subjectAAI federationen_US
dc.subjectApache Sparken_US
dc.titleMETA-pipe cloud setup and executionen_US
dc.typeJournal articleen_US
dc.typeTidsskriftartikkelen_US
dc.typePeer revieweden_US


File(s) in this item

Thumbnail

This item appears in the following collection(s)

Show simple item record