Show simple item record

dc.contributor.authorPedersen, Edvard
dc.contributor.authorWillassen, Nils Peder
dc.contributor.authorBongo, Lars Ailo
dc.date.accessioned2014-12-10T09:04:47Z
dc.date.available2015-12-10T06:50:05Z
dc.date.issued2014
dc.description.abstractA large up-to-date compendium of integrated genomic data is often required for biological data analysis. The compendium can be tens of terabytes in size, and must often be frequently updated with new experimental or meta-data. Manual compendium update is cumbersome, requires a lot of unnecessary computation, and it may result in errors or inconsistencies in the compendium. We propose a transparent file based approach for adding incremental update ca-pabilities to unmodified genomics data analysis tools and pipeline workflow managers. This approach is implemented in the GeStore system. We evaluate GeStore using a real world genomics compendium. Our results show that it is easy to add incremental updates to genomics data processing pipelines, and that incremental updates can reduce the computation time such that it becomes prac-tical to maintain large-scale up-to-date genomics compendia on small clusters.en
dc.descriptionThe final publication is available at Springer via http://dx.doi.org/10.1007/978-3-642-54420-0_31en
dc.identifier.cristinIDFRIDAID 1170448
dc.identifier.doi10.1007/978-3-642-54420-0_31
dc.identifier.isbn978-3-642-54420-0
dc.identifier.issn0302-9743
dc.identifier.urihttps://hdl.handle.net/10037/6902
dc.identifier.urnURN:NBN:no-uit_munin_6508
dc.language.isoengen
dc.publisherSpringer Berlin Heidelbergen
dc.relation.ispartofseriesEuro-Par 2013: Parallel Processing Workshops, Lecture Notes in Computer Science, Vol. 8374, 2014, pp 311-320en
dc.rights.accessRightsopenAccess
dc.subjectVDP::Teknologi: 500::Informasjons- og kommunikasjonsteknologi: 550::Datateknologi: 551en
dc.titleTransparent Incremental Updates for Genomics Data Analysis Pipelinesen
dc.typeChapteren
dc.typeBokkapittelen


File(s) in this item

Thumbnail
Thumbnail

This item appears in the following collection(s)

Show simple item record