The pipeline system for Octave and Mat lab (PSOM): a lightweight scripting framework and execution engine for scientific workflows

被引:86
作者
Bellec, Pierre [1 ,2 ]
Lavoie-Courchesne, Sebastien [1 ,2 ,3 ]
Dickinson, Phil [1 ,3 ]
Lerch, Jason P. [4 ,5 ]
Zijdenbos, Alex P. [6 ]
Evans, Alan C. [3 ]
机构
[1] Inst Univ Geriatrie Montreal, Ctr Rech, Montreal, PQ H3W 1W5, Canada
[2] Univ Montreal, Dept Informat & Rech Operat, Montreal, PQ H3C 3J7, Canada
[3] McGill Univ, Montreal Neurol Inst, McConnell Brain Imaging Ctr, Montreal, PQ, Canada
[4] Hosp Sick Children, Mouse Imaging Ctr, Toronto, ON M5G 1X8, Canada
[5] Univ Toronto, Dept Med Biophys, Toronto, ON, Canada
[6] Biospective Inc, Montreal, PQ, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
pipeline; workflow; Octave; Matlab; open-source; parallel computing; high-performance computing; neuroimaging; HUMAN BRAIN; MANAGEMENT; DISCOVERY; SCIENCE; SWIFT; FMRI;
D O I
10.3389/fninf.2012.00007
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
The analysis of neuroimaging databases typically Involves a large number of inter-connected steps called a pipeline. The pipeline system for Octave and Matlab (PSOM) is a flexible framework for the implementation of pipelines in the form of Octave or Matlab scripts. PSOM does not introduce new language constructs to specify the steps and structure of the workflow. All steps of analysis are instead described by a regular Matlab data structure, documenting their associated command and options, as well as their input, output, and cleaned-up files. The PSOM execution engine provides a number of automated services: (1) it executes jobs in parallel on a local computing facility as long as the dependencies between jobs allow for it and sufficient resources are available; (2) it generates a comprehensive record of the pipeline stages and the history of execution, which is detailed enough to fully reproduce the analysis; (3) if an analysis is started multiple times, it executes only the parts of the pipeline that need to be reprocessed. PSOM is distributed under an open-source MIT license and can be used without restriction for academic or commercial projects. The package has no external dependencies besides Matlab or Octave, is straightforward to install and supports of variety of operating systems (Linux, Windows, Mac). We ran several benchmark experiments on a public database including 200 subjects, using a pipeline for the preprocessing of functional magnetic resonance images (fMRI). The benchmark results showed that PSOM is a powerful solution for the analysis of large databases using local or distributed computing resources.
引用
收藏
页数:18
相关论文
共 47 条
[11]  
Bose R., 2006, SIGMOD REC, V35, P51
[12]  
Burton Adrian, 2011, Lancet Neurol, V10, P206, DOI 10.1016/S1474-4422(11)70031-X
[13]   Global and System-Specific Resting-State fMRI Fluctuations Are Uncorrelated: Principal Component Analysis Reveals Anti-Correlated Networks [J].
Carbonell, Felix ;
Bellec, Pierre ;
Shmuel, Amir .
BRAIN CONNECTIVITY, 2011, 1 (06) :496-510
[14]   AUTOMATIC 3D INTERSUBJECT REGISTRATION OF MR VOLUMETRIC DATA IN STANDARDIZED TALAIRACH SPACE [J].
COLLINS, DL ;
NEELIN, P ;
PETERS, TM ;
EVANS, AC .
JOURNAL OF COMPUTER ASSISTED TOMOGRAPHY, 1994, 18 (02) :192-205
[15]  
Dansereau C. L., 2011, 17 INT C FUNCT MAPP
[16]   LORIS: a web-based data management system for multi-center studies [J].
Das, Samir ;
Zijdenbos, Alex P. ;
Harlap, Jonathan ;
Vins, Dario ;
Evans, Alan C. .
FRONTIERS IN NEUROINFORMATICS, 2012, 5
[17]  
Deelman E., 2005, Scientific Programming, V13, P219
[18]   Workflows and e-Science: An overview of workflow system features and capabilities [J].
Deelman, Ewa ;
Gannon, Dennis ;
Shields, Matthew ;
Taylor, Ian .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2009, 25 (05) :528-540
[19]  
Dinov Ivo D, 2009, Front Neuroinform, V3, P22, DOI 10.3389/neuro.11.022.2009
[20]   The NIH MRI study of normal brain development [J].
Evans, AC .
NEUROIMAGE, 2006, 30 (01) :184-202