The Cyclops library can be used to apply a workflow of data analysis
steps to data stored in a SQLite database. Workflows are defined in
the master Cyclops Operations SQLite database (Cyclops_Operations.db3),
with a separate table for each workflow. Rows in each Workflow table
track the analysis steps that the workflow will apply.
Columns in each workflow table are Step, Module, ModuleType, Parameter,
and Value. Each workflow step will typically have multiple rows, with
one row for each parameter related to the workflow step. The following
is an excerpt from the LabelFreeMainOperation workflow
(tracked via table T_LabelFreeLog2PipelineOperation)
| Step | Module | ModuleType | Parameter | Value |
|---|---|---|---|---|
| 1 | 1 | LoadRSourceFiles | 1 | removeFirstCharacters |
| 2 | 2 | Import | 1 | source |
| 3 | 2 | Import | 1 | target |
| 4 | 2 | Import | 1 | importDatasetType |
| 5 | 2 | Import | 1 | tableType |
| 6 | 2 | Import | 1 | inputTableName |
| 7 | 2 | Import | 1 | newTableName |
| 8 | 3 | ExportTable | 2 | source |
| 9 | 3 | ExportTable | 2 | target |
| 10 | 3 | ExportTable | 2 | tableName |
| 11 | 3 | ExportTable | 2 | fileName |
| 12 | 3 | ExportTable | 2 | separatingCharacter |
| 13 | 3 | ExportTable | 2 | includeRowNames |
| 36 | 7 | Transform | 1 | inputTableName |
| 37 | 7 | Transform | 1 | newTableName |
| 38 | 7 | Transform | 1 | scale |
| 39 | 7 | Transform | 1 | add |
| 40 | 7 | Transform | 1 | logBase |
| 41 | 7 | Transform | 1 | set02na |
| 42 | 8 | SummarizeData | 1 | inputTableName |
| 43 | 8 | SummarizeData | 1 | newTableName |
| 44 | 9 | SummarizeData | 1 | inputTableName |
| 45 | 9 | SummarizeData | 1 | newTableName |
| 46 | 10 | Aggregate | 1 | inputTableName |
| 47 | 10 | Aggregate | 1 | newTableName |
| 48 | 10 | Aggregate | 1 | factorTable |
| 49 | 10 | Aggregate | 1 | margin |
| 50 | 10 | Aggregate | 1 | function |
| 73 | 16 | BarPlot | 3 | tableName |
| 74 | 16 | BarPlot | 3 | dataColumns |
| 75 | 16 | BarPlot | 3 | plotFileName |
| 76 | 16 | BarPlot | 3 | backgroundColor |
| 77 | 16 | BarPlot | 3 | log |
| 205 | 40 | Save | 2 |
The CyclopsTest projects demonstrates how to initialize a workflow.
It loads the workflow name from file ITQ_ExportOperation.xml.
That file specifies workflow iTRAQMainOperation, which is
defined in table T_iTRAQ_PipelineOperation. This workflow
exports several tables from a SQLite database, saving them as
tab-delimited text files.
Written by Joseph Brown for the Department of Energy (PNNL, Richland, WA)
E-mail: [email protected]
Website: https://github.com/PNNL-Comp-Mass-Spec/ or https://www.pnnl.gov/integrative-omics
The Cyclops library is licensed under the 2-Clause BSD License; you may not use this file except in compliance with the License. You may obtain a copy of the License at https://opensource.org/licenses/BSD-2-Clause
Copyright 2018 Battelle Memorial Institute