Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Do not require a pipeline-job.sh script for each workflow step. #399

Open
xiamaz opened this issue Jun 7, 2023 · 0 comments
Open

Do not require a pipeline-job.sh script for each workflow step. #399

xiamaz opened this issue Jun 7, 2023 · 0 comments

Comments

@xiamaz
Copy link
Member

xiamaz commented Jun 7, 2023

Is your feature request related to a problem? Please describe.
The pipeline-job.sh script is used for submitting snappy workflows against slurm. Currently when creating a new workflow the pipeline-job.sh template is copied into each step and includes certain user-specific commands:

dest_path=os.path.join(dest_dir, FILENAME_PIPELINE_JOB_SH),

This pipeline-job.sh seldom needs to be adapted for individual workflow steps, as it just provides a wrapper for executing the snakemake workflow on a slurm cluster.

Describe the solution you'd like
Rather than copying the pipeline-job.sh to each new workflow folder. Consider adding the project snappy directory as a default location and provide override possibilities.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Associated cubi-tk issue bihealth/cubi-tk#177

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant