Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using DSL2 I would like to better visualize sub-workflows #1543

Closed
Midnighter opened this issue Mar 23, 2020 · 4 comments · Fixed by #4070
Closed

Using DSL2 I would like to better visualize sub-workflows #1543

Midnighter opened this issue Mar 23, 2020 · 4 comments · Fixed by #4070

Comments

@Midnighter
Copy link

New feature

The upcoming DSL2 provides the ability to include entire workflows within other workflows. In the nextflow terminal output this is typically shown as top-workflow:sub-workflow:process. I would like to bring this information visually to:

  1. The DAG drawn with graphviz. This could look like this example in the gallery, possibly with a better color scheme for the different clusters and nesting of subgraphs/clusters.
  2. The automatically generated execution report could provide aggregate stats for the different workflows and only in a second step allow a view on individual processes. I'm just spit balling here but there could even be an interactive drill down feature.

Usage scenario

For the first case, I definitely think that displaying workflows as clusters will help to visually organize the drawn DAG and quickly provide orientation for large pipelines.

For the second case, also for large pipelines, it may be enough to get an overview of the different stats per workflow rather than on a per process level.

Suggest implementation

If you like this feature request and you can point me to the code that generates the dot file and the report I can try to create a pull request for each.

@pditommaso
Copy link
Member

Yes, I agree that DAG rendering could be improved in many ways. See also #1056.

The relevant classes are DotRenderer and DAG which represents the execution graph data structure.

@stale
Copy link

stale bot commented Sep 7, 2020

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

@stale stale bot added the stale label Sep 7, 2020
@pditommaso
Copy link
Member

keep open

@stale stale bot removed the stale label Oct 12, 2020
@stale
Copy link

stale bot commented Mar 11, 2021

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants