Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Number of MPI tasks as derived database column #61

Open
sarats opened this issue Jul 27, 2021 · 0 comments
Open

Number of MPI tasks as derived database column #61

sarats opened this issue Jul 27, 2021 · 0 comments

Comments

@sarats
Copy link
Member

sarats commented Jul 27, 2021

It would be good to add a database column containing the total number of MPI ranks for an experiment.

Example:
https://pace.ornl.gov/exp-details/73942
Total MPI ranks = 5120

MariaDB [pace]> select * from pelayout where expid=73942;
+--------+-------+-----------+----------+---------+-------+---------+-----------+--------+
| id | expid | component | comp_pes | root_pe | tasks | threads | instances | stride |
+--------+-------+-----------+----------+---------+-------+---------+-----------+--------+
| 664831 | 73942 | cpl | 4160 | 0 | 4160 | 1 | 1 | 1 |
| 664832 | 73942 | atm | 4160 | 0 | 4160 | 1 | 1 | 1 |
| 664833 | 73942 | lnd | 320 | 3840 | 320 | 1 | 1 | 1 |
| 664834 | 73942 | ice | 3840 | 0 | 3840 | 1 | 1 | 1 |
| 664835 | 73942 | ocn | 960 | 4160 | 960 | 1 | 1 | 1 |
| 664836 | 73942 | rof | 320 | 3840 | 320 | 1 | 1 | 1 |
| 664837 | 73942 | glc | 1 | 0 | 1 | 1 | 1 | 1 |
| 664838 | 73942 | wav | 1 | 0 | 1 | 1 | 1 | 1 |
| 664839 | 73942 | iac | 1 | 0 | 1 | 1 | 1 | 1 |
+--------+-------+-----------+----------+---------+-------+---------+-----------+--------+
9 rows in set (0.001 sec)

On first cut, we can get the grouping of processors as follows:

select root_pe,MAX(tasks) from pelayout where expid= 73942 group by root_pe;
+---------+------------+
| root_pe | MAX(tasks) |
+---------+------------+
| 0 | 4160 |
| 3840 | 320 |
| 4160 | 960 |
+---------+------------+

Now, we have to sum up the third row: 4160 + 960 = 5120.
We can probably get a better SQL statement to compute this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant