Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Log all variables in the compss log files #11

Open
kinow opened this issue Feb 22, 2024 · 1 comment
Open

Log all variables in the compss log files #11

kinow opened this issue Feb 22, 2024 · 1 comment

Comments

@kinow
Copy link

kinow commented Feb 22, 2024

Level

MINOR

Component

RUNTIME

Environment

  • COMPSs version
  • Java / Python / C version
  • Operating System

Description

This is related to #10. When we were debugging the issue with the parameters for the MPI decorator, it was confusing to look at the compss logs. It apparently (now that it works too) outputs only a few evaluated/replaced values in the logs. And later it writes all the replaced values in another log file.

Minimal example to reproduce

https://github.com/eflows4hpc/workflow-registry/blob/9b232cf8aa9c6d285a662168eea4ae9fef73a74b/Pillar_II/esm/src/fesom2/__init__.py

We got binding logs like this one (some IIP info removed):

DEBUG:pycompss.runtime.binding:  - Implementation signature: fesom2.esm_simulation.<locals>._esm_simulation
DEBUG:pycompss.runtime.binding:  - Implementation constraints: 
DEBUG:pycompss.runtime.binding:  - Implementation type: MPI
DEBUG:pycompss.runtime.binding:  - Implementation type arguments: /***********/models/fesom2_eflows4hpc/fesom2/bin/fesom.x {{working_dir_exe}} srun 48 [unassigned] false [unassigned] True
DEBUG:pycompss.runtime.binding:CE with signature fesom2.esm_simulation.<locals>._esm_simulation registered.

There are values like {{working_dir_exe}} which are resolved/bound at a later stage by COMPs, while others like srun and 48 (and env vars, I think) appear fine in the logs.

Exception

None.

Expected behaviour

Display the evaluated/resolved bindings, or indicate that they are to be resolved, and will appear in another log file.

@jorgee
Copy link
Member

jorgee commented Feb 22, 2024

As commented in #10, when you use a task parameter these values are solved at the worker. Environment variables are resolved at master, so they will appear in this logs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants