You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
Currently the stage-in container uses only curl to download inputs and to post outputs. Therefore the jobs which use a different file transfer (ftp, s3) fail.
Describe the solution you'd like
use a docker image for the stage-in and stage-out containers, which will be able to use s3, http(curl), and ftp file transfer in tesp_api/service/event_actions.py
Implement a deciding logic that will use a correct method to download files based on the url prefix eg. httpftps3. Make the changes both in tesp_api/utils/docker.py and in tesp_api/utils/singularity.py. Don't forget the stage-out methods for both modules as well.
Describe alternatives you've considered
NA
Additional context
Add any other context or screenshots about the feature request here.
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
Currently the stage-in container uses only
curl
to downloadinputs
and to postoutputs
. Therefore the jobs which use a different file transfer (ftp, s3) fail.Describe the solution you'd like
stage-in
andstage-out
containers, which will be able to use s3, http(curl), and ftp file transfer in tesp_api/service/event_actions.pyhttp
ftp
s3
. Make the changes both in tesp_api/utils/docker.py and in tesp_api/utils/singularity.py. Don't forget thestage-out
methods for both modules as well.Describe alternatives you've considered
NA
Additional context
Add any other context or screenshots about the feature request here.
The text was updated successfully, but these errors were encountered: