Adding array operations unit test WDL

[tefirman]

Description

• Adding an "Array Operations" workflow that tests array operations and scatter-gather functionality by converting an array of strings to uppercase.

Related Issues

• Fixes Array of local task inputs localization #20

Testing

• Ran locally using miniwdl, succeeds.

[sitapriyamoorthi]

@tefirman this looks great! Wondering if we should add tests that specifically evaluate:

1. Empty arrays as inputs
2. A way to ensure elements of an array are correctly indexed
3. Verifying that the length, flatten and sort functions applied to arrays works
4. Maybe test array concatenation (overkill?)
5. Testing array of arrays works

Just some thoughts... feel free to comment on if all or some of these will be useful!

[tefirman]

@sitapriyamoorthi -- Great call. I added a few more tasks to implement your suggestions:

• ValidateIndex
• ArrayFunctions
• ArrayConcat
• Array of arrays as an input

Not super worried about empty arrays, but I did run it with an empty array and it seems to work fine. Mind taking another look?

[sitapriyamoorthi]

Hi @tefirman thanks for including those changes. Just a couple of things that would complete this unit test :

1. Could you add to test an array of integers (just so we complete the circle). And test that the integers are properly parsed (my assumption is something simple like addition of integers would test that)
2. Could you also add something that tests the intermediate declaration of an array of integers similar to what you have done for strings.
3. Could you also add a small part to test that an array of files are properly localized and can be correctly indexed.

Thanks!

[tefirman]

@sitapriyamoorthi -- added a few updates to address your suggestions:

1. See IntegerArrayOps task.
2. See more_numbers intermediate variable.
3. See FileArrayOps task.

Mind taking another look?

[sitapriyamoorthi]

Been reviewing it... will add my comments shortly..

[tefirman]

@sitapriyamoorthi -- Merged in your PR if you wanted to take another look.

[sitapriyamoorthi]

Looks good! @tefirman

[sitapriyamoorthi]

@tefirman I am holding back from squashing and merging just yet since technically I have not successfully got this to run on PROOF. Starting a thread on the proof channel to discuss this. My thoughts are that since it runs locally on miniwdl. The WDL itself works on a WDL runner but may or may not run on PROOF. Lets chat more there before merging.

[tefirman]

@sitapriyamoorthi -- Just confirmed that this WDL runs successfully in the proof-api-dev branch, so I'm going to merge this into main.