test: testing using ReTestItems

[avik-pal]

See https://github.com/JuliaTesting/ReTestItems.jl

The main benefits are

• parallel testing (not super relevant for GH Actions since they are 2 core machines but helps a lot on the buildkite ones)
• prevents stuff from spilling over to other files
• loads Reactant and Test in every @testitem block automatically
• lets you run specific tests locally by specifying name = ...

[avik-pal]

@wsmoses can you make the buildkite pipeline public?

[wsmoses]

@avik-pal pipeline should be public now

[mofeing]

@avik-pal I have a couple of questions:

• does TestItems allow for some form of hierarchical organization like @testset?
• the parallelization is thread- or process-based? if it's thread-based, @wsmoses do we know if XLA compilation is thread-safe?

[wsmoses]

Compilation ought be, but cpu is multi core so we shouldn’t do multiple concurrent tests

…

On Sun, Jul 28, 2024 at 12:51 PM Sergio Sánchez Ramírez < ***@***.***> wrote: @avik-pal <https://github.com/avik-pal> I have a couple of questions: - does TestItems allow for some form of hierarchical organization like @testset? - the parallelization is thread- or process-based? if it's thread-based, @wsmoses <https://github.com/wsmoses> do we know if XLA compilation is thread-safe? — Reply to this email directly, view it on GitHub <#56 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAJTUXDJUHDBKXQ4GR42BU3ZOUOSNAVCNFSM6AAAAABLRKPPFGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDENJUGU3TQNZSGM> . You are receiving this because you were mentioned.Message ID: ***@***.***>

[avik-pal]

does TestItems allow for some form of hierarchical organization like @testset?

ReTestItems' @testitem is a superset of the @testitem from TestItems.jl. Inside a @testitem you can have hierarchical @testsets. You can think of a @testitem as a module isolating the environment of the test.

the parallelization is thread- or process-based?

It is process-based.

One nice thing about it is that it lets a test crash julia without crashing the main test process.