[E2E] macos tray test automation

[adrianriobo]

Solution/Idea

Add E2E automation tests for macos tray. The automation for mac will use native solution based on applescripts to interact with the tray.

This PR includes the implementation for the initial set of e2e scenarios for ux components on MacOS platform. To accommodate that implementation a refactor on the testing structure was required in order to expand and reuse the functionality among all different types of test (integration and e2e)

Downstream CI run results for this PR:

• windows
• mac
• rhel

The required parameters to run the ux scenarios are still missing on the downstream CI, ux feature was run manually on a mac instance with the current CRC version (1.25.0):

make -C macos_tray e2e GODOG_OPTS="--godog.tags='@darwin && @ux' --godog.format=junit" \
                BUNDLE_LOCATION="--bundle-location=''" \
                PULL_SECRET_FILE="--pull-secret-file=pull-secret" \
                INSTALLER_PATH="--installer-path=crc-macos-amd64.pkg" \
                USER_PASSWORD="--user-password=XXXX"

resulting on:

<?xml version="1.0" encoding="UTF-8"?>
<testsuites name="crc" tests="7" skipped="0" failures="1" errors="0" time="1354.117782704">
  <testsuite name="Basic test" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
  <testsuite name="Behind proxy test" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
  <testsuite name="Certificate rotation test" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
  <testsuite name="End-to-end health check" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
  <testsuite name="Local image to image-registry" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
  <testsuite name="Operator from marketplace" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
  <testsuite name="Test configuration settings" tests="0" skipped="0" failures="0" errors="0" time="0"></testsuite>
  <testsuite name="ux" tests="7" skipped="0" failures="1" errors="0" time="1354.113146961">
    <testcase name="Install CRC" status="passed" time="33.613631749"></testcase>
    <testcase name="Install tray" status="passed" time="75.117393328"></testcase>
    <testcase name="Start Cluster" status="passed" time="476.660750086"></testcase>
    <testcase name="Connect the cluster #1" status="passed" time="16.173251692"></testcase>
    <testcase name="Connect the cluster #2" status="passed" time="30.273120298"></testcase>
    <testcase name="Stop Cluster" status="failed" time="323.139393178">
      <failure message="Step user should get notified with cluster state as stopped: notification: The OpenShift Cluster was successfully stopped. Timeout"></failure>
    </testcase>
    <testcase name="Restart Cluster" status="passed" time="348.496128553"></testcase>
  </testsuite>
</testsuites>

*errors are directly realated with tray-macos issue #84

[centos-ci]

Can one of the admins verify this patch?

[adrianriobo]

Related to #2190 current install scenario fails randomly

[guillaumerose]

Can you rebase ? Otherwise,
/lgtm

Thanks a lot for automating this!

[jsliacan]

Thanks for refactoring :). I left a few minor comments and I didn't check if the build tags are all well placed. But I assume they are since you ran it on all platforms. Otherwise LGTM!

[openshift-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: adrianriobo, jsliacan

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [jsliacan]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[openshift-ci-robot]

New changes are detected. LGTM label has been removed.

[guillaumerose]

/retest

[guillaumerose]

Looks good. Let's use them for the next release.