-
Notifications
You must be signed in to change notification settings - Fork 19
Phase 3 Test Results
Yurii Lisovskyi edited this page Aug 16, 2023
·
15 revisions
Phase | Features | SoW Count | Real Count |
---|---|---|---|
Phase 3 | 100 | 103 | |
ECMP | 7 | 7 | |
LACP | 3 | 3 | |
LACP Interaction | 15 | 16 | |
LLDP | 17 | 17 | |
STP RSTP | 25 | 26 | |
HardDropCounters | 3 | 3 | |
Table Sizes | 3 | 3 | |
ifupdown2 | 9 | 10 | |
VRRP | 18 | 18 |
Test Run Status
SIT setup
Status | 08/11 |
---|---|
PASS | 293 |
FAIL | 6 |
XPASS | 0 |
XFAIL | 2 |
SKIPPED | 20 |
Report | Link |
The most recent fails:
- (1) devlink fail, fixed in https://github.com/dentproject/testing/pull/389
- (1) IGMP fail due to https://github.com/dentproject/testing/issues/337
- (1) IPv6 fail due to https://github.com/dentproject/testing/issues/391
- (2) LACP fails due to https://github.com/dentproject/testing/issues/352
- (1) LACP fail due to [{'ixia': {'command': 'stop_traffic', 'rc': -1, 'result': ' Timeout - no response after 20s.\n'}}]
Skipped tests:
- (20) L1 tests due to unsupported port speeds on Ixia card
Aldrin2, AS5114
Status | 06/24 | 07/02 | 07/08 | 07/14 | 07/25 | 08/02 |
---|---|---|---|---|---|---|
PASS | 225 | 245 | 255 | 259 | 269 | 273 |
FAIL | 13 | 18 | 11 | 14 | 12 | 8 |
XPASS | 0 | 0 | 0 | 0 | 0 | 0 |
XFAIL | 2 | 2 | 2 | 2 | 2 | 2 |
SKIPPED | 25 | 25 | 35 | 38 | 38 | 38 |
Report |
Link 1 Link 2 |
Link | Link | Link | Link | Link |
The most recent fails:
- (1) ifupdown fail, fixed in https://github.com/dentproject/testing/pull/380
- (1) IGMP fail due to https://github.com/dentproject/testing/issues/337
- (4) LACP fails, fixed in https://github.com/dentproject/testing/pull/389
- (1) Policer fail, fixed in https://github.com/dentproject/testing/pull/389
- (1) STP fail, fixed in https://github.com/dentproject/testing/pull/389
Skipped tests:
- (19) L1 tests due to unsupported port speeds on Ixia card
- (19) VRRP tests are run separately
AC3x, TN48M-P-DN
Status | 06/24 | 07/02 | 07/08 | 07/14 | 07/25 | 08/02 |
---|---|---|---|---|---|---|
PASS | 225 | 251 | 253 | 257 | 260 | 280 |
FAIL | 30 | 24 | 9 | 12 | 17 | 6 |
XPASS | 0 | 0 | 0 | 0 | 0 | 0 |
XFAIL | 2 | 2 | 2 | 2 | 2 | 2 |
SKIPPED | 8 | 13 | 20 | 23 | 42 | 33 |
Report | Link | Link | Link | Link | Link | Link |
The most recent fails:
- (2) L1 fails due to new card added, fixed in https://github.com/dentproject/testing/pull/389
- (1) ifupdown fail, fixed in https://github.com/dentproject/testing/pull/380
- (1) IGMP fail due to https://github.com/dentproject/testing/issues/337
- (1) IPv6 fail, fixed in https://github.com/dentproject/testing/pull/389
- (1) STP fail, fixed in https://github.com/dentproject/testing/pull/389
Skipped tests:
- (14) L1 tests due to unsupported port speeds on Ixia card
- (19) VRRP tests are run separately
VRRP tests (2 x Alrdin2, 1 x AC3x)
Status | 06/24 | 07/02 | 07/08 | 07/14 |
---|---|---|---|---|
PASS | 6 | 6 | 15 | 18 |
FAIL | 0 | 0 | 0 | 0 |
XPASS | 0 | 0 | 0 | 0 |
XFAIL | 0 | 0 | 0 | 0 |
SKIPPED | 0 | 0 | 0 | 0 |
Report | Link | Link | Link | Link |
Test Results March 7 2023
- 2023-04-30 AC3X
- 2023-04-30 Aldrin2
- 2023-05-07 AC3X
- 2023-05-07 Aldrin2
- 2023-05-21 AC3X
- 2023-05-21 Aldrin2
- 2023-05-25 Aldrin2
- 2023-05-26 AC3X
- 2023-05-26 Aldrin2
- 2023-05-28 AC3X
- 2023-05-28 Aldrin2
- 2023-06-24 AC3x
- 2023-06-24 Aldrin2 (1)
- 2023-06-24 Aldrin2 (2)
- 2023-07-02 AC3x
- 2023-07-02 Aldrin2
- 2023-07-08 AC3x
- 2023-07-08 Aldrin2
- 2023-07-14 AC3x
- 2023-07-14 Aldrin2
### Archive meeting notes