Skip to content

iOS end-to-end tests #1063

iOS end-to-end tests

iOS end-to-end tests #1063

Manually triggered December 17, 2024 10:07
Status Failure
Total duration 20m 15s
Artifacts 5

ios-end-to-end-tests.yml

on: workflow_dispatch
Set up outputs directory
5s
Set up outputs directory
Define test suites matrix
4s
Define test suites matrix
Build for end to end testing
3m 19s
Build for end to end testing
Matrix: Run tests
Clean up outputs directory
7s
Clean up outputs directory
Notify team on failure(if PR related)
0s
Notify team on failure(if PR related)
Fit to window
Zoom out
Zoom in

Annotations

22 errors, 4 warnings, and 2 notices
Run tests (AccountTests): ios/MullvadVPNUITests/Networking/MullvadAPIWrapper.swift#L114
testCreateAccount, failed - Failed to delete account with error: The operation couldn’t be completed. (MullvadVPNUITests.ApiError error 1.)
Run tests (AccountTests): ios/MullvadVPNUITests/Networking/MullvadAPIWrapper.swift#L134
testLoginToAccountWithTooManyDevices, failed - Failed to add device with error: The operation couldn’t be completed. (MullvadVPNUITests.ApiError error 1.)
Run tests (AccountTests): ios/MullvadVPNUITests/Networking/MullvadAPIWrapper.swift#L181
testLogOut, failed - Failed to get devices with error: The operation couldn’t be completed. (MullvadVPNUITests.ApiError error 1.)
Run tests (AccountTests): ios/MullvadVPNUITests/Networking/MullvadAPIWrapper.swift#L161
testTimeLeft, failed - Failed to get account expiry with error: The operation couldn’t be completed. (MullvadVPNUITests.ApiError error 1.)
Run tests (AccountTests)
Process completed with exit code 65.
Run tests (ConnectivityTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testAPIReachableWhenBlocked, XCTAssertTrue failed - Page is shown
Run tests (ConnectivityTests)
Process completed with exit code 65.
Run tests (CustomListsTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testAddSingleLocationToCustomList, XCTAssertTrue failed - Page is shown
Run tests (CustomListsTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testCreateCustomListPersistAfterAppRestarts, XCTAssertTrue failed - Page is shown
Run tests (CustomListsTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testDeleteCustomList, XCTAssertTrue failed - Page is shown
Run tests (CustomListsTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testEditCustomListLocations, XCTAssertTrue failed - Page is shown
Run tests (CustomListsTests)
Process completed with exit code 65.
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testAdBlockingViaDNS, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testAppConnection, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testConnectionRetryLogic, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testCustomDNS, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testDAITASettings, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testMultihopSettings, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testWireGuardOverShadowsocksManually, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testWireGuardOverTCPAutomatically, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testWireGuardOverTCPManually, XCTAssertTrue failed - Page is shown
Run tests (RelayTests): ios/MullvadVPNUITests/Pages/Page.swift#L24
testWireGuardPortSettings, XCTAssertTrue failed - Page is shown
Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Build for end to end testing
The `set-output` command is deprecated and will be disabled soon. Please upgrade to using Environment Files. For more information see: https://github.blog/changelog/2022-10-11-github-actions-deprecating-save-state-and-set-output-commands/
Run tests (ConnectivityTests)
Skipped MullvadVPNUITests.ConnectivityTests.testAPIConnectionViaBridges
Run tests (ConnectivityTests)
Skipped MullvadVPNUITests.ConnectivityTests.testAppStillFunctioningWhenAPIDown

Artifacts

Produced during runtime
Name Size
MullvadVPNUITests_AccountTests-test-results
80.3 MB
MullvadVPNUITests_ConnectivityTests-test-results
18 MB
MullvadVPNUITests_CustomListsTests-test-results
89.4 MB
MullvadVPNUITests_RelayTests-test-results
250 MB
MullvadVPNUITests_SettingsTests-test-results
113 KB