[Testing] Fix for flaky UITests in CI - 2 #31763
Build #10.0.30-ci+pr.31763.azdo.1233893 had test failures
Details
- Failed: 8 (0.07%)
- Passed: 12,154 (98.78%)
- Other: 142 (1.15%)
- Total: 12,304
Annotations
Check failure on line 1597 in Build log
azure-pipelines / maui-pr-uitests
Build log #L1597
PowerShell exited with code '1'.
Check failure on line 977 in Build log
azure-pipelines / maui-pr-uitests
Build log #L977
PowerShell exited with code '1'.
Check failure on line 1392 in Build log
azure-pipelines / maui-pr-uitests
Build log #L1392
PowerShell exited with code '1'.
Check failure on line 23 in Build log
azure-pipelines / maui-pr-uitests
Build log #L23
There are one or more test failures detected in result files. Detailed summary of published test results can be viewed in the Tests tab.
azure-pipelines / maui-pr-uitests
Microsoft.Maui.TestCases.Tests.Issues.Issue28986_SafeAreaBorderOrientation(iOS).SafeAreaBorderMultipleOrientationChanges
Portrait X position should be consistent between multiple orientation cycles
Assert.That(Math.Abs(initialPortraitBounds.X - finalPortraitBounds.X), Is.LessThanOrEqualTo(positionTolerance))
Expected: less than or equal to 10.0d
But was: 375
Raw output
at Microsoft.Maui.TestCases.Tests.Issues.Issue28986_SafeAreaBorderOrientation.SafeAreaBorderMultipleOrientationChanges() in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/Issues/Issue28986_SafeAreaBorderOrientation.cs:line 198
1) at Microsoft.Maui.TestCases.Tests.Issues.Issue28986_SafeAreaBorderOrientation.SafeAreaBorderMultipleOrientationChanges() in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/Issues/Issue28986_SafeAreaBorderOrientation.cs:line 198
azure-pipelines / maui-pr-uitests
Microsoft.Maui.TestCases.Tests.Issues.Issue32394(Android).Issue32394CurrentItemShouldnotChange
VisualTestUtils.VisualTestFailedException :
Snapshot different than baseline: Issue32394CurrentItemShouldnotChange.png (1.03% difference)
If the correct baseline has changed (this isn't a a bug), then update the baseline image.
See test attachment or download the build artifacts to get the new snapshot file.
More info: https://aka.ms/visual-test-workflow
Raw output
at VisualTestUtils.VisualRegressionTester.Fail(String message) in /_/src/TestUtils/src/VisualTestUtils/VisualRegressionTester.cs:line 162
at VisualTestUtils.VisualRegressionTester.VerifyMatchesSnapshot(String name, ImageSnapshot actualImage, String environmentName, ITestContext testContext) in /_/src/TestUtils/src/VisualTestUtils/VisualRegressionTester.cs:line 123
at Microsoft.Maui.TestCases.Tests.UITest.<VerifyScreenshot>g__Verify|9_0(String name, <>c__DisplayClass9_0&) in /_/src/Controls/tests/TestCases.Shared.Tests/UITest.cs:line 367
at Microsoft.Maui.TestCases.Tests.UITest.VerifyScreenshot(String name, Nullable`1 retryDelay, Int32 cropLeft, Int32 cropRight, Int32 cropTop, Int32 cropBottom, Double tolerance) in /_/src/Controls/tests/TestCases.Shared.Tests/UITest.cs:line 209
at Microsoft.Maui.TestCases.Tests.Issues.Issue32394.Issue32394CurrentItemShouldnotChange() in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/Issues/Issue32394.cs:line 23
at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
at System.RuntimeMethodHandle.InvokeMethod(ObjectHandleOnStack target, Void** arguments, ObjectHandleOnStack sig, BOOL isConstructor, ObjectHandleOnStack result)
at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
azure-pipelines / maui-pr-uitests
Microsoft.Maui.TestCases.Tests.CarouselViewFeatureTests(iOS).VerifyCarouselViewWithScrollTo
System.TimeoutException : Timed out waiting for element...
Raw output
at UITest.Appium.HelperExtensions.Wait(Func`1 query, Func`2 satisfactory, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 2575
at UITest.Appium.HelperExtensions.WaitForElement(IApp app, String marked, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency, Nullable`1 postTimeout) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 745
at Microsoft.Maui.TestCases.Tests.CarouselViewFeatureTests.VerifyCarouselViewWithScrollTo() in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/FeatureMatrix/CarouselViewFeatureTests.cs:line 838
at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
azure-pipelines / maui-pr-uitests
Microsoft.Maui.TestCases.Tests.CarouselViewFeatureTests(iOS).VerifyCarouselViewWithScrollTo
System.TimeoutException : Timed out waiting for element...
Raw output
at UITest.Appium.HelperExtensions.Wait(Func`1 query, Func`2 satisfactory, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 2575
at UITest.Appium.HelperExtensions.WaitForElement(IApp app, String marked, String timeoutMessage, Nullable`1 timeout, Nullable`1 retryFrequency, Nullable`1 postTimeout) in /_/src/TestUtils/src/UITest.Appium/HelperExtensions.cs:line 745
at Microsoft.Maui.TestCases.Tests.CarouselViewFeatureTests.VerifyCarouselViewWithScrollTo() in /_/src/Controls/tests/TestCases.Shared.Tests/Tests/FeatureMatrix/CarouselViewFeatureTests.cs:line 838
at System.Reflection.MethodBaseInvoker.InterpretedInvoke_Method(Object obj, IntPtr* args)
at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)