Test failures are reported as Passed

[primitivetypo]

I am running some testng test with cucumber and when test fails after an assertion on dashboard it appears as “Passed”. Any ideas what might be causing this?

[saikrishna321]

Can you share a screenshot ?

[sudharsan-selvaraj]

@primitivetypo This is a known issue in appium-dashboard plugin.

Currently, we don't have a concrete logic to determine if test execution is pass/fail. We just check all appium commands except findElement and isDisplayed for any errors. if those commands result in an error, we mark those tests as failed. We also provide an option to update the test status from the code.

Java client:

driver.executeScript("dashboard: updateStatus", ImmutableMap.of("status", "passed"));

Webdriver.IO:

driver.executeScript("dashboard: updateStatus", [{status: "passed"}]);

[primitivetypo]

Thanks @sudharsan-selvaraj the updateStatus execute script was flawless.