Use this or the one in the MAUI repository

[ymebrugts]

The dotnet MAUI repo has device tests embedded as well: https://github.com/dotnet/maui/tree/main/src/TestUtils/src
Should I use this project as a basis or the one in the MAUI repo? They don't seem to be using the same setup.

This project is referenced by the official documentation but hasn't been updated for 6 months.

The MAUI repo device runner tests have been updated recently but haven't been mentioned in official documentation

Kind regards,
Yme

[kamranayub]

I've had success setting up and using this one. But I would be interested to know what the plan for this is; it feels like this should be owned by MS for .NET MAUI testing 😃

[ymebrugts]

Yeah agreed. It's a very nice setup. As a reference for anyone else: I managed to get this working for on platform testing (instrumented testing), for UI testing we use Appium with Nunit. This setup works in an Azure Pipeline as well but it's not stable enough on MacOS Microsoft hosted agents. You need to self host afaik, at least until Microsoft delivers MacOS Agents with Apple silicon.

[mattleibow]

I think I managed to cheat a bit with building on the new macs and then just running the app on the older ones.

I need to update the example workflows.

But I am looking forward to new macs.

[ymebrugts]

Oh really? That's nice! The building was actually not the issue for us. I was having issues with phone & app startup timeouts and run timeouts, a few different ones resulting in a success once in ~5-10 runs on the Microsoft Hosted agents. It could hit the 60 minute runtime cap as well. It would cycle through about 5 errors. This probably has nothing to do with this library but the surrounding infrastructure and/or our apps. Still it was fixed on self hosted and it's now very fast and reliable. It would be interesting to see the Azure DevOps yaml which allowed you to run on the Microsoft Hosted agents without performance issues.

[mattleibow]

The MAUI ones are specific to MAUi and have really been customized for that repo.

This repo is more of an extraction and refinement for general use. I am using it, for example, in the SkiaSharp repos. It does not get much updates because it is perfect (lol, ok, I have been busy).

But, if this needs any features or bugfixes, feel free to open an issue or PR.I have a dream to migrate MAUI onto this and drop the custom runner and XHarness tests, but for now it is hard since this depends on maui and maui will depend on this... So circles are hard.

Maui is mostly mature enough that it should not have issues with a circular dependency, but I am also looking to have a non-UI (XHarness style) mechanism to run tests. No need ot spin up a maui app just to check BCL code. This is an idea, so nothing concrete.

But, a TL;DR, use this. The MAUI one is very bespoke. This repo is copied form MAUI and refined.

[Rudhra-balan]

Using device runner can we collect the code coverage for maui project.