"Unknown" container state in aspire dashboard

[hades200082]

Is there an existing issue for this?

• I have searched the existing issues

Describe the bug

I'm having a problem with Aspire where it seems to randomly be unable to detect the state of containers. They show up as "Unknown" in the aspire dashboard. This causes the .WaitFor() to never see them as running preventing my stack from booting up.

It's not the same containers each time and sometimes it all spins up fine. Any ideas what might be going on?

When I check in Docker Desktop I can see the containers running just fine.

Expected Behavior

No response

Steps To Reproduce

No response

Exceptions (if any)

none seen

.NET Version info

.NET SDK:
Version: 8.0.303
Commit: 29ab8e3268
Workload version: 8.0.300-manifests.d7126b9e
MSBuild version: 17.10.4+10fbfbf2e

Runtime Environment:
OS Name: Windows
OS Version: 10.0.19045
OS Platform: Windows
RID: win-x64
Base Path: C:\Program Files\dotnet\sdk\8.0.303\

.NET workloads installed:
[aspire]
Installation Source: SDK 8.0.300
Manifest Version: 8.1.0/8.0.100
Manifest Path: C:\Program Files\dotnet\sdk-manifests\8.0.100\microsoft.net.sdk.aspire\8.1.0\WorkloadManifest.json
Install Type: Msi

Host:
Version: 8.0.7
Architecture: x64
Commit: 2aade6beb0

.NET SDKs installed:
3.1.426 [C:\Program Files\dotnet\sdk]
5.0.400 [C:\Program Files\dotnet\sdk]
5.0.408 [C:\Program Files\dotnet\sdk]
6.0.132 [C:\Program Files\dotnet\sdk]
6.0.202 [C:\Program Files\dotnet\sdk]
6.0.203 [C:\Program Files\dotnet\sdk]
6.0.321 [C:\Program Files\dotnet\sdk]
6.0.424 [C:\Program Files\dotnet\sdk]
7.0.120 [C:\Program Files\dotnet\sdk]
8.0.107 [C:\Program Files\dotnet\sdk]
8.0.200 [C:\Program Files\dotnet\sdk]
8.0.303 [C:\Program Files\dotnet\sdk]

.NET runtimes installed:
Microsoft.AspNetCore.App 3.1.18 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 3.1.32 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 5.0.9 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 5.0.17 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 6.0.5 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 6.0.26 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 6.0.27 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 6.0.32 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 7.0.20 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 8.0.2 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.AspNetCore.App 8.0.7 [C:\Program Files\dotnet\shared\Microsoft.AspNetCore.App]
Microsoft.NETCore.App 3.1.18 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 3.1.32 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 5.0.9 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 5.0.10 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 5.0.17 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 6.0.4 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 6.0.5 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 6.0.26 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 6.0.27 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 6.0.32 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 7.0.20 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 8.0.2 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.NETCore.App 8.0.7 [C:\Program Files\dotnet\shared\Microsoft.NETCore.App]
Microsoft.WindowsDesktop.App 3.1.18 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 3.1.32 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 5.0.9 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 5.0.10 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 5.0.17 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 6.0.4 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 6.0.5 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 6.0.26 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 6.0.27 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 6.0.32 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 7.0.20 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 8.0.2 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]
Microsoft.WindowsDesktop.App 8.0.7 [C:\Program Files\dotnet\shared\Microsoft.WindowsDesktop.App]

Other architectures found:
x86 [C:\Program Files (x86)\dotnet]
registered at [HKLM\SOFTWARE\dotnet\Setup\InstalledVersions\x86\InstallLocation]

Environment variables:
Not set

global.json file:
Not found

Learn more:
https://aka.ms/dotnet/info

Download .NET:
https://aka.ms/dotnet/download

Anything else?

No response

[karolz-ms]

@hades200082 thank you for reporting the issue, much appreciated. A few clarifying questions

1. Just to make sure all the binaries are as expected: when you run your application, could you verify dcp.exe comes from C:\Program Files\dotnet\packs\Aspire.Hosting.Orchestration.win-x64\8.1.0\tools\ (note version 8.1.0) and when you run

   & 'C:\Program Files\dotnet\packs\Aspire.Hosting.Orchestration.win-x64\8.1.0\tools\dcp.exe' version

   it reports version 0.5.7?

2. What version of Docker Desktop are you using?

3. How often do you encounter this? Every 10 runs, every 100 runs... ? Any errors/warnings in Aspire app host output?

[Alirexaa]

@karolz-ms, I see random Unknown state when running PostgresEndToEnd.AppHost in the playground.

[hades200082]

@karolz-ms

1

C:\Program Files\dotnet\packs\Aspire.Hosting.Orchestration.win-x64\8.1.0\tools>dcp version
{"version":"0.5.7","commitHash":"1ac6336f6fd9d61844304b3046a9391a980fad95","buildTimestamp":"2024-07-09T16:07:33Z"}

2

I updated Docker Desktop when I started having this issue as there was an update pending. After the update it seemed to behave worse than before, then stabilised for a while. I finished for the day shortly after that but will let you know how it goes today.

My current version of Docker Desktop is 4.33.0

3

It was almost every run for a while - each time different services/containers would show the "unknown" status. It felt random.

When it happens I stop the whole solution, wait for the containers to all vanish from Docker Desktop, then start the AppHost again.

I can restart in this manner 3-4 times before I get a run that shows everything as "Running". In some cases, I settle for having 1-2 "Unknown" as long as they are not services that my projects are using .WaitFor() with (i.e. things like RedisCommander or PGAdmin if I don't explicitly need them on that run.

Sometimes it can go multiple runs without happening.

[karolz-ms]

Thanks to both of you. Looks like we all have all correct, freshest bits.

I tried to use PostgresEndToEnd playground project to reproduce the issue. Did several runs in rapid succession, with- and without debugging (F5 and Ctrl-F5 in Visual Studio). No joy. 😞

@hades200082 or @Alirexaa could you add the following to the launch profile for the application that you can reproduce the problem with (these would go into environmentVariables object that is part of the launch profile):

        "DCP_DIAGNOSTICS_LOG_LEVEL": "debug",
        "DCP_DIAGNOSTICS_LOG_FOLDER": "C:\\Users\\karolz\\code\\scratch\\dcplogs\\issue5109"

(replacing the folder with your own as necessary).

Then (after the problem repros) look into the folder, there should be several files in it, but one that we are interested in, and by far the biggest, should be one that starts with dcpctrl. Please share the file with me, but be careful, there might be some sensitive info in it. Thank you ❤️

[hades200082]

@karolz-ms I added the environment variables as you suggested to the AppHost project:

However, it never created the logs folder.

[karolz-ms]

I am sorry, I should have mentioned this, that folder needs to be created in advance, before the app is run.

[hades200082]

@karolz-ms Still not getting any logs:

[Alirexaa]

@karolz-ms how can I share this file with you?
I should mention that I run this #5098.
Can you run this source?

[karolz-ms]

@Alirexaa you can send me an email (GH has the address) or via Discord I am karolzms there

Will try #5098 later today, thanks.

@hades200082 strange... this should have worked. You are changing app host launch profile, correct?

[Alirexaa]

@Alirexaa you can send me an email (GH has the address) or via Discord I am karolzms there

Please check your email.