Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docker is stuck at "Docker Desktop is stopping" after a minute of running containers #6549

Open
3 tasks done
atticusmatticus opened this issue Oct 30, 2022 · 44 comments
Open
3 tasks done

Comments

@atticusmatticus
Copy link

atticusmatticus commented Oct 30, 2022

  • I have tried with the latest version of Docker Desktop
  • I have tried disabling enabled experimental features
  • I have uploaded Diagnostics
  • Diagnostics ID: 15D32DF4-AF1F-431A-9322-72C869E6673C/20221030144506

Expected behavior

Before this started happening a day or so ago, I would start Docker Desktop and run docker-compose up -d and my containers would start and remain on and operational for days.

Actual behavior

Now, I run the same command with Docker Desktop running and within a minute or two Docker Desktop says "Docker Desktop is stopping" and never resolves from this issue. I have to force quit the application and all it's subprocesses to stop it and repeat trying to start it up. It always enters this endless loop of "stopping" within a couple minutes of running docker-compose up -d.

Information

Please, help us understand the problem. For instance:

  • Is it reproducible? Yes
  • Is the problem new? Yes (only started occurring within last week)
  • Did the problem appear with an update? Not sure
  • macOS Version: 12.6
  • Intel chip or Apple chip: Apple M1
  • Docker Desktop Version: 4.13.0

Output of /Applications/Docker.app/Contents/MacOS/com.docker.diagnose check

Prior to Docker Desktop getting frozen in this "stopping" state all diagnose checks pass. After the "stopping" message the checks are as follows:

Starting diagnostics

[PASS] DD0027: is there available disk space on the host?
[PASS] DD0028: is there available VM disk space?
[PASS] DD0018: does the host support virtualization?
[PASS] DD0001: is the application running?
[PASS] DD0017: can a VM be started?
[PASS] DD0016: is the LinuxKit VM running?
[FAIL] DD0011: are the LinuxKit services running? failed to ping VM diagnosticsd with error: Get "http://ipc/ping": EOF
[2022-10-30T14:13:07.436819000Z][com.docker.diagnose][I] ipc.NewClient: 1a1f02ca-diagnose -> diagnosticd.sock diagnosticsd
[common/pkg/diagkit/gather/diagnose.glob..func12()
[	common/pkg/diagkit/gather/diagnose/linuxkit.go:18 +0x8c
[common/pkg/diagkit/gather/diagnose.(*test).GetResult(0x1018d7960)
[	common/pkg/diagkit/gather/diagnose/test.go:46 +0x40
[common/pkg/diagkit/gather/diagnose.Run.func1(0x1018d7960)
[	common/pkg/diagkit/gather/diagnose/run.go:17 +0x40
[common/pkg/diagkit/gather/diagnose.walkOnce.func1(0x4?, 0x1018d7960)
[	common/pkg/diagkit/gather/diagnose/run.go:142 +0x80
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x3, 0x1018d7960, 0x14000687718)
[	common/pkg/diagkit/gather/diagnose/run.go:151 +0x88
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x2, 0x1018d79e0, 0x14000687718)
[	common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x1, 0x1018d7ae0, 0x14000687718)
[	common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x0, 0x1018d7d60, 0x14000687718)
[	common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkOnce(0x101395a60?, 0x140003df890)
[	common/pkg/diagkit/gather/diagnose/run.go:137 +0x8c
[common/pkg/diagkit/gather/diagnose.Run(0x1018d7d60, 0x1400039f360?, {0x140003dfb08, 0x1, 0x1})
[	common/pkg/diagkit/gather/diagnose/run.go:16 +0x160
[main.checkCmd({0x140001ac010?, 0x6?, 0x4?}, {0x0, 0x0})
[	common/cmd/com.docker.diagnose/main.go:133 +0xdc
[main.main()
[	common/cmd/com.docker.diagnose/main.go:99 +0x30c
[2022-10-30T14:13:07.437522000Z][com.docker.diagnose][I] (a0b35a03) 1a1f02ca-diagnose C->S diagnosticsd GET /ping
[2022-10-30T14:13:07.438478000Z][com.docker.diagnose][W] (a0b35a03) 1a1f02ca-diagnose C<-S NoResponse GET /ping (951.459µs): Get "http://ipc/ping": EOF

[FAIL] DD0004: is the Docker engine running? Get "http://ipc/docker": EOF
[2022-10-30T14:13:07.438846000Z][com.docker.diagnose][I] ipc.NewClient: 2020fbbb-com.docker.diagnose -> lifecycle-server.sock VMDockerdAPI
[linuxkit/pkg/desktop-host-tools/pkg/client.NewClientForPath(...)
[	linuxkit/pkg/desktop-host-tools/pkg/client/client.go:59
[linuxkit/pkg/desktop-host-tools/pkg/client.NewClient({0x1011ca073, 0x13})
[	linuxkit/pkg/desktop-host-tools/pkg/client/client.go:53 +0x90
[common/pkg/diagkit/gather/diagnose.isDockerEngineRunning()
[	common/pkg/diagkit/gather/diagnose/dockerd.go:21 +0x28
[common/pkg/diagkit/gather/diagnose.(*test).GetResult(0x1018d79e0)
[	common/pkg/diagkit/gather/diagnose/test.go:46 +0x40
[common/pkg/diagkit/gather/diagnose.Run.func1(0x1018d79e0)
[	common/pkg/diagkit/gather/diagnose/run.go:17 +0x40
[common/pkg/diagkit/gather/diagnose.walkOnce.func1(0x3?, 0x1018d79e0)
[	common/pkg/diagkit/gather/diagnose/run.go:142 +0x80
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x2, 0x1018d79e0, 0x14000687718)
[	common/pkg/diagkit/gather/diagnose/run.go:151 +0x88
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x1, 0x1018d7ae0, 0x14000687718)
[	common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x0, 0x1018d7d60, 0x14000687718)
[	common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkOnce(0x101395a60?, 0x140003df890)
[	common/pkg/diagkit/gather/diagnose/run.go:137 +0x8c
[common/pkg/diagkit/gather/diagnose.Run(0x1018d7d60, 0x1400039f360?, {0x140003dfb08, 0x1, 0x1})
[	common/pkg/diagkit/gather/diagnose/run.go:16 +0x160
[main.checkCmd({0x140001ac010?, 0x6?, 0x4?}, {0x0, 0x0})
[	common/cmd/com.docker.diagnose/main.go:133 +0xdc
[main.main()
[	common/cmd/com.docker.diagnose/main.go:99 +0x30c
[2022-10-30T14:13:07.439957000Z][com.docker.diagnose][I] (7637a29f) 2020fbbb-com.docker.diagnose C->S VMDockerdAPI GET /docker
[2022-10-30T14:13:07.440704000Z][com.docker.diagnose][W] (7637a29f) 2020fbbb-com.docker.diagnose C<-S NoResponse GET /docker (744.792µs): Get "http://ipc/docker": EOF
[2022-10-30T14:13:07.440875000Z][com.docker.diagnose][I] (7637a29f-1) 2020fbbb-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-30T14:13:07.441576000Z][com.docker.diagnose][W] (7637a29f-1) 2020fbbb-com.docker.diagnose C<-S NoResponse GET /ping (697.542µs): Get "http://ipc/ping": EOF
[2022-10-30T14:13:08.442858000Z][com.docker.diagnose][I] (7637a29f-2) 2020fbbb-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-30T14:13:08.445849000Z][com.docker.diagnose][W] (7637a29f-2) 2020fbbb-com.docker.diagnose C<-S NoResponse GET /ping (3.0115ms): Get "http://ipc/ping": EOF
[2022-10-30T14:13:09.446989000Z][com.docker.diagnose][I] (7637a29f-3) 2020fbbb-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-30T14:13:09.449207000Z][com.docker.diagnose][W] (7637a29f-3) 2020fbbb-com.docker.diagnose C<-S NoResponse GET /ping (2.22775ms): Get "http://ipc/ping": EOF
[2022-10-30T14:13:10.450113000Z][com.docker.diagnose][I] (7637a29f-4) 2020fbbb-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-30T14:13:10.452341000Z][com.docker.diagnose][W] (7637a29f-4) 2020fbbb-com.docker.diagnose C<-S NoResponse GET /ping (2.231875ms): Get "http://ipc/ping": EOF
[2022-10-30T14:13:11.453192000Z][com.docker.diagnose][I] (7637a29f-5) 2020fbbb-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-30T14:13:11.455454000Z][com.docker.diagnose][W] (7637a29f-5) 2020fbbb-com.docker.diagnose C<-S NoResponse GET /ping (2.256417ms): Get "http://ipc/ping": EOF
[2022-10-30T14:13:12.457677000Z][com.docker.diagnose][I] (7637a29f-6) 2020fbbb-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-30T14:13:12.459683000Z][com.docker.diagnose][W] (7637a29f-6) 2020fbbb-com.docker.diagnose C<-S NoResponse GET /ping (2.003791ms): Get "http://ipc/ping": EOF
[2022-10-30T14:13:13.460218000Z][com.docker.diagnose][I] (7637a29f-7) 2020fbbb-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-30T14:13:13.463119000Z][com.docker.diagnose][W] (7637a29f-7) 2020fbbb-com.docker.diagnose C<-S NoResponse GET /ping (2.893708ms): Get "http://ipc/ping": EOF
[2022-10-30T14:13:14.464410000Z][com.docker.diagnose][I] (7637a29f-8) 2020fbbb-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-30T14:13:14.467364000Z][com.docker.diagnose][W] (7637a29f-8) 2020fbbb-com.docker.diagnose C<-S NoResponse GET /ping (2.958916ms): Get "http://ipc/ping": EOF

[PASS] DD0015: are the binary symlinks installed?
[FAIL] DD0031: does the Docker API work? error during connect: Get "http://docker.raw.sock/v1.24/containers/json?limit=0": EOF
[PASS] DD0013: is the $PATH ok?
Error response from daemon: Bad response from Docker engine
[FAIL] DD0003: is the Docker CLI working? exit status 1
[FAIL] DD0014: are the backend processes running? 1 error occurred:
	* com.docker.vpnkit is not running


[PASS] DD0007: is the backend responding?
[PASS] DD0008: is the native API responding?
[PASS] DD0009: is the vpnkit API responding?
[PASS] DD0010: is the Docker API proxy responding?
[FAIL] DD0012: is the VM networking working? network checks failed: Post "http://ipc/check-network-connectivity": EOF
[2022-10-30T14:13:15.449502000Z][com.docker.diagnose][I] ipc.NewClient: b06d6e5d-diagnose-network -> diagnosticd.sock diagnosticsd
[common/pkg/diagkit/gather/diagnose.runIsVMNetworkingOK()
[	common/pkg/diagkit/gather/diagnose/network.go:34 +0xc8
[common/pkg/diagkit/gather/diagnose.(*test).GetResult(0x1018d7be0)
[	common/pkg/diagkit/gather/diagnose/test.go:46 +0x40
[common/pkg/diagkit/gather/diagnose.Run.func1(0x1018d7be0)
[	common/pkg/diagkit/gather/diagnose/run.go:17 +0x40
[common/pkg/diagkit/gather/diagnose.walkOnce.func1(0x2?, 0x1018d7be0)
[	common/pkg/diagkit/gather/diagnose/run.go:142 +0x80
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x1, 0x1018d7be0, 0x14000687718)
[	common/pkg/diagkit/gather/diagnose/run.go:151 +0x88
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x0, 0x1018d7d60, 0x14000687718)
[	common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkOnce(0x101395a60?, 0x140003df890)
[	common/pkg/diagkit/gather/diagnose/run.go:137 +0x8c
[common/pkg/diagkit/gather/diagnose.Run(0x1018d7d60, 0x1400039f360?, {0x140003dfb08, 0x1, 0x1})
[	common/pkg/diagkit/gather/diagnose/run.go:16 +0x160
[main.checkCmd({0x140001ac010?, 0x6?, 0x4?}, {0x0, 0x0})
[	common/cmd/com.docker.diagnose/main.go:133 +0xdc
[main.main()
[	common/cmd/com.docker.diagnose/main.go:99 +0x30c
[2022-10-30T14:13:15.450138000Z][com.docker.diagnose][I] (7387d430) b06d6e5d-diagnose-network C->S diagnosticsd POST /check-network-connectivity: {"ips":["10.0.0.239","169.254.230.252"]}
[2022-10-30T14:13:15.450708000Z][com.docker.diagnose][W] (7387d430) b06d6e5d-diagnose-network C<-S NoResponse POST /check-network-connectivity (671.875µs): Post "http://ipc/check-network-connectivity": EOF
[2022-10-30T14:13:15.450889000Z][com.docker.diagnose][I] (7387d430-1) b06d6e5d-diagnose-network C->S diagnosticsd GET /ping
[2022-10-30T14:13:15.451319000Z][com.docker.diagnose][W] (7387d430-1) b06d6e5d-diagnose-network C<-S NoResponse GET /ping (428.75µs): Get "http://ipc/ping": EOF
[2022-10-30T14:13:16.451707000Z][com.docker.diagnose][I] (7387d430-2) b06d6e5d-diagnose-network C->S diagnosticsd GET /ping
[2022-10-30T14:13:16.454604000Z][com.docker.diagnose][W] (7387d430-2) b06d6e5d-diagnose-network C<-S NoResponse GET /ping (2.891209ms): Get "http://ipc/ping": EOF
[2022-10-30T14:13:17.455738000Z][com.docker.diagnose][I] (7387d430-3) b06d6e5d-diagnose-network C->S diagnosticsd GET /ping
[2022-10-30T14:13:17.458461000Z][com.docker.diagnose][W] (7387d430-3) b06d6e5d-diagnose-network C<-S NoResponse GET /ping (2.718167ms): Get "http://ipc/ping": EOF
[2022-10-30T14:13:18.461016000Z][com.docker.diagnose][I] (7387d430-4) b06d6e5d-diagnose-network C->S diagnosticsd GET /ping
[2022-10-30T14:13:18.463667000Z][com.docker.diagnose][W] (7387d430-4) b06d6e5d-diagnose-network C<-S NoResponse GET /ping (2.641167ms): Get "http://ipc/ping": EOF
[2022-10-30T14:13:19.464624000Z][com.docker.diagnose][I] (7387d430-5) b06d6e5d-diagnose-network C->S diagnosticsd GET /ping
[2022-10-30T14:13:19.467504000Z][com.docker.diagnose][W] (7387d430-5) b06d6e5d-diagnose-network C<-S NoResponse GET /ping (2.87575ms): Get "http://ipc/ping": EOF
[2022-10-30T14:13:20.468782000Z][com.docker.diagnose][I] (7387d430-6) b06d6e5d-diagnose-network C->S diagnosticsd GET /ping
[2022-10-30T14:13:20.470550000Z][com.docker.diagnose][W] (7387d430-6) b06d6e5d-diagnose-network C<-S NoResponse GET /ping (1.7595ms): Get "http://ipc/ping": EOF
[2022-10-30T14:13:21.471121000Z][com.docker.diagnose][I] (7387d430-7) b06d6e5d-diagnose-network C->S diagnosticsd GET /ping
[2022-10-30T14:13:21.473142000Z][com.docker.diagnose][W] (7387d430-7) b06d6e5d-diagnose-network C<-S NoResponse GET /ping (2.010667ms): Get "http://ipc/ping": EOF
[2022-10-30T14:13:22.473666000Z][com.docker.diagnose][I] (7387d430-8) b06d6e5d-diagnose-network C->S diagnosticsd GET /ping
[2022-10-30T14:13:22.476282000Z][com.docker.diagnose][W] (7387d430-8) b06d6e5d-diagnose-network C<-S NoResponse GET /ping (2.620458ms): Get "http://ipc/ping": EOF

[SKIP] DD0030: is the image access management authorized?
[PASS] DD0019: is the com.docker.vmnetd process responding?
[PASS] DD0033: does the host have Internet access?
[PASS] DD0018: does the host support virtualization?
[PASS] DD0001: is the application running?
[PASS] DD0017: can a VM be started?
[PASS] DD0016: is the LinuxKit VM running?
[WARN] DD0011: are the LinuxKit services running? failed to ping VM diagnosticsd with error: Get "http://ipc/ping": EOF
[WARN] DD0004: is the Docker engine running? Get "http://ipc/docker": EOF
[PASS] DD0015: are the binary symlinks installed?
[WARN] DD0031: does the Docker API work? error during connect: Get "http://docker.raw.sock/v1.24/containers/json?limit=0": EOF
[WARN] DD0032: do Docker networks overlap with host IPs? error during connect: Get "http://docker.raw.sock/v1.24/networks": EOF

Please note the following 4 warnings:

1 : The check: are the LinuxKit services running?
    Produced the following warning: failed to ping VM diagnosticsd with error: Get "http://ipc/ping": EOF

The Docker engine runs inside a Linux VM as a service. Therefore the services must have started.

2 : The check: is the Docker engine running?
    Produced the following warning: Get "http://ipc/docker": EOF

The Docker engine manages all containers and images on the host. Check the dockerd.log to see why it failed to start.

3 : The check: does the Docker API work?
    Produced the following warning: error during connect: Get "http://docker.raw.sock/v1.24/containers/json?limit=0": EOF

If the Docker API is not available from the host then Docker Desktop will not work correctly.

4 : The check: do Docker networks overlap with host IPs?
    Produced the following warning: error during connect: Get "http://docker.raw.sock/v1.24/networks": EOF

If the subnet used by a Docker network overlaps with an IP used by the host, then containers
won't be able to contact the overlapping IP addresses.

Try configuring the IP address range used by networks: in your docker-compose.yml.
See https://docs.docker.com/compose/compose-file/compose-file-v2/#ipv4_address-ipv6_address


Please investigate the following 3 issues:

1 : The test: are the LinuxKit services running?
    Failed with: failed to ping VM diagnosticsd with error: Get "http://ipc/ping": EOF

The Docker engine runs inside a Linux VM as a service. Therefore the services must have started.

2 : The test: are the backend processes running?
    Failed with: 1 error occurred:
	* com.docker.vpnkit is not running



Not all of the backend processes are running.

3 : The test: is the VM networking working?
    Failed with: network checks failed: Post "http://ipc/check-network-connectivity": EOF

VM seems to have a network connectivity issue. Check your host firewall and anti-virus settings in case they are blocking the VM.

Steps to reproduce the behavior

  1. Docker Desktop is running
  2. Run docker-compose up -d to start containers
  3. Wait a minute or so
  4. Docker Desktop gives message "Docker Desktop is stopping" which never stops.
@abcdelf
Copy link

abcdelf commented Oct 30, 2022

same issue. M1 Pro.

@fskaeh
Copy link

fskaeh commented Oct 30, 2022

Probably a duplicate of this docker/for-win#13025, there have been a few related issues opened in the last few days. I faced the same thing on a Mac Mini M1, with Docker 4.13.0. I got it working again by reverting to 4.12.

@pentatonicfunk
Copy link

Got the similar issue, but its after a while of running containers, it stopped suddenly, tried "restart" in docker desktop also stuck, had to quit and start it again.
here's the diagnose

/Applications/Docker.app/Contents/MacOS/com.docker.diagnose check
Starting diagnostics

[PASS] DD0027: is there available disk space on the host?
[PASS] DD0028: is there available VM disk space?
[PASS] DD0018: does the host support virtualization?
[PASS] DD0001: is the application running?
[PASS] DD0017: can a VM be started?
[PASS] DD0016: is the LinuxKit VM running?
[FAIL] DD0011: are the LinuxKit services running? failed to ping VM diagnosticsd with error: Get "http://ipc/ping": dial unix diagnosticd.sock: connect: no such file or directory
[2022-10-28T09:17:38.406198000Z][com.docker.diagnose][I] ipc.NewClient: 1c931df2-diagnose -> diagnosticd.sock diagnosticsd
[common/pkg/diagkit/gather/diagnose.glob..func12()
[	common/pkg/diagkit/gather/diagnose/linuxkit.go:18 +0x8c
[common/pkg/diagkit/gather/diagnose.(*test).GetResult(0x100df7960)
[	common/pkg/diagkit/gather/diagnose/test.go:46 +0x40
[common/pkg/diagkit/gather/diagnose.Run.func1(0x100df7960)
[	common/pkg/diagkit/gather/diagnose/run.go:17 +0x40
[common/pkg/diagkit/gather/diagnose.walkOnce.func1(0x4?, 0x100df7960)
[	common/pkg/diagkit/gather/diagnose/run.go:142 +0x80
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x3, 0x100df7960, 0x14000609718)
[	common/pkg/diagkit/gather/diagnose/run.go:151 +0x88
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x2, 0x100df79e0, 0x14000609718)
[	common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x1, 0x100df7ae0, 0x14000609718)
[	common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x0, 0x100df7d60, 0x14000609718)
[	common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkOnce(0x1008b5a60?, 0x140003df890)
[	common/pkg/diagkit/gather/diagnose/run.go:137 +0x8c
[common/pkg/diagkit/gather/diagnose.Run(0x100df7d60, 0x140003e9420?, {0x140003dfb08, 0x1, 0x1})
[	common/pkg/diagkit/gather/diagnose/run.go:16 +0x160
[main.checkCmd({0x14000132010?, 0x6?, 0x4?}, {0x0, 0x0})
[	common/cmd/com.docker.diagnose/main.go:133 +0xdc
[main.main()
[	common/cmd/com.docker.diagnose/main.go:99 +0x30c
[2022-10-28T09:17:38.407292000Z][com.docker.diagnose][I] (b05febf7) 1c931df2-diagnose C->S diagnosticsd GET /ping
[2022-10-28T09:17:38.407911000Z][com.docker.diagnose][W] (b05febf7) 1c931df2-diagnose C<-S NoResponse GET /ping (599.958µs): Get "http://ipc/ping": dial unix diagnosticd.sock: connect: no such file or directory

[FAIL] DD0004: is the Docker engine running? Get "http://ipc/docker": dial unix lifecycle-server.sock: connect: no such file or directory
[2022-10-28T09:17:38.408497000Z][com.docker.diagnose][I] ipc.NewClient: f98461a2-com.docker.diagnose -> lifecycle-server.sock VMDockerdAPI
[linuxkit/pkg/desktop-host-tools/pkg/client.NewClientForPath(...)
[	linuxkit/pkg/desktop-host-tools/pkg/client/client.go:59
[linuxkit/pkg/desktop-host-tools/pkg/client.NewClient({0x1006ea073, 0x13})
[	linuxkit/pkg/desktop-host-tools/pkg/client/client.go:53 +0x90
[common/pkg/diagkit/gather/diagnose.isDockerEngineRunning()
[	common/pkg/diagkit/gather/diagnose/dockerd.go:21 +0x28
[common/pkg/diagkit/gather/diagnose.(*test).GetResult(0x100df79e0)
[	common/pkg/diagkit/gather/diagnose/test.go:46 +0x40
[common/pkg/diagkit/gather/diagnose.Run.func1(0x100df79e0)
[	common/pkg/diagkit/gather/diagnose/run.go:17 +0x40
[common/pkg/diagkit/gather/diagnose.walkOnce.func1(0x3?, 0x100df79e0)
[	common/pkg/diagkit/gather/diagnose/run.go:142 +0x80
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x2, 0x100df79e0, 0x14000609718)
[	common/pkg/diagkit/gather/diagnose/run.go:151 +0x88
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x1, 0x100df7ae0, 0x14000609718)
[	common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x0, 0x100df7d60, 0x14000609718)
[	common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkOnce(0x1008b5a60?, 0x140003df890)
[	common/pkg/diagkit/gather/diagnose/run.go:137 +0x8c
[common/pkg/diagkit/gather/diagnose.Run(0x100df7d60, 0x140003e9420?, {0x140003dfb08, 0x1, 0x1})
[	common/pkg/diagkit/gather/diagnose/run.go:16 +0x160
[main.checkCmd({0x14000132010?, 0x6?, 0x4?}, {0x0, 0x0})
[	common/cmd/com.docker.diagnose/main.go:133 +0xdc
[main.main()
[	common/cmd/com.docker.diagnose/main.go:99 +0x30c
[2022-10-28T09:17:38.409417000Z][com.docker.diagnose][I] (da8d48df) f98461a2-com.docker.diagnose C->S VMDockerdAPI GET /docker
[2022-10-28T09:17:38.409779000Z][com.docker.diagnose][W] (da8d48df) f98461a2-com.docker.diagnose C<-S NoResponse GET /docker (359.542µs): Get "http://ipc/docker": dial unix lifecycle-server.sock: connect: no such file or directory
[2022-10-28T09:17:38.410003000Z][com.docker.diagnose][I] (da8d48df-1) f98461a2-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-28T09:17:38.410326000Z][com.docker.diagnose][W] (da8d48df-1) f98461a2-com.docker.diagnose C<-S NoResponse GET /ping (317.541µs): Get "http://ipc/ping": dial unix lifecycle-server.sock: connect: no such file or directory
[2022-10-28T09:17:39.410851000Z][com.docker.diagnose][I] (da8d48df-2) f98461a2-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-28T09:17:39.412078000Z][com.docker.diagnose][W] (da8d48df-2) f98461a2-com.docker.diagnose C<-S NoResponse GET /ping (1.223125ms): Get "http://ipc/ping": dial unix lifecycle-server.sock: connect: no such file or directory
[2022-10-28T09:17:40.413014000Z][com.docker.diagnose][I] (da8d48df-3) f98461a2-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-28T09:17:40.414771000Z][com.docker.diagnose][W] (da8d48df-3) f98461a2-com.docker.diagnose C<-S NoResponse GET /ping (1.749084ms): Get "http://ipc/ping": dial unix lifecycle-server.sock: connect: no such file or directory
[2022-10-28T09:17:41.415983000Z][com.docker.diagnose][I] (da8d48df-4) f98461a2-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-28T09:17:41.417736000Z][com.docker.diagnose][W] (da8d48df-4) f98461a2-com.docker.diagnose C<-S NoResponse GET /ping (1.740208ms): Get "http://ipc/ping": dial unix lifecycle-server.sock: connect: no such file or directory
[2022-10-28T09:17:42.418665000Z][com.docker.diagnose][I] (da8d48df-5) f98461a2-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-28T09:17:42.420330000Z][com.docker.diagnose][W] (da8d48df-5) f98461a2-com.docker.diagnose C<-S NoResponse GET /ping (1.662417ms): Get "http://ipc/ping": dial unix lifecycle-server.sock: connect: no such file or directory
[2022-10-28T09:17:43.421793000Z][com.docker.diagnose][I] (da8d48df-6) f98461a2-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-28T09:17:43.423663000Z][com.docker.diagnose][W] (da8d48df-6) f98461a2-com.docker.diagnose C<-S NoResponse GET /ping (1.849916ms): Get "http://ipc/ping": dial unix lifecycle-server.sock: connect: no such file or directory
[2022-10-28T09:17:44.425042000Z][com.docker.diagnose][I] (da8d48df-7) f98461a2-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-28T09:17:44.426271000Z][com.docker.diagnose][W] (da8d48df-7) f98461a2-com.docker.diagnose C<-S NoResponse GET /ping (1.223875ms): Get "http://ipc/ping": dial unix lifecycle-server.sock: connect: no such file or directory
[2022-10-28T09:17:45.427180000Z][com.docker.diagnose][I] (da8d48df-8) f98461a2-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-10-28T09:17:45.428848000Z][com.docker.diagnose][W] (da8d48df-8) f98461a2-com.docker.diagnose C<-S NoResponse GET /ping (1.659541ms): Get "http://ipc/ping": dial unix lifecycle-server.sock: connect: no such file or directory

[PASS] DD0015: are the binary symlinks installed?
[FAIL] DD0031: does the Docker API work? Cannot connect to the Docker daemon at unix://docker.raw.sock. Is the docker daemon running?
[PASS] DD0013: is the $PATH ok?
Cannot connect to the Docker daemon at unix:///var/run/docker.sock. Is the docker daemon running?
[FAIL] DD0003: is the Docker CLI working? exit status 1
[FAIL] DD0014: are the backend processes running? 5 errors occurred:
	* com.docker.driver.amd64-linux is not running
	* com.docker.virtualization is not running
	* com.docker.backend is not running
	* vpnkit-bridge is not running
	* com.docker.vpnkit is not running


[PASS] DD0007: is the backend responding?
[PASS] DD0008: is the native API responding?
[FAIL] DD0009: is the vpnkit API responding? dial unix vpnkit.diag.sock: connect: connection refused
[FAIL] DD0010: is the Docker API proxy responding? failed to ping Docker proxy API with error: Get "http://ipc/desktop-diagnostics/ping": dial unix /Users/hendrawan/.docker/run/docker.sock: connect: connection refused
[2022-10-28T09:18:08.606607000Z][com.docker.diagnose][I] ipc.NewClient: b012e3f3-diagnose -> <HOME>/.docker/run/docker.sock Proxy
[common/pkg/diagkit/gather/diagnose.glob..func11()
[	common/pkg/diagkit/gather/diagnose/ipc.go:91 +0x6c
[common/pkg/diagkit/gather/diagnose.(*test).GetResult(0x100df7ee0)
[	common/pkg/diagkit/gather/diagnose/test.go:46 +0x40
[common/pkg/diagkit/gather/diagnose.Run.func1(0x100df7ee0)
[	common/pkg/diagkit/gather/diagnose/run.go:17 +0x40
[common/pkg/diagkit/gather/diagnose.walkOnce.func1(0x2?, 0x100df7ee0)
[	common/pkg/diagkit/gather/diagnose/run.go:142 +0x80
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x1, 0x100df7ee0, 0x14000609718)
[	common/pkg/diagkit/gather/diagnose/run.go:151 +0x88
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x0, 0x100df7d60, 0x14000609718)
[	common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkOnce(0x1008b5a60?, 0x140003df890)
[	common/pkg/diagkit/gather/diagnose/run.go:137 +0x8c
[common/pkg/diagkit/gather/diagnose.Run(0x100df7d60, 0x140003e9420?, {0x140003dfb08, 0x1, 0x1})
[	common/pkg/diagkit/gather/diagnose/run.go:16 +0x160
[main.checkCmd({0x14000132010?, 0x6?, 0x4?}, {0x0, 0x0})
[	common/cmd/com.docker.diagnose/main.go:133 +0xdc
[main.main()
[	common/cmd/com.docker.diagnose/main.go:99 +0x30c
[2022-10-28T09:18:08.608651000Z][com.docker.diagnose][I] (c8746522) b012e3f3-diagnose C->S Proxy GET /desktop-diagnostics/ping
[2022-10-28T09:18:08.609682000Z][com.docker.diagnose][W] (c8746522) b012e3f3-diagnose C<-S NoResponse GET /desktop-diagnostics/ping (1.019792ms): Get "http://ipc/desktop-diagnostics/ping": dial unix <HOME>/.docker/run/docker.sock: connect: connection refused
[2022-10-28T09:18:08.610445000Z][com.docker.diagnose][I] (c8746522-1) b012e3f3-diagnose C->S Proxy GET /ping
[2022-10-28T09:18:08.611153000Z][com.docker.diagnose][W] (c8746522-1) b012e3f3-diagnose C<-S NoResponse GET /ping (705.917µs): Get "http://ipc/ping": dial unix <HOME>/.docker/run/docker.sock: connect: connection refused
[2022-10-28T09:18:09.611907000Z][com.docker.diagnose][I] (c8746522-2) b012e3f3-diagnose C->S Proxy GET /ping
[2022-10-28T09:18:09.620245000Z][com.docker.diagnose][W] (c8746522-2) b012e3f3-diagnose C<-S UnknownServer GET /ping (8.34775ms): status code not OK but 500: dial unix docker.raw.sock: connect: no such file or directory
[2022-10-28T09:18:10.620935000Z][com.docker.diagnose][I] (c8746522-3) b012e3f3-diagnose C->S Proxy GET /ping
[2022-10-28T09:18:10.623665000Z][com.docker.diagnose][W] (c8746522-3) b012e3f3-diagnose C<-S UnknownServer GET /ping (2.713916ms): status code not OK but 500: dial unix docker.raw.sock: connect: no such file or directory
[2022-10-28T09:18:11.624613000Z][com.docker.diagnose][I] (c8746522-4) b012e3f3-diagnose C->S Proxy GET /ping
[2022-10-28T09:18:11.627441000Z][com.docker.diagnose][W] (c8746522-4) b012e3f3-diagnose C<-S UnknownServer GET /ping (2.823125ms): status code not OK but 500: dial unix docker.raw.sock: connect: no such file or directory
[2022-10-28T09:18:12.629036000Z][com.docker.diagnose][I] (c8746522-5) b012e3f3-diagnose C->S Proxy GET /ping
[2022-10-28T09:18:12.630533000Z][com.docker.diagnose][W] (c8746522-5) b012e3f3-diagnose C<-S UnknownServer GET /ping (1.486958ms): status code not OK but 500: dial unix docker.raw.sock: connect: no such file or directory
[2022-10-28T09:18:13.631242000Z][com.docker.diagnose][I] (c8746522-6) b012e3f3-diagnose C->S Proxy GET /ping
[2022-10-28T09:18:13.634193000Z][com.docker.diagnose][W] (c8746522-6) b012e3f3-diagnose C<-S UnknownServer GET /ping (2.948667ms): status code not OK but 500: dial unix docker.raw.sock: connect: no such file or directory
[2022-10-28T09:18:14.635034000Z][com.docker.diagnose][I] (c8746522-7) b012e3f3-diagnose C->S Proxy GET /ping
[2022-10-28T09:18:14.643212000Z][com.docker.diagnose][W] (c8746522-7) b012e3f3-diagnose C<-S UnknownServer GET /ping (8.167ms): page not found
[2022-10-28T09:18:15.644856000Z][com.docker.diagnose][I] (c8746522-8) b012e3f3-diagnose C->S Proxy GET /ping
[2022-10-28T09:18:15.648155000Z][com.docker.diagnose][W] (c8746522-8) b012e3f3-diagnose C<-S UnknownServer GET /ping (3.294875ms): page not found

[PASS] DD0012: is the VM networking working?
[SKIP] DD0030: is the image access management authorized?
[PASS] DD0019: is the com.docker.vmnetd process responding?
[PASS] DD0033: does the host have Internet access?
[PASS] DD0018: does the host support virtualization?
[PASS] DD0001: is the application running?
[PASS] DD0017: can a VM be started?
[PASS] DD0016: is the LinuxKit VM running?
[WARN] DD0011: are the LinuxKit services running? failed to ping VM diagnosticsd with error: Get "http://ipc/ping": dial unix diagnosticd.sock: connect: no such file or directory
[WARN] DD0004: is the Docker engine running? Get "http://ipc/docker": dial unix lifecycle-server.sock: connect: no such file or directory
[PASS] DD0015: are the binary symlinks installed?
[WARN] DD0031: does the Docker API work? Cannot connect to the Docker daemon at unix://docker.raw.sock. Is the docker daemon running?
[PASS] DD0032: do Docker networks overlap with host IPs?

Please note the following 3 warnings:

1 : The check: are the LinuxKit services running?
    Produced the following warning: failed to ping VM diagnosticsd with error: Get "http://ipc/ping": dial unix diagnosticd.sock: connect: no such file or directory

The Docker engine runs inside a Linux VM as a service. Therefore the services must have started.

2 : The check: is the Docker engine running?
    Produced the following warning: Get "http://ipc/docker": dial unix lifecycle-server.sock: connect: no such file or directory

The Docker engine manages all containers and images on the host. Check the dockerd.log to see why it failed to start.

3 : The check: does the Docker API work?
    Produced the following warning: Cannot connect to the Docker daemon at unix://docker.raw.sock. Is the docker daemon running?

If the Docker API is not available from the host then Docker Desktop will not work correctly.


Please investigate the following 2 issues:

1 : The test: are the backend processes running?
    Failed with: 5 errors occurred:
	* com.docker.driver.amd64-linux is not running
	* com.docker.virtualization is not running
	* com.docker.backend is not running
	* vpnkit-bridge is not running
	* com.docker.vpnkit is not running
	```

@W7RZL
Copy link

W7RZL commented Nov 1, 2022

I'm seeing this too - Diagnostics ID: 1B3E9A2C-D98D-4DE9-9235-43132318DE5C/20221027141440

Looking at the Console, each time my Docker instance stops it corresponds to a crash in com.docker.vpnkit. The last few crashes are all EXC_BAD_ACCESS, either SIGBUS or SIGSEGV.

@jmarbutt
Copy link

jmarbutt commented Nov 1, 2022

I am having this also.

@tqn-org
Copy link

tqn-org commented Nov 2, 2022

Issue might be related to vpnkit according to the crash log. I've tried downgrading to 4.12.0(85629) which seemed to solve the issue temporarily - been running 4.12.0 for 3-4 days without Docker Desktop crashing every half a day.

@atticusmatticus
Copy link
Author

Same downgrading to 4.12.0 has fixed the issue for me.

@ackerthehacker2
Copy link

I am having the same issue with OS 13.1 ...
disabled exerimental features
tried a clean install
Diag ID: 5DBCBC02-130D-4CFA-AD4C-6AC3D6751712/20221102175832

/Applications/Docker.app/Contents/MacOS/com.docker.diagnose check
Starting diagnostics

[PASS] DD0027: is there available disk space on the host?
[PASS] DD0028: is there available VM disk space?
[PASS] DD0018: does the host support virtualization?
[PASS] DD0001: is the application running?
[PASS] DD0017: can a VM be started?
[PASS] DD0016: is the LinuxKit VM running?
[FAIL] DD0011: are the LinuxKit services running? failed to ping VM diagnosticsd with error: Get "http://ipc/ping": EOF
[2022-11-02T18:05:50.564361000Z][com.docker.diagnose][I] ipc.NewClient: 6e8d6324-diagnose -> diagnosticd.sock diagnosticsd
[common/pkg/diagkit/gather/diagnose.glob..func12()
[ common/pkg/diagkit/gather/diagnose/linuxkit.go:18 +0x8c
[common/pkg/diagkit/gather/diagnose.(*test).GetResult(0x105b5b960)
[ common/pkg/diagkit/gather/diagnose/test.go:46 +0x40
[common/pkg/diagkit/gather/diagnose.Run.func1(0x105b5b960)
[ common/pkg/diagkit/gather/diagnose/run.go:17 +0x40
[common/pkg/diagkit/gather/diagnose.walkOnce.func1(0x4?, 0x105b5b960)
[ common/pkg/diagkit/gather/diagnose/run.go:142 +0x80
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x3, 0x105b5b960, 0x140005ed718)
[ common/pkg/diagkit/gather/diagnose/run.go:151 +0x88
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x2, 0x105b5b9e0, 0x140005ed718)
[ common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x1, 0x105b5bae0, 0x140005ed718)
[ common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x0, 0x105b5bd60, 0x140005ed718)
[ common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkOnce(0x105619a60?, 0x1400051f890)
[ common/pkg/diagkit/gather/diagnose/run.go:137 +0x8c
[common/pkg/diagkit/gather/diagnose.Run(0x105b5bd60, 0x140001343a0?, {0x1400051fb08, 0x1, 0x1})
[ common/pkg/diagkit/gather/diagnose/run.go:16 +0x160
[main.checkCmd({0x140001ac010?, 0x6?, 0x4?}, {0x0, 0x0})
[ common/cmd/com.docker.diagnose/main.go:133 +0xdc
[main.main()
[ common/cmd/com.docker.diagnose/main.go:99 +0x30c
[2022-11-02T18:05:50.565119000Z][com.docker.diagnose][I] (ea8bec66) 6e8d6324-diagnose C->S diagnosticsd GET /ping
[2022-11-02T18:05:50.565907000Z][com.docker.diagnose][W] (ea8bec66) 6e8d6324-diagnose C<-S NoResponse GET /ping (759.417µs): Get "http://ipc/ping": EOF

[FAIL] DD0004: is the Docker engine running? Get "http://ipc/docker": EOF
[2022-11-02T18:05:50.566496000Z][com.docker.diagnose][I] ipc.NewClient: 2f78c1da-com.docker.diagnose -> lifecycle-server.sock VMDockerdAPI
[linuxkit/pkg/desktop-host-tools/pkg/client.NewClientForPath(...)
[ linuxkit/pkg/desktop-host-tools/pkg/client/client.go:59
[linuxkit/pkg/desktop-host-tools/pkg/client.NewClient({0x10544e033, 0x13})
[ linuxkit/pkg/desktop-host-tools/pkg/client/client.go:53 +0x90
[common/pkg/diagkit/gather/diagnose.isDockerEngineRunning()
[ common/pkg/diagkit/gather/diagnose/dockerd.go:21 +0x28
[common/pkg/diagkit/gather/diagnose.(*test).GetResult(0x105b5b9e0)
[ common/pkg/diagkit/gather/diagnose/test.go:46 +0x40
[common/pkg/diagkit/gather/diagnose.Run.func1(0x105b5b9e0)
[ common/pkg/diagkit/gather/diagnose/run.go:17 +0x40
[common/pkg/diagkit/gather/diagnose.walkOnce.func1(0x3?, 0x105b5b9e0)
[ common/pkg/diagkit/gather/diagnose/run.go:142 +0x80
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x2, 0x105b5b9e0, 0x140005ed718)
[ common/pkg/diagkit/gather/diagnose/run.go:151 +0x88
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x1, 0x105b5bae0, 0x140005ed718)
[ common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkDepthFirst(0x0, 0x105b5bd60, 0x140005ed718)
[ common/pkg/diagkit/gather/diagnose/run.go:148 +0x50
[common/pkg/diagkit/gather/diagnose.walkOnce(0x105619a60?, 0x1400051f890)
[ common/pkg/diagkit/gather/diagnose/run.go:137 +0x8c
[common/pkg/diagkit/gather/diagnose.Run(0x105b5bd60, 0x140001343a0?, {0x1400051fb08, 0x1, 0x1})
[ common/pkg/diagkit/gather/diagnose/run.go:16 +0x160
[main.checkCmd({0x140001ac010?, 0x6?, 0x4?}, {0x0, 0x0})
[ common/cmd/com.docker.diagnose/main.go:133 +0xdc
[main.main()
[ common/cmd/com.docker.diagnose/main.go:99 +0x30c
[2022-11-02T18:05:50.567364000Z][com.docker.diagnose][I] (bf543097) 2f78c1da-com.docker.diagnose C->S VMDockerdAPI GET /docker
[2022-11-02T18:05:50.567929000Z][com.docker.diagnose][W] (bf543097) 2f78c1da-com.docker.diagnose C<-S NoResponse GET /docker (563.417µs): Get "http://ipc/docker": EOF
[2022-11-02T18:05:50.568129000Z][com.docker.diagnose][I] (bf543097-1) 2f78c1da-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-11-02T18:05:50.568613000Z][com.docker.diagnose][W] (bf543097-1) 2f78c1da-com.docker.diagnose C<-S NoResponse GET /ping (482.791µs): Get "http://ipc/ping": EOF
[2022-11-02T18:05:51.569478000Z][com.docker.diagnose][I] (bf543097-2) 2f78c1da-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-11-02T18:05:51.571896000Z][com.docker.diagnose][W] (bf543097-2) 2f78c1da-com.docker.diagnose C<-S NoResponse GET /ping (2.424917ms): Get "http://ipc/ping": EOF
[2022-11-02T18:05:52.573187000Z][com.docker.diagnose][I] (bf543097-3) 2f78c1da-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-11-02T18:05:52.575492000Z][com.docker.diagnose][W] (bf543097-3) 2f78c1da-com.docker.diagnose C<-S NoResponse GET /ping (2.27625ms): Get "http://ipc/ping": EOF
[2022-11-02T18:05:53.577099000Z][com.docker.diagnose][I] (bf543097-4) 2f78c1da-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-11-02T18:05:53.578914000Z][com.docker.diagnose][W] (bf543097-4) 2f78c1da-com.docker.diagnose C<-S NoResponse GET /ping (1.771792ms): Get "http://ipc/ping": EOF
[2022-11-02T18:05:54.579788000Z][com.docker.diagnose][I] (bf543097-5) 2f78c1da-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-11-02T18:05:54.581460000Z][com.docker.diagnose][W] (bf543097-5) 2f78c1da-com.docker.diagnose C<-S NoResponse GET /ping (1.670125ms): Get "http://ipc/ping": EOF
[2022-11-02T18:05:55.582156000Z][com.docker.diagnose][I] (bf543097-6) 2f78c1da-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-11-02T18:05:55.584328000Z][com.docker.diagnose][W] (bf543097-6) 2f78c1da-com.docker.diagnose C<-S NoResponse GET /ping (2.164333ms): Get "http://ipc/ping": EOF
[2022-11-02T18:05:56.585214000Z][com.docker.diagnose][I] (bf543097-7) 2f78c1da-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-11-02T18:05:56.587578000Z][com.docker.diagnose][W] (bf543097-7) 2f78c1da-com.docker.diagnose C<-S NoResponse GET /ping (2.430917ms): Get "http://ipc/ping": EOF
[2022-11-02T18:05:57.588457000Z][com.docker.diagnose][I] (bf543097-8) 2f78c1da-com.docker.diagnose C->S VMDockerdAPI GET /ping
[2022-11-02T18:05:57.592054000Z][com.docker.diagnose][W] (bf543097-8) 2f78c1da-com.docker.diagnose C<-S NoResponse GET /ping (3.571542ms): Get "http://ipc/ping": EOF

[PASS] DD0015: are the binary symlinks installed?
[FAIL] DD0031: does the Docker API work? error during connect: Get "http://docker.raw.sock/v1.24/containers/json?limit=0": EOF
[PASS] DD0013: is the $PATH ok?

@nicks
Copy link

nicks commented Nov 4, 2022

Thanks for the report! ya, poking around in the diagnostics @atticusmatticus posted at the top of the thread, I do see vpnkit crashing a lot. We've gotten some reports of this, but aren't totally sure yet what causes it or why it only affects some users.

Can you try upgrading to Docker Desktop 4.13.1 and see if that helps? (it has some recent vpnkit fixes)

@nicks
Copy link

nicks commented Nov 4, 2022

i think the issue @ackerthehacker2 is seeing is a very different issue, don't see any segfaults in your diagnostics, maybe file a new issue with repro steps and more details on what you're seeing?

@W7RZL
Copy link

W7RZL commented Nov 5, 2022

Can you try upgrading to Docker Desktop 4.13.1 and see if that helps? (it has some recent vpnkit fixes)

For me, 4.13.1 had the same crash in vpnkit. My containers have been running for 3 days now with no problems after downgrading to 4.12.

@fskaeh
Copy link

fskaeh commented Nov 5, 2022

On 4.13.1 on my Mac Mini M1 running Ventura it’s still happening. It seems related to containers opening too many connections at once. It would crash everytime I start downloads in Transmission. By reducing the number of allowed connections in Transmission (5 per torrent, 15 in total) it seems okay for now (no crash since this morning at least). Will report back if it happens again. Unfortunately I’m not at home now so I can’t really get logs.

EDIT: Nevermind, it still crashes after a minute or two every time one of my running torrents gets active again.

@kershyll
Copy link

kershyll commented Nov 6, 2022

Thanks for the report! ya, poking around in the diagnostics @atticusmatticus posted at the top of the thread, I do see vpnkit crashing a lot. We've gotten some reports of this, but aren't totally sure yet what causes it or why it only affects some users.

Can you try upgrading to Docker Desktop 4.13.1 and see if that helps? (it has some recent vpnkit fixes)

Have the same problem with 4.13.1; randomly crashes after a couple of days for me, this time it took about 3.
Apple Chip, macOS 13.0

The docker diagnostics currently show a pass on everything because I didn't think of running them before I killed the processes and restarted it.

I've attached the macOS crash report: vpnkit_crash_report-06112022.txt

@atticusmatticus
Copy link
Author

Same for me as others, upgrading to 4.13.1 doesn't seem to change the issue appreciably. Still crashes after a minute or so once docker apps like Transmission start to make some connections and start transferring etc.

@yaohwu
Copy link

yaohwu commented Nov 8, 2022

Same happened in macOS 13.0 (22A380) when using docker desktop 4.13.1 (90346).
The issue comes in a few minutes after docker started.

@Niko-La
Copy link

Niko-La commented Nov 8, 2022

Issue might be related to vpnkit according to the crash log. I've tried downgrading to 4.12.0(85629) which seemed to solve the issue temporarily - been running 4.12.0 for 3-4 days without Docker Desktop crashing every half a day.

is this consistent? crash every 3-4 days? mine just did after 3 days, def better than every 2-6hours. how are you monitoring the crashes? does it crash for the same reason every time?

@fskaeh
Copy link

fskaeh commented Nov 8, 2022

Issue might be related to vpnkit according to the crash log. I've tried downgrading to 4.12.0(85629) which seemed to solve the issue temporarily - been running 4.12.0 for 3-4 days without Docker Desktop crashing every half a day.

is this consistent? crash every 3-4 days? mine just did after 3 days, def better than every 2-6hours. how are you monitoring the crashes? does it crash for the same reason every time?

It's not really a timing issue. Mine has run just fine on 4.13.1 for a couple of days because I disabled Transmission. But I know if I enable it again, everything will crash as soon as my torrents get started again.

@atc-cegodk
Copy link

Docker Desktop (Version 4.13.1 (90346)) also crashes on my (Intel x86-64 CPU) iMac. Console.app shows that com.docker.vpnkit crashes with EXC_BAD_ACCESS. Signal is sometimes SIGBUS; sometimes SIGSEGV. Two crash reports attached.
vpnkit_sigbus_7nov2022.txt
vpnkit_sigsegv_8nov2022.txt

No antivirus installed, but ElasticEndpoint/Elastic Security are installed.

@jwaldrip
Copy link

jwaldrip commented Nov 8, 2022

Same issues here. My entire team is having docker crash every 15-20 minutes.

@djs55
Copy link
Contributor

djs55 commented Nov 8, 2022

Thanks for the report. Does anyone have a self-contained repro I could try? (Edited to add: I've got some leads, based on the crash reports, but I want to make sure I'm looking in the right place.)

Edit again: in case it helps, I've reverted some changes related to the stack traces. I have an Apple Silicon binary if you want to try it:
com.docker.vpnkit-darwin-arm64.zip

% shasum com.docker.vpnkit-darwin-arm64 
00f7ec5196891c8d63203667ce88ec5a1f45cd91  com.docker.vpnkit-darwin-arm64

To install it on Ventura I had to open up System Settings / Privacy & Security and add the Terminal as a program which can modify applications. This might be because of my local security settings though.

The new vpnkit can be installed by:

mv /Applications/Docker.app/Contents/Resources/bin/com.docker.vpnkit /Applications/Docker.app/Contents/Resources/bin/com.docker.vpnkit.backup
mv com.docker.vpnkit-darwin-arm64 /Applications/Docker.app/Contents/Resources/bin/com.docker.vpnkit

and then restart Docker. If this one still crashes (hopefully not), I'd be interested to see any new stack traces to see how they differ.

@kershyll
Copy link

kershyll commented Nov 9, 2022

I've installed your vpnkit version. It took 1-3 days for me to crash, so it might take some time until I can report back! :)

Regarding the self-contained repo - in my case I'm just using the latest pi-hole image with no custom configuration or settings whatsoever.

docker run -d --name pihole -e ServerIP=192.168.0.140 -e TZ=Europe/Vienna -e WEBPASSWORD=PASSWORD -e DNS1=1.1.1.1 -e DNS2=1.0.0.1 -p 80:80 -p 53:53/tcp -p 53:53/udp -p 443:443 -v ~/pihole/:/etc/pihole/ --dns=127.0.0.1 --dns=1.1.1.1 --cap-add=NET_ADMIN --restart=unless-stopped pihole/pihole:latest

@stanimirivanovde
Copy link

stanimirivanovde commented Nov 14, 2022

Update:
Downgrading to 4.12.0 (85629) fix the issue. I tried downgrading to 4.13.1, 4.13.0 but both were not working.

Docker Version 4.14.0 (91374) is crashing for me too in about 5 minutes of running 10 containers that are putting a lot of network traffic (network port scanning). The Dashboard shows the message: "Docker Desktop is stopped." I looked at the logs and found a segmentation fault in com.docker.vpnkit. I tried cleaning up the docker files, re-installing it, system prune -a etc but nothing works:

2022-11-14 00:38:51.551636-0500 0xc9962b   Default     0x0                  93229  0    com.docker.backend: com.docker.vpnkit with pid: 93276 shutdown by signal: segmentation fault
2022-11-14 00:38:51.551641-0500 0xc9a6c1   Default     0x0                  93229  0    com.docker.backend: shutting down 6 tasks
2022-11-14 00:38:51.552282-0500 0xc9962b   Default     0x0                  93229  0    com.docker.backend: shutdown group 0/2: [docker with pid: 93277 com.docker.extensions with pid: 93280 com.docker.dev-envs with pid
: 93281]
2022-11-14 00:38:51.552684-0500 0xc9962b   Default     0x0                  93229  0    com.docker.backend: sending signal terminated to docker with pid: 93277
2022-11-14 00:38:51.553104-0500 0xc9962b   Default     0x0                  93229  0    com.docker.backend: sending signal terminated to com.docker.extensions with pid: 93280
2022-11-14 00:38:51.553511-0500 0xc9962b   Default     0x0                  93229  0    com.docker.backend: sending signal terminated to com.docker.dev-envs with pid: 93281
2022-11-14 00:38:51.555753-0500 0xc99627   Default     0x0                  93229  0    com.docker.backend: com.docker.dev-envs with pid: 93281 shutdown with exit code 1
2022-11-14 00:38:51.557933-0500 0xc9962a   Default     0x0                  93229  0    com.docker.backend: docker with pid: 93277 shutdown cleanly
2022-11-14 00:38:51.558838-0500 0xc9a577   Default     0x0                  93229  0    com.docker.backend: com.docker.extensions with pid: 93280 shutdown cleanly
2022-11-14 00:38:51.655042-0500 0xc9a4bd   Default     0x0                  93229  0    com.docker.backend: shutdown group 1/2: [com.docker.driver.amd64-linux with pid: 93279]
2022-11-14 00:38:51.655679-0500 0xc9a4bd   Default     0x0                  93229  0    com.docker.backend: sending signal terminated to com.docker.driver.amd64-linux with pid: 93279
2022-11-14 00:38:51.659770-0500 0xc9962a   Default     0x0                  93229  0    com.docker.backend: (7cc146fe) 187d0393-BackendAPI S<-C 835cb7a2-DriverCMD POST /events[[STACK]]github.com/docker/pinata/common/pk
g/backend.(*backendClient).PushEvent(0xc0000349b0, {0x17275ce66a256458, 0x0, {0xc0005a8150, 0x21}, {0x18d58ee, 0x8}, {0x0, 0x0}, {0x0, ...}, ...})
        github.com/docker/pinata/common/pkg/backend/notify.go:27 +0x102
main.handleSystemCalls({0x1a0ce38, 0xc0002cb6d0})
        github.com/docker/pinata/mac/backend/cmd/com.docker.driver.amd64-linux/main.go:484 +0x196
created by main.main
        github.com/docker/pinata/mac/backend/cmd/com.docker.driver.amd64-linux/main.go:86 +0x538

My system information:

   System Software Overview:

      System Version: macOS 13.0.1 (22A400)
      Kernel Version: Darwin 22.1.0
      Boot Volume: Macintosh HD
      Boot Mode: Normal
      Secure Virtual Memory: Enabled
      System Integrity Protection: Enabled
      Time since boot: 2 days, 47 minutes

Hardware:

    Hardware Overview:

      Model Name: MacBook Pro
      Model Identifier: MacBookPro16,1
      Processor Name: 8-Core Intel Core i9
      Processor Speed: 2.4 GHz
      Number of Processors: 1
      Total Number of Cores: 8
      L2 Cache (per Core): 256 KB
      L3 Cache: 16 MB
      Hyper-Threading Technology: Enabled
      Memory: 64 GB
      System Firmware Version: 1916.40.8.0.0 (iBridge: 20.16.420.0.0,0)
      OS Loader Version: 564.40.4~27

The actual com.docker.vpnkit carsh report is here:

-------------------------------------
Translated Report (Full Report Below)
-------------------------------------

Process:               com.docker.vpnkit [93276]
Path:                  /Applications/Docker.app/Contents/Resources/bin/com.docker.vpnkit
Identifier:            com.docker.vpnkit
Version:               ???
Code Type:             X86-64 (Native)
Parent Process:        com.docker.backend [93229]
Responsible:           Docker [93228]
User ID:               501

Date/Time:             2022-11-14 00:38:51.5571 -0500
OS Version:            macOS 13.0.1 (22A400)
Report Version:        12
Bridge OS Version:     7.0 (20P420)
Anonymous UUID:        D13A3E13-BD97-DD33-50E2-E29E2593D0FD

Sleep/Wake UUID:       93E92F9F-EE14-4B7F-9BFB-848AD3E82F10

Time Awake Since Boot: 160000 seconds
Time Since Wake:       530 seconds

System Integrity Protection: enabled

Crashed Thread:        3

Exception Type:        EXC_BAD_ACCESS (SIGSEGV)
Exception Codes:       KERN_INVALID_ADDRESS at 0x00007f9be8000000
Exception Codes:       0x0000000000000001, 0x00007f9be8000000

Termination Reason:    Namespace SIGNAL, Code 11 Segmentation fault: 11
Terminating Process:   exc handler [93276]

VM Region Info: 0x7f9be8000000 is not in any region.  Bytes after previous region: 1  Bytes before following region: 116391936
      REGION TYPE                    START - END         [ VSIZE] PRT/MAX SHRMOD  REGION DETAIL
      MALLOC_MEDIUM            7f9be7800000-7f9be8000000 [ 8192K] rw-/rwx SM=PRV  
--->  GAP OF 0x6f00000 BYTES
      MALLOC_TINY              7f9beef00000-7f9bef000000 [ 1024K] rw-/rwx SM=PRV  

Thread 0::  Dispatch queue: com.apple.main-thread
0   libsystem_kernel.dylib        	    0x7ff80ee9c3b6 __select + 10
1   com.docker.vpnkit             	       0x102798e7e unix_select + 814
2   com.docker.vpnkit             	       0x1020f18b1 camlLwt_engine__fun_2758 + 33
...
511 com.docker.vpnkit             	       0x1020f13cd camlLwt_engine__fun_2681 + 269

Thread 1:
0   libsystem_kernel.dylib        	    0x7ff80ee961fe __psynch_cvwait + 10
1   libsystem_pthread.dylib       	    0x7ff80eed27e1 _pthread_cond_wait + 1243
2   com.docker.vpnkit             	       0x10278e7e8 caml_condition_wait + 104
3   com.docker.vpnkit             	       0x10205109d camlDune__exe__Logging__next_1306 + 109
4   com.docker.vpnkit             	       0x102050e95 camlDune__exe__Logging__with_lock_1175 + 69
...
511 com.docker.vpnkit             	       0x102050e95 camlDune__exe__Logging__with_lock_1175 + 69

Thread 2:
0   libsystem_kernel.dylib        	    0x7ff80ee9c3b6 __select + 10
1   com.docker.vpnkit             	       0x10278dc7f caml_thread_tick + 79
2   libsystem_pthread.dylib       	    0x7ff80eed2259 _pthread_start + 125
3   libsystem_pthread.dylib       	    0x7ff80eecdc7b thread_start + 15

Thread 3 Crashed:
0   com.docker.vpnkit             	       0x1027c1dc0 caml_ba_sub + 208
1   com.docker.vpnkit             	       0x1021028c8 camlLuv__UDP__fun_3102 + 232
2   com.docker.vpnkit             	       0x1027c6505 caml_start_program + 73
...
511 com.docker.vpnkit             	       0x1027c6505 caml_start_program + 73

Thread 4:
0   libsystem_kernel.dylib        	    0x7ff80ee961fe __psynch_cvwait + 10
1   libsystem_pthread.dylib       	    0x7ff80eed27e1 _pthread_cond_wait + 1243
2   com.docker.vpnkit             	       0x102787329 uv_cond_wait + 9
3   com.docker.vpnkit             	       0x102776a36 worker + 86
4   libsystem_pthread.dylib       	    0x7ff80eed2259 _pthread_start + 125
5   libsystem_pthread.dylib       	    0x7ff80eecdc7b thread_start + 15

Thread 5:
0   libsystem_kernel.dylib        	    0x7ff80ee961fe __psynch_cvwait + 10
1   libsystem_pthread.dylib       	    0x7ff80eed27e1 _pthread_cond_wait + 1243
2   com.docker.vpnkit             	       0x102787329 uv_cond_wait + 9
3   com.docker.vpnkit             	       0x102776a36 worker + 86
4   libsystem_pthread.dylib       	    0x7ff80eed2259 _pthread_start + 125
5   libsystem_pthread.dylib       	    0x7ff80eecdc7b thread_start + 15

Thread 6:
0   libsystem_kernel.dylib        	    0x7ff80ee961fe __psynch_cvwait + 10
1   libsystem_pthread.dylib       	    0x7ff80eed27e1 _pthread_cond_wait + 1243
2   com.docker.vpnkit             	       0x102787329 uv_cond_wait + 9
3   com.docker.vpnkit             	       0x102776a36 worker + 86
4   libsystem_pthread.dylib       	    0x7ff80eed2259 _pthread_start + 125
5   libsystem_pthread.dylib       	    0x7ff80eecdc7b thread_start + 15

Thread 7:
0   libsystem_kernel.dylib        	    0x7ff80ee961fe __psynch_cvwait + 10
1   libsystem_pthread.dylib       	    0x7ff80eed27e1 _pthread_cond_wait + 1243
2   com.docker.vpnkit             	       0x102787329 uv_cond_wait + 9
3   com.docker.vpnkit             	       0x102776a36 worker + 86
4   libsystem_pthread.dylib       	    0x7ff80eed2259 _pthread_start + 125
5   libsystem_pthread.dylib       	    0x7ff80eecdc7b thread_start + 15


Thread 3 crashed with X86 Thread State (64-bit):
  rax: 0x0000000000e78cdc  rbx: 0x0000ff3860078ee1  rcx: 0x0000000000e78cdb  rdx: 0x0000000000000000
  rdi: 0x0100000000000005  rsi: 0x0000000000000000  rbp: 0x0000700003411a50  rsp: 0x0000700003411980
   r8: 0x0000000102094f90   r9: 0x00007f9be0c39900  r10: 0x00000000000000c0  r11: 0x000060000387103c
  r12: 0x0000000103073260  r13: 0x0000000000000000  r14: 0x0000000000000071  r15: 0x0000700003419d90
  rip: 0x00000001027c1dc0  rfl: 0x0000000000010212  cr2: 0x00007f9be8000000
  
Logical CPU:     10
Error Code:      0x00000004 (no mapping for user data read)
Trap Number:     14

Thread 3 instruction stream:
  ff 48 89 8d 38 ff ff ff-48 8d 8d 38 ff ff ff 48  .H..8...H..8...H
  89 88 20 01 00 00 0f 28-05 a3 bd 00 00 0f 11 85  .. ....(........
  40 ff ff ff 48 8d 45 d0-48 89 85 50 ff ff ff 48  @...H.E.H..P...H
  d1 fe 4c 8b 47 10 48 8b-7f 18 f7 c7 00 01 00 00  ..L.G.H.........
  75 31 49 83 f8 02 0f 8c-f4 00 00 00 b9 01 00 00  u1I.............
  00 b8 02 00 00 00 45 31-ed ba 01 00 00 00 66 90  ......E1......f.
 [49]0f af 54 c9 28 48 63-c8 83 c0 01 49 39 c8 7f  I..T.(Hc....I9..	<==
  ef eb 35 49 8d 58 ff ba-01 00 00 00 48 85 db 7e  ..5I.X......H..~
  20 b8 01 00 00 00 31 c9-0f 1f 84 00 00 00 00 00   .....1.........
  49 0f af 54 c9 28 48 63-c8 83 c0 01 48 39 cb 7f  I..T.(Hc....H9..
  ef 48 83 c6 ff 4c 63 eb-48 85 f6 0f 88 a0 00 00  .H...Lc.H.......
  00 4d 85 f6 0f 88 97 00-00 00 49 d1 fe 4a 8d 04  .M........I..J..

Binary Images:
    0x7ff80ee92000 -     0x7ff80eecbff7 libsystem_kernel.dylib (*) <0c2fd2c9-777c-3355-b70f-7b1b6e9d1b0b> /usr/lib/system/libsystem_kernel.dylib
       0x10203d000 -        0x10295cfff com.docker.vpnkit (*) <be9b5943-d786-3f0c-9f65-b987a3b2d1d6> /Applications/Docker.app/Contents/Resources/bin/com.docker.vpnkit
    0x7ff80eecc000 -     0x7ff80eed7ff7 libsystem_pthread.dylib (*) <13b5e252-77d1-31e1-888d-1c5f4426ea87> /usr/lib/system/libsystem_pthread.dylib
               0x0 - 0xffffffffffffffff ??? (*) <00000000-0000-0000-0000-000000000000> ???

External Modification Summary:
  Calls made by other processes targeting this process:
    task_for_pid: 0
    thread_create: 0
    thread_set_state: 0
  Calls made by this process:
    task_for_pid: 0
    thread_create: 0
    thread_set_state: 0
  Calls made by all processes on this machine:
    task_for_pid: 3
    thread_create: 0
    thread_set_state: 54

VM Region Summary:
ReadOnly portion of Libraries: Total=201.5M resident=0K(0%) swapped_out_or_unallocated=201.5M(100%)
Writable regions: Total=2.7G written=0K(0%) resident=0K(0%) swapped_out=0K(0%) unallocated=2.7G(100%)

                                VIRTUAL   REGION 
REGION TYPE                        SIZE    COUNT (non-coalesced) 
===========                     =======  ======= 
Kernel Alloc Once                    8K        1 
MALLOC                           944.2M      125 
MALLOC guard page                   24K        5 
MALLOC_MEDIUM (reserved)           1.3G       15         reserved VM address space (unallocated)
MALLOC_NANO (reserved)           384.0M        1         reserved VM address space (unallocated)
STACK GUARD                       56.0M        8 
Stack                             41.6M        8 
VM_ALLOCATE                          4K        1 
__DATA                            7443K       38 
__DATA_CONST                       247K       34 
__DATA_DIRTY                        63K       23 
__LINKEDIT                       187.3M        3 
__OBJC_RO                         65.1M        1 
__OBJC_RW                         1982K        1 
__TEXT                            14.2M       42 
dyld private memory                256K        1 
shared memory                       16K        3 
===========                     =======  ======= 
TOTAL                              3.0G      310 
TOTAL, minus reserved VM space     1.3G      310 



-----------
Full Report
-----------

{"app_name":"com.docker.vpnkit","timestamp":"2022-11-14 00:38:51.00 -0500","app_version":"","slice_uuid":"be9b5943-d786-3f0c-9f65-b987a3b2d1d6","build_version":"","platform":1,"share_with_app_devs":0,"is_first_party":1,"bug_type":"309","os_version":"macOS 13.0.1 (22A400)","roots_installed":0,"incident_id":"BCB80A07-707E-448A-89E8-9D2D0E2A4B61","name":"com.docker.vpnkit"}
{
  "uptime" : 160000,
  "procRole" : "Unspecified",
  "version" : 2,
  "userID" : 501,
  "deployVersion" : 210,
  "modelCode" : "MacBookPro16,1",
  "coalitionID" : 12484,
  "osVersion" : {
    "train" : "macOS 13.0.1",
    "build" : "22A400",
    "releaseType" : "User"
  },
  "captureTime" : "2022-11-14 00:38:51.5571 -0500",
  "incident" : "BCB80A07-707E-448A-89E8-9D2D0E2A4B61",
  "pid" : 93276,
  "cpuType" : "X86-64",
  "roots_installed" : 0,
  "bug_type" : "309",
  "procLaunch" : "2022-11-14 00:34:14.7533 -0500",
  "procStartAbsTime" : 160557372789936,
  "procExitAbsTime" : 160833885117388,
  "procName" : "com.docker.vpnkit",
  "procPath" : "\/Applications\/Docker.app\/Contents\/Resources\/bin\/com.docker.vpnkit",
  "parentProc" : "com.docker.backend",
  "parentPid" : 93229,
  "coalitionName" : "com.docker.docker",
  "crashReporterKey" : "D13A3E13-BD97-DD33-50E2-E29E2593D0FD",
  "responsiblePid" : 93228,
  "responsibleProc" : "Docker",
  "wakeTime" : 530,
  "bridgeVersion" : {"build":"20P420","train":"7.0"},
  "sleepWakeUUID" : "93E92F9F-EE14-4B7F-9BFB-848AD3E82F10",
  "sip" : "enabled",
  "vmRegionInfo" : "0x7f9be8000000 is not in any region.  Bytes after previous region: 1  Bytes before following region: 116391936\n      REGION TYPE                    START - END         [ VSIZE] PRT\/MAX SHRMOD  REGION DETAIL\n      MALLOC_MEDIUM            7f9be7800000-7f9be8000000 [ 8192K] rw-\/rwx SM=PRV  \n--->  GAP OF 0x6f00000 BYTES\n      MALLOC_TINY              7f9beef00000-7f9bef000000 [ 1024K] rw-\/rwx SM=PRV  ",
  "exception" : {"codes":"0x0000000000000001, 0x00007f9be8000000","rawCodes":[1,140307588972544],"type":"EXC_BAD_ACCESS","signal":"SIGSEGV","subtype":"KERN_INVALID_ADDRESS at 0x00007f9be8000000"},
  "termination" : {"flags":0,"code":11,"namespace":"SIGNAL","indicator":"Segmentation fault: 11","byProc":"exc handler","byPid":93276},
  "vmregioninfo" : "0x7f9be8000000 is not in any region.  Bytes after previous region: 1  Bytes before following region: 116391936\n      REGION TYPE                    START - END         [ VSIZE] PRT\/MAX SHRMOD  REGION DETAIL\n      MALLOC_MEDIUM            7f9be7800000-7f9be8000000 [ 8192K] rw-\/rwx SM=PRV  \n--->  GAP OF 0x6f00000 BYTES\n      MALLOC_TINY              7f9beef00000-7f9bef000000 [ 1024K] rw-\/rwx SM=PRV  ",
  "extMods" : {"caller":{"thread_create":0,"thread_set_state":0,"task_for_pid":0},"system":{"thread_create":0,"thread_set_state":54,"task_for_pid":3},"targeted":{"thread_create":0,"thread_set_state":0,"task_for_pid":0},"warnings":0},
  "faultingThread" : 3,
  "threads" : [{"id":13211497,"queue":"com.apple.main-thread","frames":[{"imageOffset":41910,"symbol":"__select","symbolLocation":10,"imageIndex":0},{"imageOffset":7716478,"symbol":"unix_select","symbolLocation":814,"imageIndex":1},{"imageOffset":739505,"symbol":"camlLwt_engine__fun_2758","symbolLocation":33,"imageIndex":1},{"imageOffset":738253,"symbol":"camlLwt_engine__fun_2681","symbolLocation":269,"imageIndex":1},
...
{"imageOffset":738253,"symbol":"camlLwt_engine__fun_2681","symbolLocation":269,"imageIndex":1}]},{"id":13211580,"frames":[{"imageOffset":16894,"symbol":"__psynch_cvwait","symbolLocation":10,"imageIndex":0},{"imageOffset":26593,"symbol":"_pthread_cond_wait","symbolLocation":1243,"imageIndex":2},{"imageOffset":7673832,"symbol":"caml_condition_wait","symbolLocation":104,"imageIndex":1},{"imageOffset":82077,"symbol":"camlDune__exe__Logging__next_1306","symbolLocation":109,"imageIndex":1},{"imageOffset":81557,"symbol":"camlDune__exe__Logging__with_lock_1175","symbolLocation":69,"imageIndex":1},
...
{"imageOffset":81557,"symbol":"camlDune__exe__Logging__with_lock_1175","symbolLocation":69,"imageIndex":1}]},{"id":13211581,"frames":[{"imageOffset":41910,"symbol":"__select","symbolLocation":10,"imageIndex":0},{"imageOffset":7670911,"symbol":"caml_thread_tick","symbolLocation":79,"imageIndex":1},{"imageOffset":25177,"symbol":"_pthread_start","symbolLocation":125,"imageIndex":2},{"imageOffset":7291,"symbol":"thread_start","symbolLocation":15,"imageIndex":2}]},{"triggered":true,"id":13211582,"instructionState":{"instructionStream":{"bytes":[255,72,137,141,56,255,255,255,72,141,141,56,255,255,255,72,137,136,32,1,0,0,15,40,5,163,189,0,0,15,17,133,64,255,255,255,72,141,69,208,72,137,133,80,255,255,255,72,209,254,76,139,71,16,72,139,127,24,247,199,0,1,0,0,117,49,73,131,248,2,15,140,244,0,0,0,185,1,0,0,0,184,2,0,0,0,69,49,237,186,1,0,0,0,102,144,73,15,175,84,201,40,72,99,200,131,192,1,73,57,200,127,239,235,53,73,141,88,255,186,1,0,0,0,72,133,219,126,32,184,1,0,0,0,49,201,15,31,132,0,0,0,0,0,73,15,175,84,201,40,72,99,200,131,192,1,72,57,203,127,239,72,131,198,255,76,99,235,72,133,246,15,136,160,0,0,0,77,133,246,15,136,151,0,0,0,73,209,254,74,141,4],"offset":96}},"threadState":{"r13":{"value":0},"rax":{"value":15174876},"rflags":{"value":66066},"cpu":{"value":10},"r14":{"value":113},"rsi":{"value":0},"r8":{"value":4329131920,"symbolLocation":0,"symbol":"camlSlirp__fun_10784"},"cr2":{"value":140307588972544},"rdx":{"value":0},"r10":{"value":192},"r9":{"value":140307467573504},"r15":{"value":123145356942736},"rbx":{"value":280617594359521},"trap":{"value":14,"description":"(no mapping for user data read)"},"err":{"value":4},"r11":{"value":105553175449660},"rip":{"value":4336655808,"matchesCrashFrame":1},"rbp":{"value":123145356909136},"rsp":{"value":123145356908928},"r12":{"value":4345770592,"symbolLocation":0,"symbol":"Caml_state"},"rcx":{"value":15174875},"flavor":"x86_THREAD_STATE","rdi":{"value":72057594037927941}},"frames":[{"imageOffset":7884224,"symbol":"caml_ba_sub","symbolLocation":208,"imageIndex":1},{"imageOffset":809160,"symbol":"camlLuv__UDP__fun_3102","symbolLocation":232,"imageIndex":1},{"imageOffset":7902469,"symbol":"caml_start_program","symbolLocation":73,"imageIndex":1},
...
{"imageOffset":7902469,"symbol":"caml_start_program","symbolLocation":73,"imageIndex":1},{"imageOffset":7902469,"symbol":"caml_start_program","symbolLocation":73,"imageIndex":1}]},{"id":13211584,"frames":[{"imageOffset":16894,"symbol":"__psynch_cvwait","symbolLocation":10,"imageIndex":0},{"imageOffset":26593,"symbol":"_pthread_cond_wait","symbolLocation":1243,"imageIndex":2},{"imageOffset":7643945,"symbol":"uv_cond_wait","symbolLocation":9,"imageIndex":1},{"imageOffset":7576118,"symbol":"worker","symbolLocation":86,"imageIndex":1},{"imageOffset":25177,"symbol":"_pthread_start","symbolLocation":125,"imageIndex":2},{"imageOffset":7291,"symbol":"thread_start","symbolLocation":15,"imageIndex":2}]},{"id":13211585,"frames":[{"imageOffset":16894,"symbol":"__psynch_cvwait","symbolLocation":10,"imageIndex":0},{"imageOffset":26593,"symbol":"_pthread_cond_wait","symbolLocation":1243,"imageIndex":2},{"imageOffset":7643945,"symbol":"uv_cond_wait","symbolLocation":9,"imageIndex":1},{"imageOffset":7576118,"symbol":"worker","symbolLocation":86,"imageIndex":1},{"imageOffset":25177,"symbol":"_pthread_start","symbolLocation":125,"imageIndex":2},{"imageOffset":7291,"symbol":"thread_start","symbolLocation":15,"imageIndex":2}]},{"id":13211586,"frames":[{"imageOffset":16894,"symbol":"__psynch_cvwait","symbolLocation":10,"imageIndex":0},{"imageOffset":26593,"symbol":"_pthread_cond_wait","symbolLocation":1243,"imageIndex":2},{"imageOffset":7643945,"symbol":"uv_cond_wait","symbolLocation":9,"imageIndex":1},{"imageOffset":7576118,"symbol":"worker","symbolLocation":86,"imageIndex":1},{"imageOffset":25177,"symbol":"_pthread_start","symbolLocation":125,"imageIndex":2},{"imageOffset":7291,"symbol":"thread_start","symbolLocation":15,"imageIndex":2}]},{"id":13211587,"frames":[{"imageOffset":16894,"symbol":"__psynch_cvwait","symbolLocation":10,"imageIndex":0},{"imageOffset":26593,"symbol":"_pthread_cond_wait","symbolLocation":1243,"imageIndex":2},{"imageOffset":7643945,"symbol":"uv_cond_wait","symbolLocation":9,"imageIndex":1},{"imageOffset":7576118,"symbol":"worker","symbolLocation":86,"imageIndex":1},{"imageOffset":25177,"symbol":"_pthread_start","symbolLocation":125,"imageIndex":2},{"imageOffset":7291,"symbol":"thread_start","symbolLocation":15,"imageIndex":2}]}],
  "usedImages" : [
  {
    "source" : "P",
    "arch" : "x86_64",
    "base" : 140703378776064,
    "size" : 237560,
    "uuid" : "0c2fd2c9-777c-3355-b70f-7b1b6e9d1b0b",
    "path" : "\/usr\/lib\/system\/libsystem_kernel.dylib",
    "name" : "libsystem_kernel.dylib"
  },
  {
    "source" : "P",
    "arch" : "x86_64",
    "base" : 4328771584,
    "size" : 9568256,
    "uuid" : "be9b5943-d786-3f0c-9f65-b987a3b2d1d6",
    "path" : "\/Applications\/Docker.app\/Contents\/Resources\/bin\/com.docker.vpnkit",
    "name" : "com.docker.vpnkit"
  },
  {
    "source" : "P",
    "arch" : "x86_64",
    "base" : 140703379013632,
    "size" : 49144,
    "uuid" : "13b5e252-77d1-31e1-888d-1c5f4426ea87",
    "path" : "\/usr\/lib\/system\/libsystem_pthread.dylib",
    "name" : "libsystem_pthread.dylib"
  },
  {
    "size" : 0,
    "source" : "A",
    "base" : 0,
    "uuid" : "00000000-0000-0000-0000-000000000000"
  }
],
  "sharedCache" : {
  "base" : 140703375060992,
  "size" : 21474836480,
  "uuid" : "840e528a-0c70-3c6a-b7b4-4f05f32ccc51"
},
  "vmSummary" : "ReadOnly portion of Libraries: Total=201.5M resident=0K(0%) swapped_out_or_unallocated=201.5M(100%)\nWritable regions: Total=2.7G written=0K(0%) resident=0K(0%) swapped_out=0K(0%) unallocated=2.7G(100%)\n\n                                VIRTUAL   REGION \nREGION TYPE                        SIZE    COUNT (non-coalesced) \n===========                     =======  ======= \nKernel Alloc Once                    8K        1 \nMALLOC                           944.2M      125 \nMALLOC guard page                   24K        5 \nMALLOC_MEDIUM (reserved)           1.3G       15         reserved VM address space (unallocated)\nMALLOC_NANO (reserved)           384.0M        1         reserved VM address space (unallocated)\nSTACK GUARD                       56.0M        8 \nStack                             41.6M        8 \nVM_ALLOCATE                          4K        1 \n__DATA                            7443K       38 \n__DATA_CONST                       247K       34 \n__DATA_DIRTY                        63K       23 \n__LINKEDIT                       187.3M        3 \n__OBJC_RO                         65.1M        1 \n__OBJC_RW                         1982K        1 \n__TEXT                            14.2M       42 \ndyld private memory                256K        1 \nshared memory                       16K        3 \n===========                     =======  ======= \nTOTAL                              3.0G      310 \nTOTAL, minus reserved VM space     1.3G      310 \n",
  "legacyInfo" : {
  "threadTriggered" : {

  }
},
  "trialInfo" : {
  "rollouts" : [
    {
      "rolloutId" : "610d52e1fc54bc3389840408",
      "factorPackIds" : {
        "SIRI_UNDERSTANDING_ASR_ASSISTANT" : "632b79c0ad93210495dd7045",
        "SIRI_UNDERSTANDING_MORPHUN" : "62ec7220c682040ba94e6a20"
      },
      "deploymentId" : 240000507
    },
    {
      "rolloutId" : "61675b89201f677a9a4cbd65",
      "factorPackIds" : {
        "HEALTH_FEATURE_AVAILABILITY" : "6337495fa33d3500e4e7e330"
      },
      "deploymentId" : 240000040
    }
  ],
  "experiments" : [

  ]
}
}

@scpedicini
Copy link

Just wanted to confirm this happens on my Mac M1 Pro with Docker Desktop v4.13.0, and seems to occur once a day apropos of nothing. No containers running and Docker Desktop is idle when it locks up.

Crash log shows com.docker.vpnkit:

Exception Type:        EXC_BAD_ACCESS (SIGSEGV)
Exception Codes:       KERN_INVALID_ADDRESS at 0x0000000168000000
Exception Codes:       0x0000000000000001, 0x0000000168000000
Exception Note:        EXC_CORPSE_NOTIFY

@mikehoyle
Copy link

mikehoyle commented Nov 23, 2022

Confirming this is happening on Docker Desktop v4.14.1 (91661), installed on Debian Linux. It generally will last an hour or so before entering this "Docker Desktop is stopping" state.

Edit: Can also confirm that the problem no longer occurs after deleting Docker metadata and downgrading to 4.12.0

@kenkku
Copy link

kenkku commented Nov 24, 2022

I am experiencing the same issue, vpnkit crashes pretty much 100% of the time when a container runs for few minutes. Basically same stack trace, it crashes in caml_ba_sub.

edit: Docker Desktop version is 4.14.1 (91661) and I'm running it on an M1 Mac

@kershyll
Copy link

If this one still crashes (hopefully not), I'd be interested to see any new stack traces to see how they differ.

Just reporting back, for me it hasn't crashed yet.
However, I have a very low network load (only running a single container with a pi-hole setup), so if it's related to that, I can't really contribute to that issue anymore.

@kenkku
Copy link

kenkku commented Nov 25, 2022

Thanks for the report. Does anyone have a self-contained repro I could try? (Edited to add: I've got some leads, based on the crash reports, but I want to make sure I'm looking in the right place.)

Edit again: in case it helps, I've reverted some changes related to the stack traces. I have an Apple Silicon binary if you want to try it: com.docker.vpnkit-darwin-arm64.zip

% shasum com.docker.vpnkit-darwin-arm64 
00f7ec5196891c8d63203667ce88ec5a1f45cd91  com.docker.vpnkit-darwin-arm64

To install it on Ventura I had to open up System Settings / Privacy & Security and add the Terminal as a program which can modify applications. This might be because of my local security settings though.

The new vpnkit can be installed by:

mv /Applications/Docker.app/Contents/Resources/bin/com.docker.vpnkit /Applications/Docker.app/Contents/Resources/bin/com.docker.vpnkit.backup
mv com.docker.vpnkit-darwin-arm64 /Applications/Docker.app/Contents/Resources/bin/com.docker.vpnkit

and then restart Docker. If this one still crashes (hopefully not), I'd be interested to see any new stack traces to see how they differ.

I tried this binary today and it crashed on the second run of my container. The container generates 200-300 MB of network traffic in one run (based on the statistics in Docker Desktop).

I checked before running that the vpnkit binary is correct:

~> shasum /Applications/Docker.app/Contents/Resources/bin/com.docker.vpnkit
00f7ec5196891c8d63203667ce88ec5a1f45cd91  /Applications/Docker.app/Contents/Resources/bin/com.docker.vpnkit

Here's the stack trace from the crashed thread:

Thread 1 Crashed:
0   com.docker.vpnkit             	       0x102f6c2d8 caml_ba_sub + 172
1   com.docker.vpnkit             	       0x102f70408 caml_c_call + 28
2   com.docker.vpnkit             	       0x102f70408 caml_c_call + 28
3   com.docker.vpnkit             	       0x102f650e0 caml_callback3 + 64
4   com.docker.vpnkit             	       0x102f24f60 luv_recv_trampoline + 96
5   com.docker.vpnkit             	       0x102f37b08 uv__udp_io + 268
6   com.docker.vpnkit             	       0x102f3ab08 uv__io_poll + 992
7   com.docker.vpnkit             	       0x102f2ade4 uv_run + 372
8   com.docker.vpnkit             	       0x102f20cf4 luv_stub_blocking_1_uv_run + 104
9   com.docker.vpnkit             	       0x102f70408 caml_c_call + 28
10  com.docker.vpnkit             	       0x102f64d80 caml_callback_exn + 44
11  com.docker.vpnkit             	       0x102f3c3c8 caml_thread_start + 112
12  libsystem_pthread.dylib       	       0x19be5426c _pthread_start + 148
13  libsystem_pthread.dylib       	       0x19be4f08c thread_start + 8

For reference, here's a stack from a crash few days ago:

Thread 3 Crashed:
0   com.docker.vpnkit             	       0x1034606b0 caml_ba_sub + 392
1   com.docker.vpnkit             	       0x1034645c4 caml_c_call + 28
2   com.docker.vpnkit             	       0x1034645c4 caml_c_call + 28
3   com.docker.vpnkit             	       0x103459518 caml_callback3 + 64
4   com.docker.vpnkit             	       0x103412d64 luv_recv_trampoline + 96
5   com.docker.vpnkit             	       0x10342bf80 uv__udp_io + 268
6   com.docker.vpnkit             	       0x10342ef8c uv__io_poll + 992
7   com.docker.vpnkit             	       0x10341f2a0 uv_run + 392
8   com.docker.vpnkit             	       0x103415cd0 luv_stub_blocking_1_uv_run + 104
9   com.docker.vpnkit             	       0x1034645c4 caml_c_call + 28
10  com.docker.vpnkit             	       0x1034591b8 caml_callback_exn + 44
11  com.docker.vpnkit             	       0x103430850 caml_thread_start + 112
12  libsystem_pthread.dylib       	       0x1bc40426c _pthread_start + 148
13  libsystem_pthread.dylib       	       0x1bc3ff08c thread_start + 8

edit: the stack trace with slightly different offset from caml_ba_sub might actually be from a previous version of Docker Desktop, as I tried updating when the problem first occurred. I also have other stack traces with an offset of 172 from caml_ba_sub with the original binary that shipped with Docker Desktop

@oenu
Copy link

oenu commented Dec 23, 2022

This issue is still present in docker v 4.15.0

@stanimirivanovde
Copy link

I confirm v4.15.0 is still crashing for me. I'm staying at 4.12.0 for now.

@ackerthehacker2
Copy link

ackerthehacker2 commented Dec 23, 2022 via email

@fdambrosio
Copy link

I have the same problem with docker 4.15 and macos 12.6

@Niemi
Copy link

Niemi commented Jan 6, 2023

Me too.
docker images  ✔  1095  11:51:38 error during connect: Get "http://%2FUsers%2Falekseikurepin%2F.rd%2Fdocker.sock/v1.24/images/json": EOF
docker-desktop 4.15 and macOS 12.4

@fdambrosio
Copy link

I'm testing the last 4.16.2 (95914) version (with macOs 12.6) and it doesn't 'stop' after minutes, it seems to work! :-)

@bewareofgeek
Copy link

Have we found a solution to this? I am experiencing the same vpnkit crash with network traffic. As mentioned earlier, it always happens with torrents. Never with usenet downloads since it doesn't make many connections at once. the container will run indefinitely until there are torrent downloads, then I can almost never complete a torrent and often after the crash, I have to verify local data on torrents. I am running 4.16.2 (95914)

@stanimirivanovde
Copy link

I've been using 4.12 and it works great. I gave up on upgrading

@djs55
Copy link
Contributor

djs55 commented Feb 21, 2023

The remaining crash should be fixed in the upcoming 4.17. If you'd like to try a release candidate build:

If there's still an issue, please upload some diagnostics, quote the ID here and I'll take a look.

@miketrimmel
Copy link

Facing the same problem as described here. Hiw can I reset docker?

@ackerthehacker2
Copy link

ackerthehacker2 commented Mar 15, 2023 via email

@stanimirivanovde
Copy link

If someone has a better experience with 4.17 or another approach please let me know. I am using 4.12 and it works great.

@Ador-able
Copy link

I'm using version 4.17.1 (windows), and I still have the same problem.

[2023-03-29T00:03:24.943922100Z][com.docker.backend.exe][E] com.docker.vpnkit.exe with pid: 14560 shutdown with exit code 3221225477

@Ador-able
Copy link

Ador-able commented Mar 29, 2023

Run the qbittorrent container and start 10 seeds. Waiting for a while, you will find com.docker.vpnkit.exe constantly collapse and restart.

But as others say, the same container, V4.12 runs well.

@WencesJ
Copy link

WencesJ commented May 2, 2023

You can either downgrade to v4.12 or what just worked for me now was changing some of the following values in the docker settings.json file:

Library/"Group Containers"/group.com.docker/settings.json

to

  "requireVmnetd": true,
  "useVirtualizationFramework": true,
  "useVirtualizationFrameworkVirtioFS": false,
  "wslEngineEnabled": true

you can use nano in your terminal to edit the file:

nano Library/"Group Containers"/group.com.docker/settings.json

@stan-threatmate
Copy link

stan-threatmate commented May 2, 2023

I upgraded yesterday from 4.12 to Docker 4.19 on Mac OS latest and all my issues have been fixed. And the performance is improved significantly.

@ErickGiffoni
Copy link

I am facing a very similar issue here. Docker won't stop Postgres and desktop won't quit.

Screenshot 2024-09-11 at 15 23 28

It happens when I click the stop box/button.

Running on version 4.33.0 (160616)
Engine: 27.1.1
Compose: v2.29.1-desktop.1
Credential Helper: v0.8.2

macOS Monterey 12.7.6

I have to find all docker's PID and kill them or open Activity Monitor and kill everything also

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests