how to vnc with unity3d in docker?

[twyeld]

Since I have a Unity3D level running nicely in docker using nVidia to accelerate the graphics, now I want to access it from a remote device using vnc viewer. How to add vnc to container and make run for remote viewing?

[mviereck]

Overall I am less experienced with remote setups, but it is possible.

I recommend to use xpra instead of VNC.
Most VNC servers run their own X server. x11docker can access this X server, too, but it would not be GPU accelerated but use software rendering only.

An example for remote access with xpra is given in the wiki: SSH with xpra

Server setup:

read Xenv < <(x11docker --xvfb --display=30 --showenv x11docker/lxde pcmanfm)

# Output of new X environment, just for info
echo $Xenv
# You can drop `--display=30` in command above if you provide DISPLAY
# from this output to following xpra commands instead of :30

# start xpra server with new environment variables.
# (replace "start" with "start-desktop" to forward a desktop environment)
env $Xenv xpra start :30 --use-display --start-via-proxy=no

Replace the x11docker command in the brackets with your own command. The example uses an invisible software accelerated Xvfb X server. You probably want a visible X server with GPU acceleration.

On the client run:

# Attach xpra client over SSH to xpra server
xpra attach ssh:$HOSTNAME:30     # replace $HOSTNAME with IP or host name of ssh server

Please try out if you get a working setup with this example. Note that it helps to specify a display number with e.g. --display=30.

[mviereck]

You are trying something completely different than I suggested. You are running xpra in container, but my example runs xpra on the host/the server.

Please try first the example as given in the wiki without changing it. Once you got that working, we can carefully adjust the command to fit your needs.

EDIT: github is somehow disordering the comments yet.

[twyeld]

can't seem to ssh into container

tried:

docker run --hostname=myContainer xpra-nvidia

but doesn't run - and can't use --net=host with namespaces enabled...

any ideas?

[mviereck]

Please try first to get my example running. We need a working point to start from.

[twyeld]

ok - I tried this:

read Xenv < <(x11docker --xvfb --display=30 --showenv [myImage] xterm)

but just hangs after a few warnings and notes

[twyeld]

I am trying this:
Dockerfile

FROM x11docker/nvidia-base

RUN apt-get update && apt-get install -y xpra xterm

CMD xpra start :100 --exit-with-children --start-child nvidia-base-game-app-xpra

build:

docker build -t nvidia-base-game-app-xpra .

run:

x11docker --hostdisplay --gpu nvidia-base-game-app-xpra xterm

[twyeld]

ok - I used a lxde image to launch pcmanfm
then:

env $Xenv xpra start-desktop:30 --use-display --start-via-proxy=no

which returns: Entering daemon mode;
and then:

xpra attach ssh:10.xx.xx.xxx:30

but this returns:

xpra initialization error:
 failed to connect to '10.xx.xx.xxx:22':
 [Errno 111] Connection refused

[twyeld]

if I launch pcfman normally no problems:

x11docker [mylxde_image] pcmanfm
``
only when I use "read Xenv < <(x11docker..." etc  pcfman doesn't launch and i can't seem to connect to the host

[mviereck]

You are using different display number. Here it is 30:

xpra attach ssh:10.xx.xx.xxx:30

But in the error message it is 22:

failed to connect to '10.xx.xx.xxx:22':

Please be precise in the report when describing the steps you did. The command you show does not match the output of the error message.

If you connect through a firewall, e.g. through one in a router, you probably need to allow access, some sort of passthrough. Unfortunately I am not familar with this, and different firewalls or routers might have different configurations.

To exclude firewall issues, try on a single local machine for now.

only when I use "read Xenv < <(x11docker..." etc pcfman doesn't launch and i can't seem to connect to the host

It is correct that you does not see pcmanfm immediately. It runs on an invisible Xvfb X server (option --xvfb). It needs the xpra attach command to make it visible.

Try on one computer:

read Xenv < <(x11docker --xvfb --display=30 --no-auth --showenv x11docker/lxde pcmanfm)
env $Xenv xpra start :30 --use-display --start-via-proxy=no --daemon=no

(I've added --daemon=no so xpra might show possible issues.)
(I've also added --no-auth to avoid possible X authentication issues for now.)

In a different terminal window on the same computer try:

myhost="$(hostname)"
xpra attach ssh:$myhost:30

(Variable myhost will contain the local name of your computer.)

[twyeld]

I specified display 30 it returns 22:

twyeld@twyeld-OptiPlex-7040:~$ myhost="$twyeld"
twyeld@twyeld-OptiPlex-7040:~$ xpra attach ssh:$myhost:30
2019-11-03 22:47:39,936 Xpra gtk2 client version 2.4.3-r21350M 64-bit
2019-11-03 22:47:39,937  running on Linux Ubuntu 19.04 disco
2019-11-03 22:47:39,938  window manager is 'GNOME Shell'
2019-11-03 22:47:39,949 Warning: failed to import opencv:
2019-11-03 22:47:39,949  No module named cv2
2019-11-03 22:47:39,949  webcam forwarding is disabled
2019-11-03 22:47:40,408 GStreamer version 1.15.90 for Python 2.7.16 64-bit
2019-11-03 22:47:40,471 No OpenGL_accelerate module loaded: No module named OpenGL_accelerate
2019-11-03 22:47:40,708 OpenGL enabled with GeForce GTX 1050 Ti/PCIe/SSE2
2019-11-03 22:47:40,779 Error: printing disabled:
2019-11-03 22:47:40,779  No module named cups
xpra initialization error:
 failed to connect to '127.0.0.1:22':
 [Errno 111] Connection refused

[twyeld]

also - in the first terminal I get the message:

x11docker WARNING: --xvfb: X server :30 runs without cookie authentication.

bash: read: `DISPLAY=:30': not a valid identifier

[twyeld]

it might be worth noting that if I run xpra in the terminal to launch its GUI I can get a xterm running but cannot connect to it on the same machine or remote.

if I type in a terminal: "$ xpra --start -start=xterm" I do not get a xterm at all...

anyway, I need to sleep now - its very late - thank you for your help - I will check again in the morning

[mviereck]

It's odd. Let's try this, now with display number 40.
I execute these commands on my machine:

read Xenv < <(x11docker --xvfb --display=40 --no-auth --showenv x11docker/lxde pcmanfm)
env $Xenv xpra start :40 --use-display --start-via-proxy=no --daemon=no

In a second terminal window I execute:

myhost="$(hostname)"
xpra attach ssh:$myhost:40

This is what I get in the first terminal window:

lauscher@buster:~$ read Xenv < <(x11docker --xvfb --display=40 --no-auth --showenv x11docker/lxde pcmanfm)
x11docker WARNING: User lauscher is member of group docker.
  That allows unprivileged processes on host to gain root privileges.

x11docker note: Option --xvfb: Specifying quite big virtual screen size
  for --xvfb: 4720x3840
  This costs some memory, but will fit most possible remote screens.
  To save memory, specify needed screen size only with e.g. --size=1980x1200
  Check output of 'xrandr | grep current' on your target display.

x11docker WARNING: Option --no-auth: SECURITY RISK!
  Allowing access to new X server for everyone.

x11docker WARNING: --xvfb: X server :40 runs without cookie authentication.

lauscher@buster:~$ env $Xenv xpra start :40 --use-display --start-via-proxy=no --daemon=no
** (pcmanfm:137): WARNING **: 13:05:01.264: The directory '~/Templates' doesn't exist, ignoring it

2019-11-03 13:05:14,941 created unix domain socket '/run/user/1000/xpra/buster-40'
2019-11-03 13:05:14,941 cannot create group socket '/run/xpra/buster-40'
2019-11-03 13:05:14,941  [Errno 13] Permission denied
2019-11-03 13:05:15,075 pointer device emulation using XTest
2019-11-03 13:05:15,215 serving html content from '/usr/share/xpra/www'
2019-11-03 13:05:16,497 4x AMD A6-7310 APU with AMD Radeon R4 Graphics
2019-11-03 13:05:16,513 Warning: no XShm support on display :40
2019-11-03 13:05:16,540 xvfb pid not found
2019-11-03 13:05:18,857 OpenGL is supported on display ':40'
2019-11-03 13:05:18,858  using 'llvmpipe (LLVM 9.0, 128 bits)' renderer
2019-11-03 13:05:18,920 Warning: failed to load the mdns publisher
2019-11-03 13:05:18,921  No module named 'avahi'
2019-11-03 13:05:18,921  either install the 'python-avahi' module
2019-11-03 13:05:18,921  or use the 'mdns=no' option
2019-11-03 13:05:18,953 Warning: cannot forward notifications,
2019-11-03 13:05:18,953  the interface is already claimed
2019-11-03 13:05:18,953  if you do not have a dedicated dbus session for this xpra instance,
2019-11-03 13:05:18,954  use the 'notifications=no' option
2019-11-03 13:05:18,981 pulseaudio server started with pid 5404
2019-11-03 13:05:18,982  private server socket path:
2019-11-03 13:05:18,982  '/run/user/1000/xpra/pulse-40/pulse/native'
2019-11-03 13:05:19,860 GStreamer version 1.16.1 for Python 3.7.5 64-bit

(Xpra:5333): Gtk-CRITICAL **: 13:05:19.915: gtk_widget_realize: assertion 'widget->priv->anchored || GTK_IS_INVISIBLE (widget)' failed
2019-11-03 13:05:20,111 Warning: webcam forwarding is disabled
2019-11-03 13:05:20,112  the virtual video directory '/sys/devices/virtual/video4linux' was not found
2019-11-03 13:05:20,112  make sure that the 'v4l2loopback' kernel module is installed and loaded
2019-11-03 13:05:20,113 found 0 virtual video devices for webcam forwarding
2019-11-03 13:05:20,172 xpra is ready.
2019-11-03 13:05:20,173 xpra GTK3 X11 version 4.0-r24051 64-bit
2019-11-03 13:05:20,466  uid=1000 (lauscher), gid=1000 (lauscher)
2019-11-03 13:05:20,466  running with pid 5333 on Linux Debian testing bullseye
2019-11-03 13:05:20,467  connected to X11 display :40 with 24 bit colors


2019-11-03 13:05:26,678 printer forwarding enabled using postscript and pdf
2019-11-03 13:05:26,713 watching for applications menu changes in:
2019-11-03 13:05:26,714  '/usr/share/xfce4/applications'
2019-11-03 13:05:26,714  '/usr/local/share/applications'
2019-11-03 13:05:26,714  '/usr/share/applications'
2019-11-03 13:05:26,714  '/usr/share/applications'
2019-11-03 13:05:27,672 Warning: icon is quite large (92 KB):
2019-11-03 13:05:27,673  '/home/lauscher/.local/share/icons/rosa-icons/72x72/apps/preferences-desktop.svg'
2019-11-03 13:05:27,708 Warning: icon is quite large (238 KB):
2019-11-03 13:05:27,708  '/home/lauscher/.local/share/icons/rosa-icons/72x72/apps/preferences-system-network.svg'
2019-11-03 13:05:28,182 Warning: icon is quite large (233 KB):
2019-11-03 13:05:28,182  '/usr/share/icons/hicolor/scalable/status/xfce4-power-manager-settings.svg'
2019-11-03 13:05:29,000 Warning: icon is quite large (157 KB):
2019-11-03 13:05:29,001  '/home/lauscher/.local/share/icons/rosa-icons/72x72/apps/preferences-system-session-services.svg'
2019-11-03 13:05:31,161 6.8GB of system memory

This is what I get in the second terminal window:

lauscher@buster:~$ myhost="$(hostname)"
lauscher@buster:~$ xpra attach ssh:$myhost:40
2019-11-03 13:06:39,489 Xpra GTK3 X11 client version 4.0-r24051 64-bit
2019-11-03 13:06:39,771  running on Linux Debian testing bullseye
2019-11-03 13:06:39,774  window manager is 'Xfwm4'
2019-11-03 13:06:39,829 Warning: failed to import opencv:
2019-11-03 13:06:39,829  No module named 'cv2'
2019-11-03 13:06:39,830  webcam forwarding is disabled
2019-11-03 13:06:40,697 GStreamer version 1.16.1 for Python 3.7.5 64-bit
2019-11-03 13:06:41,050 No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
2019-11-03 13:06:41,925 OpenGL enabled with AMD KABINI (DRM 2.50.0, 5.2.0-3-amd64, LLVM 9.0.0)
2019-11-03 13:06:42,240 Connected (version 2.0, client OpenSSH_8.1p1)
please enter the passphrase for /home/lauscher/.ssh/id_rsa:
2019-11-03 13:06:50,229 cannot load key from file '/home/lauscher/.ssh/id_rsa':
2019-11-03 13:06:50,230  Could not deserialize key data.
2019-11-03 13:06:50,231 Error: cannot load private key '/home/lauscher/.ssh/id_rsa'
2019-11-03 13:06:50,243 SSH password authentication failed:
2019-11-03 13:06:50,243  Bad authentication type; allowed types: ['publickey', 'password']
please enter the SSH password for lauscher@buster:
2019-11-03 13:06:59,602 Authentication (password) successful!
2019-11-03 13:06:59,737  keyboard settings: rules=evdev, model=pc105, layout=de
2019-11-03 13:06:59,746  desktop size is 1920x1080 with 1 screen:
2019-11-03 13:06:59,747   :0.0 (508x285 mm - DPI: 96x96) workarea: 1870x1045 at 50x35
2019-11-03 13:06:59,747     BOE eDP (344x193 mm - DPI: 141x142)
2019-11-03 13:07:00,629 enabled fast mmap transfers using 256MB shared memory area
2019-11-03 13:07:00,630 enabled remote logging
2019-11-03 13:07:00,631 Xpra GTK3 X11 server version 4.0-r24051 64-bit
2019-11-03 13:07:00,632  running on Linux Debian testing bullseye
2019-11-03 13:07:00,680 Attached to ssh://lauscher@buster/40
2019-11-03 13:07:00,681  (press Control-C to detach)

2019-11-03 13:07:01,109 server does not support xi input devices
2019-11-03 13:07:01,110  server uses: xtest
2019-11-03 13:07:01,641 sound output found 2 audio output devices:
2019-11-03 13:07:01,641 sound output  * Internes Audio Analog Stereo
2019-11-03 13:07:01,642 sound output    alsa_output.pci-0000_00_14.2.analog-stereo
2019-11-03 13:07:01,642 sound output  * Internes Audio
2019-11-03 13:07:01,642 sound output    alsa_card.pci-0000_00_01.1
2019-11-03 13:07:01,643 sound output  to select a specific one,
2019-11-03 13:07:01,643 sound output  use the environment variable 'XPRA_PULSE_SINK_DEVICE_NAME'
2019-11-03 13:07:01,643 sound output using default pulseaudio device
2019-11-03 13:07:02,187 sound output using 'opus' audio codec

(In the second terminal window I am prompted for the user password)

Please run exactly the same commands and show me the full output like I did.

[twyeld]

ok - here is my output:
first terminal window:

twyeld@twyeld-OptiPlex-7040:~$ read Xenv < <(x11docker --xvfb --display=40 --no-auth --showenv lxde-vnc pcmanfm)
x11docker WARNING: User twyeld is member of group docker.
  That allows unprivileged processes on host to gain root privileges.

x11docker note: Option --xvfb: Specifying quite big virtual screen size
  for --xvfb: 4720x3840
  This costs some memory, but will fit most possible remote screens.
  To save memory, specify needed screen size only with e.g. --size=1980x1200
  Check output of 'xrandr | grep current' on your target display.

x11docker WARNING: Option --no-auth: SECURITY RISK!
  Allowing access to new X server for everyone.

x11docker WARNING: --xvfb: X server :40 runs without cookie authentication.

twyeld@twyeld-OptiPlex-7040:~$ env $Xenv xpra start :40 --use-display --start-via-proxy=no --daemon=no
x11docker WARNING: Unable to change /etc/passwd. That may be a security risk.

x11docker WARNING: Cannot change /etc/shadow. That may be a security risk.

x11docker note: Failed to add container user to group video.

x11docker note: Failed to add container user to group audio.

x11docker note: Failed to add container user to group render.

2019-11-04 09:34:17,174 created unix domain socket: /run/user/1000/xpra/twyeld-OptiPlex-7040-40
2019-11-04 09:34:17,175 cannot create group socket '/run/xpra/twyeld-OptiPlex-7040-40'
2019-11-04 09:34:17,175  [Errno 13] Permission denied
2019-11-04 09:34:17,269 Warning: no XShm support on display :40
2019-11-04 09:34:17,753 pointer device emulation using XTest
2019-11-04 09:34:20,197  OpenGL is supported on this display
2019-11-04 09:34:20,258 html server unavailable, cannot find websockify module
2019-11-04 09:34:20,377 Warning: cannot forward notifications, the interface is already claimed
2019-11-04 09:34:20,377  if you do not have a dedicated dbus session for this xpra instance,
2019-11-04 09:34:20,377  use the 'notifications=no' option
2019-11-04 09:34:20,758 Warning: webcam forwarding is disabled
2019-11-04 09:34:20,758  the virtual video directory '/sys/devices/virtual/video4linux' was not found
2019-11-04 09:34:20,758  make sure that the 'v4l2loopback' kernel module is installed and loaded
2019-11-04 09:34:20,758 found 0 virtual video devices for webcam forwarding
2019-11-04 09:34:22,033 Warning: failed to load the mdns publisher
2019-11-04 09:34:22,034  No module named avahi
2019-11-04 09:34:22,035  either fix your installation or use the 'mdns=no' option
2019-11-04 09:34:22,036 xpra X11 version 2.4.3-r21350M 64-bit
2019-11-04 09:34:22,036  uid=1000 (twyeld), gid=1000 (twyeld)
2019-11-04 09:34:22,037  running with pid 10780 on Linux Ubuntu 19.04 disco
2019-11-04 09:34:22,037  connected to X11 display :40 with 24 bit colors
2019-11-04 09:34:22,072 xpra is ready.
2019-11-04 09:34:22,177 23.5GB of system memory

** (pcmanfm:141): WARNING **: 09:34:25.793: The directory '~/Templates' doesn't exist, ignoring it

second terminal window:

twyeld@twyeld-OptiPlex-7040:~$ myhost="$twyeld"
twyeld@twyeld-OptiPlex-7040:~$ xpra attach ssh:$myhost:40
2019-11-04 09:37:08,733 Xpra gtk2 client version 2.4.3-r21350M 64-bit
2019-11-04 09:37:08,733  running on Linux Ubuntu 19.04 disco
2019-11-04 09:37:08,735  window manager is 'GNOME Shell'
2019-11-04 09:37:08,746 Warning: failed to import opencv:
2019-11-04 09:37:08,746  No module named cv2
2019-11-04 09:37:08,746  webcam forwarding is disabled
2019-11-04 09:37:09,206 GStreamer version 1.15.90 for Python 2.7.16 64-bit
2019-11-04 09:37:09,270 No OpenGL_accelerate module loaded: No module named OpenGL_accelerate
2019-11-04 09:37:09,516 OpenGL enabled with GeForce GTX 1050 Ti/PCIe/SSE2
2019-11-04 09:37:09,588 Error: printing disabled:
2019-11-04 09:37:09,588  No module named cups
xpra initialization error:
 failed to connect to '127.0.0.1:22':
 [Errno 111] Connection refused

[twyeld]

ok - some small success
I rolled back from ssh to tcp:

host machine:

read Xenv < <(x11docker --xvfb --display=9999 --no-auth --showenv nvidia-base-game-app xterm)
env $Xenv xpra start :9999 --use-display --start-via-proxy=no --daemon=no --bind-tcp=0.0.0.0:10000

remote/local machine:

xpra attach tcp:172.17.0.1:10000

this worked for both the lxde/pcfman and my unity3D game compile(example above), but the graphics is very slow

how to optimise to get a better frame rate?

[mviereck]

ok - some small success
this worked for both the lxde/pcfman and my unity3D game compile(example above)

great!

You have changed:

myhost="$(hostname)"

to:

myhost="$twyeld"

Why? What is the content of variable $twyeld?
Please use literally myhost="$(hostname)" or e.g. myhost=172.17.0.1 if this is a valid IP address of yours.

how to optimise to get a better frame rate?

At this point it becomes a bit special. You have an NVIDIA GPU. With NVIDIA only options --hostdisplay and --xorg are useable.

The x11docker command needs to be adjusted:

read Xenv < <(x11docker --xvfb --display=9999 --no-auth --showenv nvidia-base-game-app xterm)

Instead of --xvfb, try with --xorg. However, you cannot type into console than, so you need to put the lines into a script file and execute that. Try a script like this:

#! /bin/bash
read Xenv < <(x11docker --xorg --gpu --display=9999 --no-auth --showenv nvidia-base-game-app xterm)
env $Xenv xpra start :9999 --use-display --start-via-proxy=no --daemon=no --bind-tcp=0.0.0.0:10000

On a second machine, try to attach to the X server:

xpra attach tcp:172.17.0.1:10000

[twyeld]

ok - I got this to work - but with a few problems:

1. when I run the bash script, xorg takes over the host machine so I can't access the terminal
2. xterm pops up in the xorg screen on the host machine but it is black
3. connecting from a remote machine is fine but the xterm on the remote machine is not interactive - can't type in it etc
4. i can type in the host machine xterm but can't see what i am typing - need to view from remote machine..
5. but, the frame rate is much better once i get my app running!

is there any way to make xorg run in a shell window? ie overcome some of these problems?

also, I can only connect to the host machine inside the company firewall

[mviereck]

ok - I got this to work - but with a few problems:
but, the frame rate is much better once i get my app running!

Great!

xterm pops up in the xorg screen on the host machine but it is black

xpra normally shows the window content on the client only. But you can optionally show it on the server, too, at the cost of some performance. From man xpra:

--sync-xvfb=DELAY
              The windows are normally only displayed on the client(s),  they  are
              not  painted  on the virtual display.  Some applications like screen
              recorders may want to capture the window contents, you can use  this
              option  to  enable  painting with a configurable delay (in millisec‐
              onds).  Warning: this extra painting is expensive  and  quite  slow,
              which is why it is not enabled by default.

Try in the xpra start command e.g. --sync-xvfb=0 or --sync-xvfb=100.

connecting from a remote machine is fine but the xterm on the remote machine is not interactive - can't type in it etc

Please add --xtest in the x11docker command. That is an inofficial/undocumented option yet. xpra will need that, I did not thought of this before, sorry.

i can type in the host machine xterm but can't see what i am typing - need to view from remote machine..

:-D Should be fixed with the hints above.

when I run the bash script, xorg takes over the host machine so I can't access the terminal

With NVIDIA x11docker only can provide accelerated --xorg and --hostdisplay. Try with --hostdisplay. In that case, you cannot specify the display number with --display=9999. Instead, type echo $DISPLAY on the server and use that display number.

lauscher@buster:~$ echo $DISPLAY
:0.0

Use :0 without the appending .0. You probably must not use --no-auth.

also, I can only connect to the host machine inside the company firewall

There is not much I can do. The firewall must allow some sort of access from the outside. You could ask your company admin. xpra allows a lot of configurations, be it ssh or tcp, and which ports and which encryption methods it uses and so on. A default xpra ssh setup is already well done from a security point of view. But I am not experienced in network setups and can't say much more than that. Maybe the admin would allow you an ssh access from outside.

[twyeld]

excellent!
most of that worked - using xtest means I can type in the xterm of the remote window.
but trying to access the display on the host machine is too problematic and when it does work it slows everything down too much.
I am happy to just access remotely.
thank you for your help!
I will continue to post here as I explore this concept further...

[mviereck]

Did you succeed meanwhile to access from outside?
If you can use ssh in general, it should be possible to use xpra ssh as well.

There is a success with xpra ssh in #197.
The key was a slghtly changed syntax in the xpra attach command.
Try something like:

xpra attach ssh://USERNAME@SERVERIP/40

Replace USERNAME and SERVERIP accordingly and 40 with the display number.

[twyeld]

I don't have permission to access my adhoc server from outside the firewall. I will have to wait until I migrate to an external server...