Gamestreaming Development Preview

[AreaScout]

Hi all

I just want to give you a small preview for Gamestreaming on the Odroid-Go Adv., it uses the VPU to decode the video stream and the 2D raster graphic acceleration unit to rotate the screen to landscape mode, it runs very smooth and sound and input has very little lag however I will try to speed this up again with DRM Prime video decoding.



RG

[mad_ady]

This looks great! Can you do it the other way around?

[AreaScout]

From macOS to the Go Adv. ?

[rooted]

Very nice, I didn't think moonlight would work so well on such a low resolution display.

I think mad_ady is looking for the same thing as myself, I would love to stream from the Go Advance to my Android TV or perhaps the N2. I know these devices can play games on their own but since the Go Advance already has the emulators, games, and controls it would be cool to use it in this way.

[AreaScout]

@rooted

It works very well, I was playing half an hour Asphalt9 on it --> extra cool

@all

Beside that, my WIFI has lags, does anyone know what I can do about it ? My WIFI USB stick is half a meter from the WIFI router so the distance isn't the problem

Code: Select all

64 bytes from 192.168.1.1: icmp_seq=482 ttl=64 time=2.69 ms
64 bytes from 192.168.1.1: icmp_seq=483 ttl=64 time=2.68 ms
64 bytes from 192.168.1.1: icmp_seq=484 ttl=64 time=2.14 ms
64 bytes from 192.168.1.1: icmp_seq=485 ttl=64 time=2.54 ms
64 bytes from 192.168.1.1: icmp_seq=486 ttl=64 time=3784 ms
64 bytes from 192.168.1.1: icmp_seq=487 ttl=64 time=2785 ms
64 bytes from 192.168.1.1: icmp_seq=488 ttl=64 time=1788 ms
64 bytes from 192.168.1.1: icmp_seq=489 ttl=64 time=789 ms
64 bytes from 192.168.1.1: icmp_seq=490 ttl=64 time=8.14 ms
64 bytes from 192.168.1.1: icmp_seq=491 ttl=64 time=2.57 ms

RG

[rooted]

Beside that, my WIFI has lags, does anyone know what I can do about it ? My WIFI USB stick is half a meter from the WIFI router so the distance isn't the problem

Disable power save:

Code: Select all

sudo vi /etc/NetworkManager/conf.d/default-wifi-powersave-on.conf

Change the 3 which is enabled to 2 which is disabled and reboot.

[AreaScout]

@rooted

Very nice find But in my case that didn't help

RG

[rooted]

@rooted

Very nice find But in my case that didn't help

RG

Interesting, it made a huge difference on my WiFi.

[AreaScout]

I think I will order one of those USB2Ethernet adapters if I don't get it working, did you use wpa_supplicant to connect to your WIFI ?

[rooted]

I think I will order one of those USB2Ethernet adapters if I don't get it working, did you use wpa_supplicant to connect to your WIFI ?

I just followed the wiki and used nmcli

Code: Select all

sudo nmcli dev wifi con 'your SSID' password 'your password'

My router is using wpa2/AES

[AreaScout]

Yes !!! That did work, so wpa_supplicant must have been the issue haha nice, I am happy that it works, thank you so much

RG

[rooted]

Yes !!! That did work, so wpa_supplicant must have been the issue haha nice, I am happy that it works, thank you so much

RG

You're welcome.

[odroid]

WPA supplicant had too many issues and we switched to the nmcli over a year ago.
https://wiki.odroid.com/troubleshooting ... etup_nmcli

[AreaScout]

@odroid

I was following the tutorial on the wiki just one menu entry above from here https://wiki.odroid.com/troubleshooting ... wifi_setup that should be deleted then

RG

[AreaScout]

Some other developers still need it probably.
So I've emphasis the warning message on that wiki page.

warn.png (66.99 KiB) Viewed 7881 times

[AreaScout]

@all



Moonlight for GoAdv. consists of two working video backend (platforms), both of them are HW accelerated, they are sdl and rk

For pairing with your game pc you have to issue ./moonlight pair xxx.xxx.xxx.xxx after that you can ask/list for shared games with ./moonlight list xxx.xxx.xxx.xxx the streaming itself is startet with

zero copy (drm prime) video backend entirely without GPU (VPU->rotate->VOP):

./moonlight stream xxx.xxx.xxx.xxx -app GameName -fps 30 -720 -platform rk

or VPU, 2D Accelerator, GPU renderer/scaler sdl2 backend

./moonlight stream xxx.xxx.xxx.xxx -app GameName -fps 30 -720 -platform sdl

Streaming is very fast and with very very little lag with both of the backends, however the rockchip drm prime backend is the fastest but it could be that the difference is not noticeable and is within microseconds.

I have only testet 720p30 but 720p60 or 1080p30, 1080p60 should be possible too if your WLAN is fast enough, high-end wireless router (802.11n dual-band recommended) or wired network is recommended, which I do not have

Moonlight 2.4.10 GoAdv./Rockchip

Here is the download of the final version of Moonlight Gamestreaming client for the GoAdv. ready for game image builders, the debian package does NOT resolve package dependencies you have to install it for your own, here they are in detail:

Code: Select all

        libgamestream.so.4 => /home/odroid/moonlight-embedded/libgamestream/libgamestream.so.4 (0x0000007f90ce7000)
        libz.so.1 => /lib/aarch64-linux-gnu/libz.so.1 (0x0000007f90cad000)
        liblzma.so.5 => /lib/aarch64-linux-gnu/liblzma.so.5 (0x0000007f90c7d000)
        libm.so.6 => /lib/aarch64-linux-gnu/libm.so.6 (0x0000007f90bc3000)
        libSDL2-2.0.so.0 => /usr/lib/aarch64-linux-gnu/libSDL2-2.0.so.0 (0x0000007f90abb000)
        libX11.so.6 => /usr/lib/aarch64-linux-gnu/libX11.so.6 (0x0000007f90992000)
        libEGL.so => /usr/local/lib/aarch64-linux-gnu/libEGL.so (0x0000007f8e44b000)
        libasound.so.2 => /usr/lib/aarch64-linux-gnu/libasound.so.2 (0x0000007f8e356000)
        libevdev.so.2 => /usr/lib/aarch64-linux-gnu/libevdev.so.2 (0x0000007f8e32d000)
        libopus.so.0 => /usr/lib/aarch64-linux-gnu/libopus.so.0 (0x0000007f8e2e0000)
        libudev.so.1 => /lib/aarch64-linux-gnu/libudev.so.1 (0x0000007f8e2b6000)
        libdl.so.2 => /lib/aarch64-linux-gnu/libdl.so.2 (0x0000007f8e2a1000)
        libmoonlight-common.so.4 => /home/odroid/moonlight-embedded/libgamestream/libmoonlight-common.so.4 (0x0000007f8e25e000)
        libpthread.so.0 => /lib/aarch64-linux-gnu/libpthread.so.0 (0x0000007f8e232000)
        libpulse-simple.so.0 => /usr/lib/aarch64-linux-gnu/libpulse-simple.so.0 (0x0000007f8e21d000)
        libvdpau.so.1 => /usr/lib/aarch64-linux-gnu/libvdpau.so.1 (0x0000007f8e209000)
        libpulse.so.0 => /usr/lib/aarch64-linux-gnu/libpulse.so.0 (0x0000007f8e1b7000)
        libdrm.so.2 => /usr/lib/aarch64-linux-gnu/libdrm.so.2 (0x0000007f8e197000)
        librockchip_mpp.so.1 => /usr/local/lib/librockchip_mpp.so.1 (0x0000007f8e06c000)
        librga.so => /usr/local/lib/aarch64-linux-gnu/librga.so (0x0000007f8e052000)
        libc.so.6 => /lib/aarch64-linux-gnu/libc.so.6 (0x0000007f8def9000)

RG and have fun

[memeka]

Some other developers still need it probably.
So I've emphasis the warning message on that wiki page.
warn.png

that is interesting because i think nmcli uses wpa_supplicant

[meveric]

I use /etc/network/interfaces directly (I did not configure wpa_supplicant in ANY way).. but if you check with ifup -v wlan0 you see that it uses wpa_supplicant in the background as well.
So I also assume wpa_supplicant works fine, but using it directly to start wifi is not the best idea, rather rely on other methods like nmcli and /etc/network/interfaces.

[AreaScout]

Even finding an working tutorial for wpa_supplicant was really hard I spend nearly 4 hours on it to make it "work", so odroid was right, it's bad, nmcli on the other hand took only a one liner to execute and make it work just perfect

RG

[meveric]

try removing wpasupplicant (if it's still installed) and see if WLAN is still working with nmcli. Many application rely on wpasupplicant in the background, and you basically just switching the "frontend" part for connecting.

[AreaScout]

@meveric

That would be a bad idea because nmcli has wpasupplicant as an dependency, it uses parts of it, but that doesn't mean that it has to be as bad as using wpa_supplicant as stand alone wlan connection

RG

[meveric]

That's basically what I said.. You complain that wpasupplicant is bad, but in fact you're using wpaspupplicant.
The frontend/configuration of wpasupplicant (directly) is not the best, but the software itself is actually what you need.
So doesn't really matter if you use nmcli or any of the other methods, in the end you're using wpasupplicant. You just choose the frontend that you like best.

[AreaScout]

nmcli doesn't use wpa_supplicant in case of WEP key encryption mechanism, so obviously it only needs it for the WPA key encryption mechanism, but that's not the point, the point is that with the wpa_supplicant tutorial you can/get a bad WIFI connection, that's why it has a info for it now to use nmcli

RG

[AreaScout]

@all

New moonlight game streaming client based on qt (ported moonlight-qt) coming up soon with GUI to start from Emulationstation, browse games, change settings, close games, quit games

IMG_3594_2.jpg (75.45 KiB) Viewed 6832 times

RG

[Josh86]

NICE! Looking forward to trying out streaming! Will there be any kind of accessible GUI options for tweaking stream settings?

Keyboard support? Will we need to use an external keyboard or will there be some kind of OSK that can be used/activated like on most mobile platforms?

[AreaScout]

@Josh86

IMG_3595_.jpg (61.93 KiB) Viewed 6791 times

As you can see you can adjust settings from within the settings view, moonlight will search for any PCs with NVIDIA GameStream enabled, if for some reason it does not find it you have to connect a keyboard and manually add the IP of your GameStream PC, but in most cases it will find it i.e GoAdv is in same subnet with GameStream PC.

RG

[Durante]

Very nice, looking forward to it!

Edit: I don't know much about NV gamestream, does it have the ability to stream native 3:2 aspect ratio if a game supports that?

[rooted]

You have really taken it to the next level with the upcoming release, nice work.

[AreaScout]

Edit: I don't know much about NV gamestream, does it have the ability to stream native 3:2 aspect ratio if a game supports that?

@Durante

Basically the desktop resolution is being streamed not the game resolution, there are windows store games with 3:2 resolution but they do run windowed

@all

Here is a small video I did with moonlight-qt so you can see how to work with the streaming client



P.S.: Sorry for the strong moiré effect in the video, for sure there is some settings with the camera to reduce it but I still don't know all settings the camera has

RG

[ripper121]

When will this ready to install by apt-get?
Or will be there a new Image file?

[Durante]

Basically the desktop resolution is being streamed not the game resolution, there are windows store games with 3:2 resolution but they do run windowed

Intersting. So if one were to create a custom 3:2 desktop resolution it should work? (As long as the game supports it of course)

[AreaScout]

@Durante

No, it will always stream desktop resolution of either 720p, 1080p 1440p and 4k as far as I know (1440p and 4k are not supported on the GoAdv)

@ripper121

There will be a deb package for the stock Ubuntu 18.04 image and you will be able to build it from source for other images soon

RG

[odroid]

@AreaScout,

I have a question.
What is the average/max speed (bit rate) of the wifi connection while you play games via streaming?
Is it over 30Mbps?

[joy]

@AreaScout,
That's cool!
I look forward to getting a new deb soon. ( We need a newer deb than moonlight_2.4.10-1_arm64.deb that you shared with us before, right? )

[AreaScout]

@odroid

The picture from the settings view of moonlight shows a bitrate for 720p and 60fps of 9.5Mbps, so theoretically it can not be more then 30Mbps because input and audio does not add that extra load, I will log the exact network traffic for that settings, any setting higher than 9.5Mbps does not make sense on that small LCD as far as I can tell.

@joy

Yes you need a new package, today I will upload and share the information on how to install and use it

RG

[AreaScout]

moonlight-qt

Here is the first release of moonlight-qt (A Gamestreaming Client WITH GUI) for the ODROID Go Adv.



The binary and this tutorial is for the Ubuntu 18.04 stock image

Install moonlight + dependencies:

moonlight-qt

Code: Select all

wget https://www.areascout.at/moonlight-qt-go2_1.2.1-1_arm64.deb
sudo dpkg -i moonlight-qt-go2_1.2.1-1_arm64.deb
sudo apt install libopus0 libssl1.1 libsdl2-ttf-2.0-0 libsdl2-2.0-0 libpulse0 libasound2 liblzma5 zlib1g libvdpau1 libva-x11-2 libwayland-client0 libva-drm2 libva2 libqt5svg5 libqt5gui5 libqt5qml5 libqt5network5 libqt5core5a libc6 libgcc1 qml-module-qtgraphicaleffects qml-module-qtquick-controls2 qml-module-qtquick-dialogs qml-module-qtquick-layouts qml-module-qtquick-privatewidgets qml-module-qtquick-templates2 qml-module-qtquick-window2 qml-module-qtquick2

We will also need librga, librockchip-mpp1, libdrm and libsdl2 build with KMS/DRM support, librga is already preinstalled, if you do not have the others, here is how to build them (sorry we do not have our own package server configured for the GoA to provide it)

Build libdrm:

Code: Select all

git clone -b rockchip-2.4.95 https://github.com/rockchip-linux/libdrm-rockchip.git
cd libdrm-rockchip
./autogen.sh --enable-rockchip-experimental-api
make -j3
sudo make install

Build SDL2 for KMS/DRM:

Install GPU driver development header files + library:

Code: Select all

wget https://oph.mdrjr.net/meveric/pool/go2/libm/libmali-rk/libmali-rk-bifrost-g31-rxp0-gbm_1.7-1+deb10_arm64.deb
wget https://oph.mdrjr.net/meveric/pool/go2/libm/libmali-rk/libmali-rk-dev_1.7-1+deb10_arm64.deb
sudo apt install ./libmali-rk-dev_1.7-1+deb10_arm64.deb ./libmali-rk-bifrost-g31-rxp0-gbm_1.7-1+deb10_arm64.deb

Build + install dependencies

Code: Select all

sudo apt-get install libxext-dev xutils-dev gettext libtool libx11-dev libsm-dev libxext-dev git g++ cmake mercurial libudev-dev libdrm-dev zlib1g-dev pkg-config libasound2-dev libfreetype6-dev libx11-xcb1 libxcb-dri2-0 

Code: Select all

cd ~
git clone https://github.com/AreaScout/SDL.git
cd SDL
./autogen.sh
./configure --disable-video-opengl --enable-video-kmsdrm
make -j3
sudo make install

after configure is finished you should see this line Video drivers : dummy x11(dynamic) kmsdrm(dynamic) opengl_es1 opengl_es2 vulkan

Code: Select all

make -j3
sudo cp build/.libs/libSDL2.so /usr/lib/aarch64-linux-gnu/. 

Building RockChip mpp video decoder libraries:

Code: Select all

cd ~
git clone https://github.com/rockchip-linux/mpp.git
cd mpp
cmake -DRKPLATFORM=ON -DHAVE_DRM=ON .
make -j3
sudo make install

Configuration and usage:

As Qt5 which is used for the GUI of moonlight is build for many video backends X11, Wayland, KMS/DRM a.s.o we have to tell Qt5 which video backend we should use, for this we have to setup some environment variables

Edit the .bashrc file under /home/odroid or /root depending on which user moonlight should run and add this at the end of the file:


export QT_QPA_PLATFORM=eglfs
export QT_QPA_EGLFS_INTEGRATION=eglfs_kms
export QT_QPA_EGLFS_KMS_CONFIG=/home/odroid/gbm.json
export QT_LOGGING_RULES=qt.qpa.*=true


Re-login

Code: Select all

su - odroid

The logging environment variable is not needed (last one), the json config file is needed to tell if we use a hardware cursor or not, the rest is an extra lesson

Code: Select all

{
  "device": "/dev/dri/card0",
  "hwcursor": true,
  "pbuffers": false,
  "outputs": [
    {
      "name": "DSI-1",
      "mode": "320x480",
      "format": "argb8888"
    }
  ]
}

It could be that you need to correct permissions for the video processor device node with

Code: Select all

sudo chown root:video /dev/vpu_service
sudo chmod 660 /dev/vpu_service

Now moonlight should be able to start, after pairing by clicking on the PC icon with your PC name (it should be automatically discovered) you can open the setting view by pressing X or SELECT button, with L1 and R1 you can do page down and up with the D-Pad up and down you can highlight your selection and with the B button you can select settings, each game should be closed after gaming.
To disconnect a running game press START+SELECT+L1+R1
To toggle mouse emulation if needed press START+SELECT+L1


The default mapping is shown on the first picture above and is compiled in, if you want to add a custom mapping file gamecontrollerdb.txt the search path order is as follows:

1. Same path like the moonlight binary /usr/local/bin
2. ~/.local/share/Moonlight Game Streaming Project/Moonlight/gamecontrollerdb.txt
3. /usr/local/share/Moonlight Game Streaming Project/Moonlight/gamecontrollerdb.txt
4. /usr/share/Moonlight Game Streaming Project/Moonlight/gamecontrollerdb.txt

Adding some cool Windows 10 Store Games (probably Boulder Dash or Spelunker clones ) to Nvidia Gamestreaming:

Press windows+R on your Windows PC and type shell:AppsFolder into the window, a Windows explorer window will open with your installed Games/Apps, browse for the right Game, right click it and choose create shortcut a new Icon should be created on your Desktop, now open NVIDIA GeForce Experience form your taskbar, click on the settings icon in the top right corner, then on the left click SHIELD and now on that dialog you can add a game manually, click add, go and browse for the desktop shortcut created before, edit and change the name of the game to something more easily and add game icon of your choice (download from internet).

P.S.: If you find something not working please report it here, I couldn't test HEVC 1080p60 streaming because my GPU card does not support it, only H264, so please test this also

PP.S.: Do not choose native resolution (it's way to small for streaming a 320x480 frame) and 1440p or 4k, it will not work and will probably crash the app, the ODROID GoA supports 720p and 1080p ! I will delete those settings in the next release

That's it happy Streaming 🕹🕹

[AreaScout]

@AreaScout,

I have a question.
What is the average/max speed (bit rate) of the wifi connection while you play games via streaming?
Is it over 30Mbps?

@odroid

I was wrong with "any setting higher than 9.5Mbps does not make sense on that small LCD" anything higher than 20Mbps doesn't make sense would be more the trues

Here is the exact network traffic taken with nload, first picture with 720p60 20Mbps and second with 1080p60 20Mbps

IMG_1456.png (32.18 KiB) Viewed 6183 times

IMG_1457.png (30.57 KiB) Viewed 6183 times

RG

[odroid]

Glad to hear that 20Mbps was fine.

[TheRuck]

I was able to get the moonlight working using your tutorial on the latest test build (ubuntu-20.04-4.4-es-odroid-goA-trial-20200818.img)

To get the nice menu entries I had to add a theme into the (/etc/emulationstation/themes/es-theme-simple/) directory.
ZIP attached (

moonlight.zip

(16.96 KiB) Downloaded 22 times

)

I created a directory ( /home/odroid/ngs/ ) and placed a shell script ( Start Game Streaming.sh )

Start Game Streaming.sh:

Code: Select all

#!/bin/bash
/usr/local/bin/moonlight

I then copied the ( /etc/emulationstation/es_systems.cfg ) file to ( /home/odroid/.emulationstation/es_systems.cfg )
And added the following code to the end of the file ( /home/odroid/.emulationstation/es_systems.cfg ) before the </systemList> tag:

Code: Select all

    <system>
            <name>moonlight</name>
            <fullname>Moonlight Game Streaming</fullname>
            <path>/home/odroid/ngs/</path>
            <extension>.sh</extension>
            <command>perfmax;%ROM%;perfnorm</command>
            <platform></platform>
            <theme>moonlight</theme>
    </system>

[TheRuck]

UPDATE
I figured it out!

I had to set:
Resolution to 720p/60fps with 15mbps.
Video decoder to (Force hardware decoding)
Video Codec to H.264



SOLVED
I have it working but I seem to have a ghost image and a green line across the left and top.
Have you seen this? If so, what is the fix? I am using the 720p at 60fps. Tried other settings, same thing, except native.

[AreaScout]

Hi

What video backend are you using for Streaming ?

RG

[TheRuck]

I am unsure what backend it is using by default. I followed your instructions here:
viewtopic.php?p=283815#p283815

I used the supplied deb and compiled the dependencies.

[kernot]

Hi all,
Following AreaScout manual.
I'm getting an error when doing the make install from this step:
////
cd ~
git clone https://github.com/AreaScout/SDL.git
cd SDL
./autogen.sh
./configure --disable-video-opengl --enable-video-kmsdrm
make -j3
sudo make install
////
The error is:
In file included from /home/ark/SDL/src/video/kmsdrm/SDL_kmsdrmevents.c:26:
/home/ark/SDL/src/video/kmsdrm/SDL_kmsdrmvideo.h:37:10: fatal error: rga/RgaApi.h: No such file or directory
37 | #include <rga/RgaApi.h>

I have ensured that I have librga installed on my system.

Thanks you guys in advance.

[AreaScout]

@kernot

Just install librga + it's development package with:

Code: Select all

wget https://oph.mdrjr.net/meveric/pool/main/libr/librga-odroid/librga-odroid_20200317-1+deb10_arm64.deb
wget https://oph.mdrjr.net/meveric/pool/main/libr/librga-odroid-dev/librga-odroid-dev_20200317-1+deb10_all.deb

sudo apt install ./librga-odroid_20200317-1+deb10_arm64.deb ./librga-odroid-dev_20200317-1+deb10_all.deb

RG

[AreaScout]

@all

Guys, game streaming to the new Go Super is far better than streaming to the Go2, the display size comes handy the case feels solid, it's fast, it works, it's stable, it's updated, it has two thumbstick, it's tearing free and cool

Hold on for a release soon

game_stream.png (1.18 MiB) Viewed 433 times

RG

[AreaScout]

@all

Some more pictures testing some games

GoSuper_Stream.png (3.03 MiB) Viewed 380 times

RG

[Shoesy]

Super cool! Will the new build work on oga 1 / be too?

[AreaScout]

Of course it will