Very slow network speed with H2+ (one direction)

Post Reply
bwa
Posts: 2
Joined: Mon Aug 17, 2020 10:56 pm
languages_spoken: english
ODROIDs: H2+
N2 (4Gb)
Has thanked: 0
Been thanked: 1 time
Contact:
Contact bwa

Very slow network speed with H2+ (one direction)

Post by bwa »

Hi.

I have been working hard to get my H2+ to performe on the 2.5G network with Microtik and Cisco switches.

On direction always end up with 200Mb or less, when testing between two H2+ devices with iperf3.

I have tested EVERY thing. Downgradet switch software, tried other Cisco switches, tweaked iperf etc. etc.

Two dayes of my live spend with testing and reinstalling.

And the problem is the Realtek driver that Odroid link to in the install guide.

I got my Ubuntu 20.04.1 up at full speed today, and im so happy now. :-)

This post is just a warning to other people, that tries to buy new hardware and devices to fix the issue. It seems to be a driver problem, not the switches.

Best regards,

Brian W Andersen


Result with new 5.9.0RC1 kernel (build in support rtl8125b)

Setup

(H2+ cluster3 10.1.1.103/10.2.2.103) <-> (Microtik CRS305-1G-4S+IN) <-> (H2+ cluster4 10.1.1.104/10.2.2.104)


10.1.1.0/24 = 1G network Cisco 3560-CX
10.2.2.0/24 = 2.5G Microtik CRS305-1G-4S+IN


2.5G on Microtik switch.

bwa@cluster3:~$ iperf -c 10.2.2.104
------------------------------------------------------------
Client connecting to 10.2.2.104, TCP port 5001
TCP window size: 1.35 MByte (default)
------------------------------------------------------------
[ 3] local 10.2.2.103 port 39298 connected with 10.2.2.104 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-10.0 sec 2.52 GBytes 2.16 Gbits/sec

bwa@clusteer4:~$ iperf -c 10.2.2.103
------------------------------------------------------------
Client connecting to 10.2.2.103, TCP port 5001
TCP window size: 876 KByte (default)
------------------------------------------------------------
[ 3] local 10.2.2.104 port 32788 connected with 10.2.2.103 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-10.0 sec 2.47 GBytes 2.12 Gbits/sec


1G on Cisco switch.

bwa@cluster3:~$ iperf -c 10.1.1.104
------------------------------------------------------------
Client connecting to 10.1.1.104, TCP port 5001
TCP window size: 1.04 MByte (default)
------------------------------------------------------------
[ 3] local 10.1.1.103 port 38058 connected with 10.1.1.104 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-10.0 sec 1.09 GBytes 940 Mbits/sec

bwa@clusteer4:~$ iperf -c 10.1.1.103
------------------------------------------------------------
Client connecting to 10.1.1.103, TCP port 5001
TCP window size: 629 KByte (default)
------------------------------------------------------------
[ 3] local 10.1.1.104 port 53154 connected with 10.1.1.103 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-10.0 sec 1.09 GBytes 940 Mbits/sec
These users thanked the author bwa for the post:
domih (Wed Aug 19, 2020 12:08 pm)
Top
User avatar
rooted
Posts: 8512
Joined: Fri Dec 19, 2014 9:12 am
languages_spoken: english
Location: Gulf of Mexico, US
Has thanked: 740 times
Been thanked: 345 times
Contact:
Contact rooted

Re: Very slow network speed with H2+ (one direction)

Post by rooted »

Did Hardkernel ever verify your issue or anyone else?
Top
bwa
Posts: 2
Joined: Mon Aug 17, 2020 10:56 pm
languages_spoken: english
ODROIDs: H2+
N2 (4Gb)
Has thanked: 0
Been thanked: 1 time
Contact:
Contact bwa

Re: Very slow network speed with H2+ (one direction)

Post by bwa »

Hi

I just posted this today, as a help to other with my problem. Don’t know about Odroid, but other people have the same problem, and it is easy to reproduce.

While trying to fix this I google and found people buying new switches and USB net devices. That is a waste of money, when the problem is software. One guy wrote about the same problem at Microtik forum. (Same hardware that I use)

Most was actually people with multiple H2+talking together. I got 4 x HPE micro servers with 10G NIC, and the problem was different here (talking from 2.5G to 10G and back) Worst was from 2.5G to 2.5G.

One forum wrote about Odroid testing with a switch, from South Korea, that didn’t have the issue.

I have 5 x H2+ as a CEPH storage, to a openstack cloud. (Home lab) I got the fastest M2 flash disk 32Gb of memory and data stripping across them all. But because of the slow network, my VM only managed 5 MB/sek and IO countable on one hand. Moving glance RAW image to and around in CEPH, was a pain, since RAW image is full size. (Unlike QCOWS2)

It only takes 5 command lines to upgrade the kernel, and se the difference. Of course RC1 kernel is not the best kernel and ZFS is not supported yet. But it seems to work much better in my setup.
Top
User avatar
rooted
Posts: 8512
Joined: Fri Dec 19, 2014 9:12 am
languages_spoken: english
Location: Gulf of Mexico, US
Has thanked: 740 times
Been thanked: 345 times
Contact:
Contact rooted

Re: Very slow network speed with H2+ (one direction)

Post by rooted »

Yeah I saw MikroTik and thought you were the same person, I'm the one who suggested they seek help over there as well.

It's good to know a kernel update resolves the issue, the driver is quite new and it's understandable there are teething problems
Top
User avatar
odroid
Site Admin
Posts: 37371
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English, Korean
ODROIDs: ODROID
Has thanked: 1785 times
Been thanked: 1139 times
Contact:
Contact odroid

Re: Very slow network speed with H2+ (one direction)

Post by odroid »

Thank you for sharing a good news.
We will look into the Kernel 5.9 RC1 more carefully and check any possible way to back-port the rtl8125b related new drivers to Ubuntu stock Kernel 5.4.
Top
domih
Posts: 403
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, N2+, H2, H2+, C4, HC4 - 1GbE, 2.5GbE, 10GbE, 40+GbE
Location: San Francisco Bay Area
Has thanked: 156 times
Been thanked: 154 times
Contact:
Contact domih

Re: Very slow network speed with H2+ (one direction)

Post by domih »

@odroid

(1) I'll test kernel 5.9 RC1 to confirm the slower speed with 1GbE switches is solved (940 vs 820 Gbits/sec) on my side too. HOWEVER, note that the Realtek download page (https://www.realtek.com/en/component/zo ... s-software) shows the latest version to be r8125-9.003.05.tar.bz2 posted on 2020/05/25. I have it installed on one of my H2+ so before switching to kernel 5.9 RC1 I believe it is useful to test this latest driver version again with a 1GbE switch. Last time I tried it was with 9.003.02 or 9.003.03. If 9.003.05 fixes the issue, then no need to upgrade the kernel entirely, simply update the driver. If not, then it means that the kernel developers do something extra (to the driver or the kernel itself?). I'll try to test it tomorrow evening or on Wed.

(2) I think I'll also re-test the connection to the 10G SFP+ switch Microtik CRS317-1G-16S+RM (in relation to this thread viewtopic.php?f=170&t=39578)

@bwa

(3) You wrote:
2.5G on Microtik switch.

bwa@cluster3:~$ iperf -c 10.2.2.104
------------------------------------------------------------
Client connecting to 10.2.2.104, TCP port 5001
TCP window size: 1.35 MByte (default)
------------------------------------------------------------
[ 3] local 10.2.2.103 port 39298 connected with 10.2.2.104 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-10.0 sec 2.52 GBytes 2.16 Gbits/sec

bwa@clusteer4:~$ iperf -c 10.2.2.103
------------------------------------------------------------
Client connecting to 10.2.2.103, TCP port 5001
TCP window size: 876 KByte (default)
------------------------------------------------------------
[ 3] local 10.2.2.104 port 32788 connected with 10.2.2.103 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-10.0 sec 2.47 GBytes 2.12 Gbits/sec
Is this the max you got so far? You should be able to reach 2.35Gbits/sec. Could you try a direct H2+ <-> other PC connection to see if the switch is for something in this 0.2 Gbits/sec lower result?
These users thanked the author domih for the post:
odroid (Tue Aug 18, 2020 4:18 pm)
Top
domih
Posts: 403
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, N2+, H2, H2+, C4, HC4 - 1GbE, 2.5GbE, 10GbE, 40+GbE
Location: San Francisco Bay Area
Has thanked: 156 times
Been thanked: 154 times
Contact:
Contact domih

Re: Very slow network speed with H2+ (one direction)

Post by domih »

The Realtek driver r8125-9.003.05 with Ubuntu Mate 20.04 kernel 5.4.0-42-generic #46-Ubuntu does NOT fix the issue:

domih@trx:~$ iperf3 -c h2d
Connecting to host h2d, port 5201
[ 5] local 192.168.1.36 port 60404 connected to 192.168.1.73 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 111 MBytes 928 Mbits/sec 0 482 KBytes
[ 5] 1.00-2.00 sec 113 MBytes 950 Mbits/sec 0 532 KBytes
[ 5] 2.00-3.00 sec 112 MBytes 937 Mbits/sec 0 559 KBytes
[ 5] 3.00-4.00 sec 112 MBytes 941 Mbits/sec 0 584 KBytes
[ 5] 4.00-5.00 sec 112 MBytes 941 Mbits/sec 0 584 KBytes
[ 5] 5.00-6.00 sec 112 MBytes 937 Mbits/sec 0 611 KBytes
[ 5] 6.00-7.00 sec 113 MBytes 944 Mbits/sec 0 670 KBytes
[ 5] 7.00-8.00 sec 112 MBytes 944 Mbits/sec 0 708 KBytes
[ 5] 8.00-9.00 sec 112 MBytes 944 Mbits/sec 0 708 KBytes
[ 5] 9.00-10.00 sec 111 MBytes 933 Mbits/sec 0 708 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 1.09 GBytes 940 Mbits/sec 0 sender
[ 5] 0.00-10.17 sec 1.09 GBytes 922 Mbits/sec receiver

domih@trx:~$ iperf3 -c h2d -R
Connecting to host h2d, port 5201
Reverse mode, remote host h2d is sending
[ 5] local 192.168.1.36 port 60408 connected to 192.168.1.73 port 5201
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 95.2 MBytes 798 Mbits/sec
[ 5] 1.00-2.00 sec 97.0 MBytes 814 Mbits/sec
[ 5] 2.00-3.00 sec 96.9 MBytes 813 Mbits/sec
[ 5] 3.00-4.00 sec 96.9 MBytes 813 Mbits/sec
[ 5] 4.00-5.00 sec 97.0 MBytes 813 Mbits/sec
[ 5] 5.00-6.00 sec 97.3 MBytes 817 Mbits/sec
[ 5] 6.00-7.00 sec 96.9 MBytes 812 Mbits/sec
[ 5] 7.00-8.00 sec 97.3 MBytes 816 Mbits/sec
[ 5] 8.00-9.00 sec 96.7 MBytes 811 Mbits/sec
[ 5] 9.00-10.00 sec 97.1 MBytes 815 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.17 sec 971 MBytes 801 Mbits/sec 2 sender
[ 5] 0.00-10.00 sec 968 MBytes 812 Mbits/sec receiver
Top
domih
Posts: 403
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, N2+, H2, H2+, C4, HC4 - 1GbE, 2.5GbE, 10GbE, 40+GbE
Location: San Francisco Bay Area
Has thanked: 156 times
Been thanked: 154 times
Contact:
Contact domih

Re: Very slow network speed with H2+ (one direction)

Post by domih »

The kernel 5.9.0-050900rc1-generic #202008162130 indeed fixes the issue:

Code: Select all

cd Downloads/
wget https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.9-rc1/amd64/linux-headers-5.9.0-050900rc1-generic_5.9.0-050900rc1.202008162130_amd64.deb
wget https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.9-rc1/amd64/linux-headers-5.9.0-050900rc1_5.9.0-050900rc1.202008162130_all.deb
wget https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.9-rc1/amd64/linux-image-unsigned-5.9.0-050900rc1-generic_5.9.0-050900rc1.202008162130_amd64.deb
wget https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.9-rc1/amd64/linux-modules-5.9.0-050900rc1-generic_5.9.0-050900rc1.202008162130_amd64.deb
sudo dpkg -i *.deb
sudo reboot
uname -a
Linux h2d 5.9.0-050900rc1-generic #202008162130 SMP Sun Aug 16 21:35:23 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux
.../...

domih@trx:~$ iperf3 -c h2d
Connecting to host h2d, port 5201
[ 5] local 192.168.1.36 port 60614 connected to 192.168.1.73 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 115 MBytes 962 Mbits/sec 0 583 KBytes
[ 5] 1.00-2.00 sec 112 MBytes 941 Mbits/sec 0 583 KBytes
[ 5] 2.00-3.00 sec 112 MBytes 941 Mbits/sec 0 583 KBytes
[ 5] 3.00-4.00 sec 112 MBytes 941 Mbits/sec 0 583 KBytes
[ 5] 4.00-5.00 sec 113 MBytes 951 Mbits/sec 0 583 KBytes
[ 5] 5.00-6.00 sec 112 MBytes 941 Mbits/sec 0 583 KBytes
[ 5] 6.00-7.00 sec 112 MBytes 941 Mbits/sec 0 583 KBytes
[ 5] 7.00-8.00 sec 112 MBytes 941 Mbits/sec 0 583 KBytes
[ 5] 8.00-9.00 sec 112 MBytes 941 Mbits/sec 0 583 KBytes
[ 5] 9.00-10.00 sec 112 MBytes 941 Mbits/sec 0 583 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 1.10 GBytes 944 Mbits/sec 0 sender
[ 5] 0.00-10.15 sec 1.10 GBytes 927 Mbits/sec receiver

domih@trx:~$ iperf3 -c h2d -R
Connecting to host h2d, port 5201
Reverse mode, remote host h2d is sending
[ 5] local 192.168.1.36 port 60618 connected to 192.168.1.73 port 5201
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 112 MBytes 940 Mbits/sec
[ 5] 1.00-2.00 sec 112 MBytes 942 Mbits/sec
[ 5] 2.00-3.00 sec 112 MBytes 942 Mbits/sec
[ 5] 3.00-4.00 sec 112 MBytes 942 Mbits/sec
[ 5] 4.00-5.00 sec 112 MBytes 941 Mbits/sec
[ 5] 5.00-6.00 sec 112 MBytes 940 Mbits/sec
[ 5] 6.00-7.00 sec 112 MBytes 941 Mbits/sec
[ 5] 7.00-8.00 sec 112 MBytes 940 Mbits/sec
[ 5] 8.00-9.00 sec 112 MBytes 940 Mbits/sec
[ 5] 9.00-10.00 sec 112 MBytes 940 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.16 sec 1.10 GBytes 928 Mbits/sec 2 sender
[ 5] 0.00-10.00 sec 1.10 GBytes 941 Mbits/sec receiver

Kudos to @bwa.

CONCLUSION: You (Odroid) should make a diff between the DKMS driver from the kernel 5.9.0 rc1 source tree and the Realtek driver r8125-9.003.05. It should show some differences. If not the fix is in the kernel itself (either a fix or a change to adapt to specifics of the Realtek driver).
Last edited by domih on Wed Aug 19, 2020 12:26 pm, edited 1 time in total.
Top
User avatar
odroid
Site Admin
Posts: 37371
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English, Korean
ODROIDs: ODROID
Has thanked: 1785 times
Been thanked: 1139 times
Contact:
Contact odroid

Re: Very slow network speed with H2+ (one direction)

Post by odroid »

@domih,
Thank you for the test. The new r8169 upstream driver seems to be solving the final puzzle.

I think a new RTL8125B specific firmware blob might improve the throughput even we need to test it though.
viewtopic.php?p=302008#p302008
Did you use the latest linux-firmware package to obtain "rtl8125b-2.fw' too?
Top
domih
Posts: 403
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, N2+, H2, H2+, C4, HC4 - 1GbE, 2.5GbE, 10GbE, 40+GbE
Location: San Francisco Bay Area
Has thanked: 156 times
Been thanked: 154 times
Contact:
Contact domih

Re: Very slow network speed with H2+ (one direction)

Post by domih »

odroid wrote: ↑
Wed Aug 19, 2020 12:25 pm
 .../...
Did you use the latest linux-firmware package to obtain "rtl8125b-2.fw' too?
No, I just installed the 5.9 rc1 kernel. Am I supposed to install that firmware too? How do I do so?
Top
User avatar
odroid
Site Admin
Posts: 37371
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English, Korean
ODROIDs: ODROID
Has thanked: 1785 times
Been thanked: 1139 times
Contact:
Contact odroid

Re: Very slow network speed with H2+ (one direction)

Post by odroid »

Normally, we run "sudo apt install linux-firmware" command.
But I am not sure if Canonical ppa server has the latest one or not.
Please try ls -alp /lib/firmware/rtl_nic/rtl81* command.
Top
domih
Posts: 403
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, N2+, H2, H2+, C4, HC4 - 1GbE, 2.5GbE, 10GbE, 40+GbE
Location: San Francisco Bay Area
Has thanked: 156 times
Been thanked: 154 times
Contact:
Contact domih

Re: Very slow network speed with H2+ (one direction)

Post by domih »

odroid wrote: ↑
Wed Aug 19, 2020 1:12 pm
 Normally, we run "sudo apt install linux-firmware" command.
But I am not sure if Canonical ppa server has the latest one or not.

Please try ls -alp /lib/firmware/rtl_nic/rtl81* command.

Code: Select all

domih@h2d:~$ ls -alp /lib/firmware/rtl_nic/rtl81*
-rw-r--r-- 1 root root 2076 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8105e-1.fw
-rw-r--r-- 1 root root 1856 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8106e-1.fw
-rw-r--r-- 1 root root  832 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8106e-2.fw
-rw-r--r-- 1 root root  992 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8107e-1.fw
-rw-r--r-- 1 root root  976 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8107e-2.fw
-rw-r--r-- 1 root root 3456 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8125a-3.fw
-rw-r--r-- 1 root root 1768 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8153a-2.fw
-rw-r--r-- 1 root root 1440 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8153a-3.fw
-rw-r--r-- 1 root root  712 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8153a-4.fw
-rw-r--r-- 1 root root 1088 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8153b-2.fw
-rw-r--r-- 1 root root 1492 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168d-1.fw
-rw-r--r-- 1 root root 1324 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168d-2.fw
-rw-r--r-- 1 root root 5500 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168e-1.fw
-rw-r--r-- 1 root root 3920 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168e-2.fw
-rw-r--r-- 1 root root 3872 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168e-3.fw
-rw-r--r-- 1 root root 3424 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168f-1.fw
-rw-r--r-- 1 root root 1232 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168f-2.fw
-rw-r--r-- 1 root root  336 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168fp-3.fw
-rw-r--r-- 1 root root 4304 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168g-1.fw
-rw-r--r-- 1 root root 4896 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168g-2.fw
-rw-r--r-- 1 root root  832 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168g-3.fw
-rw-r--r-- 1 root root  992 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168h-1.fw
-rw-r--r-- 1 root root  976 Jul 15 06:11 /lib/firmware/rtl_nic/rtl8168h-2.fw
Top
User avatar
odroid
Site Admin
Posts: 37371
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English, Korean
ODROIDs: ODROID
Has thanked: 1785 times
Been thanked: 1139 times
Contact:
Contact odroid

Re: Very slow network speed with H2+ (one direction)

Post by odroid »

I could find "rtl8125b-2.fw' file by googling. But we need to look into the source code how a fall-back function works when the .fw file doesn't exist.
https://packages.debian.org/sid/firmware-realtek
http://anduin.linuxfromscratch.org/sour ... e/rtl_nic/
Top
domih
Posts: 403
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, N2+, H2, H2+, C4, HC4 - 1GbE, 2.5GbE, 10GbE, 40+GbE
Location: San Francisco Bay Area
Has thanked: 156 times
Been thanked: 154 times
Contact:
Contact domih

Re: Very slow network speed with H2+ (one direction)

Post by domih »

odroid wrote: ↑
Wed Aug 19, 2020 1:19 pm
 I could find "rtl8125b-2.fw' file by googling. But we need to look into the source code how a fall-back function works when the .fw file doesn't exist.
https://packages.debian.org/sid/firmware-realtek
http://anduin.linuxfromscratch.org/sour ... e/rtl_nic/
I could not install the .deb because it conflicts with already installed firmware package. So I downloaded the file from the second URL and copied it manually to /lib/firmware/rtl_nic/. I then issued an update-initramfs -u and rebooted.

The 1 GbE test is basically the same and the speed issue is still gone.

domih@trx:~$ iperf3 -c h2d
Connecting to host h2d, port 5201
[ 5] local 192.168.1.36 port 33062 connected to 192.168.1.73 port 5201
[ ID] Interval Transfer Bitrate Retr Cwnd
[ 5] 0.00-1.00 sec 114 MBytes 958 Mbits/sec 0 356 KBytes
[ 5] 1.00-2.00 sec 112 MBytes 938 Mbits/sec 0 356 KBytes
[ 5] 2.00-3.00 sec 113 MBytes 945 Mbits/sec 0 356 KBytes
[ 5] 3.00-4.00 sec 112 MBytes 938 Mbits/sec 0 356 KBytes
[ 5] 4.00-5.00 sec 113 MBytes 945 Mbits/sec 0 356 KBytes
[ 5] 5.00-6.00 sec 112 MBytes 939 Mbits/sec 0 373 KBytes
[ 5] 6.00-7.00 sec 113 MBytes 945 Mbits/sec 0 373 KBytes
[ 5] 7.00-8.00 sec 112 MBytes 938 Mbits/sec 0 373 KBytes
[ 5] 8.00-9.00 sec 113 MBytes 945 Mbits/sec 0 373 KBytes
[ 5] 9.00-10.00 sec 112 MBytes 938 Mbits/sec 0 373 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 1.10 GBytes 943 Mbits/sec 0 sender
[ 5] 0.00-10.16 sec 1.10 GBytes 927 Mbits/sec receiver

iperf Done.
domih@trx:~$ iperf3 -c h2d -R
Connecting to host h2d, port 5201
Reverse mode, remote host h2d is sending
[ 5] local 192.168.1.36 port 33072 connected to 192.168.1.73 port 5201
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.00 sec 112 MBytes 942 Mbits/sec
[ 5] 1.00-2.00 sec 112 MBytes 941 Mbits/sec
[ 5] 2.00-3.00 sec 112 MBytes 941 Mbits/sec
[ 5] 3.00-4.00 sec 112 MBytes 941 Mbits/sec
[ 5] 4.00-5.00 sec 112 MBytes 942 Mbits/sec
[ 5] 5.00-6.00 sec 112 MBytes 940 Mbits/sec
[ 5] 6.00-7.00 sec 112 MBytes 941 Mbits/sec
[ 5] 7.00-8.00 sec 112 MBytes 939 Mbits/sec
[ 5] 8.00-9.00 sec 112 MBytes 941 Mbits/sec
[ 5] 9.00-10.00 sec 112 MBytes 941 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.17 sec 1.10 GBytes 927 Mbits/sec 2 sender
[ 5] 0.00-10.00 sec 1.10 GBytes 941 Mbits/sec receiver

iperf Done.
Top
User avatar
odroid
Site Admin
Posts: 37371
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English, Korean
ODROIDs: ODROID
Has thanked: 1785 times
Been thanked: 1139 times
Contact:
Contact odroid

Re: Very slow network speed with H2+ (one direction)

Post by odroid »

Tomorrow, we will check the kernel message with more verbose options to check if the new firmware was loaded successfully or not.
Top
fvolk
Posts: 606
Joined: Sun Jun 05, 2016 11:04 pm
languages_spoken: english
ODROIDs: C2, C4, H2
Has thanked: 0
Been thanked: 72 times
Contact:
Contact fvolk

Re: Very slow network speed with H2+ (one direction)

Post by fvolk »

odroid wrote: ↑
Wed Aug 19, 2020 1:19 pm
 I could find "rtl8125b-2.fw' file by googling.
There is a Git repo that contains the firmwares for the kernel - if you only need a specific file you can get them directly from there:
https://git.kernel.org/pub/scm/linux/ke ... ee/rtl_nic
These users thanked the author fvolk for the post:
domih (Thu Aug 20, 2020 2:08 am)
Top
domih
Posts: 403
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, N2+, H2, H2+, C4, HC4 - 1GbE, 2.5GbE, 10GbE, 40+GbE
Location: San Francisco Bay Area
Has thanked: 156 times
Been thanked: 154 times
Contact:
Contact domih

Re: Very slow network speed with H2+ (one direction)

Post by domih »

Kernel 5.9 rc1 fixes the slow issue of using an RTL8125 on 1 a GbE network. HOWEVER, Kernel 5.9 rc1 introduces a degradation of speed for 2.5 GbE in one direction (around 2.10 max instead of the usual 2.35). So if your main need is to always have the max 2.35 Gbits/sec in both directions for 2.5 GbE, I think the alternative solution (for now) is to use a USB 1 GbE adapter. Using the stock Kernel with the Realtek driver r8125-9.003.05 will keep both NIC running at max speed in both directions for 2.5 GbE. The USB 1 GbE adapter will give you around 920 Mbits/sec, well above the degraded 800/840 Mbits/sec.

This is while waiting for a kernel includes the driver that fixes both (old and new) issues at the same time :-)
Top
domih
Posts: 403
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, N2+, H2, H2+, C4, HC4 - 1GbE, 2.5GbE, 10GbE, 40+GbE
Location: San Francisco Bay Area
Has thanked: 156 times
Been thanked: 154 times
Contact:
Contact domih

Re: Very slow network speed with H2+ (one direction)

Post by domih »

domih wrote: ↑
Wed Aug 26, 2020 4:30 pm
 The USB 1 GbE adapter will give you around 920 Mbits/sec, well above the degraded 800/840 Mbits/sec.
To be more precise, here is a test with iperf3. The USB 1 GbE adapter is an ASIX AX88179 Gigabit Ethernet type: USB driver: ax88179_178a

Here is the result of iperf3 testing (forward at 928 Mbits/sec and reverse at 918 Mbits/sec):

Code: Select all

domih@h2e:~$ iperf3 -c h2d -t 30
Connecting to host h2d, port 5201
[  5] local 192.168.1.74 port 55598 connected to 192.168.1.73 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.00   sec   113 MBytes   946 Mbits/sec    0    962 KBytes       
[  5]   1.00-2.00   sec   111 MBytes   933 Mbits/sec    0    962 KBytes       
[  5]   2.00-3.00   sec   110 MBytes   923 Mbits/sec    0   1008 KBytes       
[  5]   3.00-4.00   sec   111 MBytes   933 Mbits/sec    0   1.09 MBytes       
[  5]   4.00-5.00   sec   110 MBytes   923 Mbits/sec    0   1.09 MBytes       
[  5]   5.00-6.00   sec   111 MBytes   933 Mbits/sec    0   1.14 MBytes       
[  5]   6.00-7.00   sec   110 MBytes   923 Mbits/sec    0   1.21 MBytes       
[  5]   7.00-8.00   sec   111 MBytes   933 Mbits/sec    0   1.21 MBytes       
[  5]   8.00-9.00   sec   110 MBytes   923 Mbits/sec    0   1.21 MBytes       
[  5]   9.00-10.00  sec   111 MBytes   933 Mbits/sec    0   1.21 MBytes       
[  5]  10.00-11.00  sec   111 MBytes   933 Mbits/sec    0   1.21 MBytes       
[  5]  11.00-12.00  sec   110 MBytes   923 Mbits/sec    0   1.21 MBytes       
[  5]  12.00-13.00  sec   110 MBytes   923 Mbits/sec    0   1.21 MBytes       
[  5]  13.00-14.00  sec   111 MBytes   933 Mbits/sec    0   1.33 MBytes       
[  5]  14.00-15.00  sec   111 MBytes   933 Mbits/sec    0   1.33 MBytes       
[  5]  15.00-16.00  sec   110 MBytes   923 Mbits/sec    0   1.82 MBytes       
[  5]  16.00-17.00  sec   110 MBytes   923 Mbits/sec    0   1.82 MBytes       
[  5]  17.00-18.00  sec   111 MBytes   933 Mbits/sec    0   1.82 MBytes       
[  5]  18.00-19.00  sec   110 MBytes   923 Mbits/sec    0   1.82 MBytes       
[  5]  19.00-20.00  sec   111 MBytes   933 Mbits/sec    0   1.82 MBytes       
[  5]  20.00-21.00  sec   110 MBytes   923 Mbits/sec    0   1.82 MBytes       
[  5]  21.00-22.00  sec   111 MBytes   932 Mbits/sec    0   1.82 MBytes       
[  5]  22.00-23.00  sec   110 MBytes   924 Mbits/sec    0   1.82 MBytes       
[  5]  23.00-24.00  sec   111 MBytes   933 Mbits/sec    0   1.82 MBytes       
[  5]  24.00-25.00  sec   110 MBytes   923 Mbits/sec    0   1.82 MBytes       
[  5]  25.00-26.00  sec   110 MBytes   923 Mbits/sec    0   1.82 MBytes       
[  5]  26.00-27.00  sec   111 MBytes   933 Mbits/sec    0   1.82 MBytes       
[  5]  27.00-28.00  sec   111 MBytes   933 Mbits/sec    0   1.82 MBytes       
[  5]  28.00-29.00  sec   110 MBytes   923 Mbits/sec    0   1.82 MBytes       
[  5]  29.00-30.00  sec   110 MBytes   923 Mbits/sec    0   1.82 MBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-30.00  sec  3.24 GBytes   928 Mbits/sec    0             sender
[  5]   0.00-30.01  sec  3.24 GBytes   928 Mbits/sec                  receiver

iperf Done.
domih@h2e:~$ iperf3 -c h2d -t 30 -R
Connecting to host h2d, port 5201
Reverse mode, remote host h2d is sending
[  5] local 192.168.1.74 port 55602 connected to 192.168.1.73 port 5201
[ ID] Interval           Transfer     Bitrate
[  5]   0.00-1.00   sec   104 MBytes   869 Mbits/sec                  
[  5]   1.00-2.00   sec   109 MBytes   917 Mbits/sec                  
[  5]   2.00-3.00   sec   110 MBytes   920 Mbits/sec                  
[  5]   3.00-4.00   sec   110 MBytes   920 Mbits/sec                  
[  5]   4.00-5.00   sec   109 MBytes   915 Mbits/sec                  
[  5]   5.00-6.00   sec   109 MBytes   916 Mbits/sec                  
[  5]   6.00-7.00   sec   109 MBytes   917 Mbits/sec                  
[  5]   7.00-8.00   sec   110 MBytes   921 Mbits/sec                  
[  5]   8.00-9.00   sec   109 MBytes   918 Mbits/sec                  
[  5]   9.00-10.00  sec   110 MBytes   920 Mbits/sec                  
[  5]  10.00-11.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  11.00-12.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  12.00-13.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  13.00-14.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  14.00-15.00  sec   109 MBytes   918 Mbits/sec                  
[  5]  15.00-16.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  16.00-17.00  sec   110 MBytes   919 Mbits/sec                  
[  5]  17.00-18.00  sec   110 MBytes   920 Mbits/sec                  
[  5]  18.00-19.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  19.00-20.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  20.00-21.00  sec   109 MBytes   914 Mbits/sec                  
[  5]  21.00-22.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  22.00-23.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  23.00-24.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  24.00-25.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  25.00-26.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  26.00-27.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  27.00-28.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  28.00-29.00  sec   110 MBytes   921 Mbits/sec                  
[  5]  29.00-30.00  sec   110 MBytes   921 Mbits/sec                  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-30.00  sec  3.21 GBytes   919 Mbits/sec    1             sender
[  5]   0.00-30.00  sec  3.21 GBytes   918 Mbits/sec                  receiver

iperf Done.
These users thanked the author domih for the post:
odroid (Fri Aug 28, 2020 1:03 pm)
Top
Post Reply

Return to “General Topics”

Who is online

Users browsing this forum: No registered users and 2 guests