[HC2] [Armbian] Slow transfer speed via Samba

Post Reply
trohn_javolta
Posts: 53
Joined: Fri Nov 03, 2017 6:16 am
languages_spoken: english, german
ODROIDs: none (plans for XU4)
Contact:

[HC2] [Armbian] Slow transfer speed via Samba

Unread post by trohn_javolta » Wed Nov 28, 2018 12:02 am

Why is samba out of the box so slow on the HC1/HC2?

I'm running latest armbian stretch stable on my HC2 but I read this also from many other os.
Filesystem on attached hdd is ext4.
I simply installed samba and samba-common, made sure it runs on the big cores and also used these settings in smb.conf to make transfer speed faster:

Code: Select all

write cache size = 524288 
getwd cache = yes 
use sendfile = yes 
min receivefile size = 16384
With these settings I "just" get 60 mb/s transfer speed! :roll:
Initially I installed OMV via armbian-config and with this tweaked OMV and its samba I got 100 mb/s!
Ran into issues and removed OMV, I don't need it anyways, for my use it's overkill.

Are there settings I'm missing here? The speed difference is enormous :o
I think with HC1/HC2 gigabit nas speeds shouldn't be a problem.
Is there maybe a custom built samba debian package out there that takes care of some tweaks for a 100 mb/s transfer speed via samba?

User avatar
odroid
Site Admin
Posts: 29348
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by odroid » Wed Nov 28, 2018 9:28 am

There must be no special custom built samba.

Try to see "cat /proc/interrupts" output first.

Code: Select all

#!/bin/bash                                                                                                                                                                              
USB3_IRQ=`cat /proc/interrupts | grep "GICv2 104" | awk -F : '{print $1}'`                                                                                                               
USB5_IRQ=`cat /proc/interrupts | grep "GICv2 105" | awk -F : '{print $1}'`                                                                                                               
echo 5 > /proc/irq/${USB3_IRQ}/smp_affinity_list                                                                                                                                         
echo 6 > /proc/irq/${USB5_IRQ}/smp_affinity_list                                                                                                                                         
                                                                                                                                                                                         
if [ -f /sys/class/net/eth0/queues/rx-0/rps_cpus ]; then                                                                                                                                 
        echo f > /sys/class/net/eth0/queues/rx-0/rps_cpus                                                                                                                                
fi
And check CPU governor and minimum frequency in cpufreq sysfs.

trohn_javolta
Posts: 53
Joined: Fri Nov 03, 2017 6:16 am
languages_spoken: english, german
ODROIDs: none (plans for XU4)
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by trohn_javolta » Thu Nov 29, 2018 2:39 am

Cpu governor set is ondemand.
Output of cpufreq-info: https://pastebin.com/2Jp5741N
Output of /proc/interrupts:https://pastebin.com/CARuEHHf

Should I put the posted lines of code in a script and execute it or what? :?:

trohn_javolta
Posts: 53
Joined: Fri Nov 03, 2017 6:16 am
languages_spoken: english, german
ODROIDs: none (plans for XU4)
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by trohn_javolta » Thu Nov 29, 2018 2:52 am

trohn_javolta wrote:Should I put the posted lines of code in a script and execute it or what? :?:
Did that, but speed is still at like 50 mb/s.

User avatar
rooted
Posts: 6073
Joined: Fri Dec 19, 2014 9:12 am
languages_spoken: english
Location: Gulf of Mexico, US
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by rooted » Thu Nov 29, 2018 8:11 am

Didn't you ask this question on Armbian's forum?

User avatar
odroid
Site Admin
Posts: 29348
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by odroid » Thu Nov 29, 2018 9:35 am

Try "performance" governor on both big and little cores.

trohn_javolta
Posts: 53
Joined: Fri Nov 03, 2017 6:16 am
languages_spoken: english, german
ODROIDs: none (plans for XU4)
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by trohn_javolta » Thu Nov 29, 2018 5:32 pm

rooted wrote:Didn't you ask this question on Armbian's forum?
I did and got the answer to search myself.
I did search the forum but couldn't find anything new. Just found this script for tweaked settings https://pastebin.com/8AE5sZFz
But all settings from the samba section where already in my smb.conf.

trohn_javolta
Posts: 53
Joined: Fri Nov 03, 2017 6:16 am
languages_spoken: english, german
ODROIDs: none (plans for XU4)
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by trohn_javolta » Thu Nov 29, 2018 5:35 pm

odroid wrote:Try "performance" governor on both big and little cores.
At the moment I can't, I copy stuff from int. hdd to ext. hdd via usb. But I'll try that. Is there a command to set that for all cores?

User avatar
rooted
Posts: 6073
Joined: Fri Dec 19, 2014 9:12 am
languages_spoken: english
Location: Gulf of Mexico, US
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by rooted » Fri Nov 30, 2018 4:18 am

trohn_javolta wrote:
rooted wrote:Didn't you ask this question on Armbian's forum?
I did and got the answer to search myself.
I did search the forum but couldn't find anything new. Just found this script for tweaked settings https://pastebin.com/8AE5sZFz
But all settings from the samba section where already in my smb.conf.
I was just wondering what they said?

User avatar
odroid
Site Admin
Posts: 29348
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by odroid » Fri Nov 30, 2018 9:47 am

trohn_javolta wrote:
odroid wrote:Try "performance" governor on both big and little cores.
At the moment I can't, I copy stuff from int. hdd to ext. hdd via usb. But I'll try that. Is there a command to set that for all cores?
You have to run below commands with superuser privileges.
For LITTLE cores,

Code: Select all

echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
For big cores,

Code: Select all

echo performance > /sys/devices/system/cpu/cpu4/cpufreq/scaling_governor

trohn_javolta
Posts: 53
Joined: Fri Nov 03, 2017 6:16 am
languages_spoken: english, german
ODROIDs: none (plans for XU4)
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by trohn_javolta » Mon Dec 03, 2018 8:27 pm

odroid wrote:
trohn_javolta wrote:
odroid wrote:Try "performance" governor on both big and little cores.
At the moment I can't, I copy stuff from int. hdd to ext. hdd via usb. But I'll try that. Is there a command to set that for all cores?
You have to run below commands with superuser privileges.
For LITTLE cores,

Code: Select all

echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
For big cores,

Code: Select all

echo performance > /sys/devices/system/cpu/cpu4/cpufreq/scaling_governor
Unfortunately that did not help either. Any other ideas? I don't understand how there can be such a difference in speed...

User avatar
odroid
Site Admin
Posts: 29348
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by odroid » Tue Dec 04, 2018 12:27 pm

You might need to post a question on OMV forum to find a tweak what they made.

User avatar
rooted
Posts: 6073
Joined: Fri Dec 19, 2014 9:12 am
languages_spoken: english
Location: Gulf of Mexico, US
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by rooted » Tue Dec 04, 2018 1:54 pm

I'm not understanding your issue really.

You installed OMV on Armbian, installed samba through OMV interface, uninstalled OMV and it uninstalled samba also? If not then SMB should still be set-up?

After a bit of reading I don't think OMV is doing anything special to the samba configuration.

If you read this page you will see ryecoaaron says as much.

https://forum.openmediavault.org/index. ... ork-Drive/

trohn_javolta
Posts: 53
Joined: Fri Nov 03, 2017 6:16 am
languages_spoken: english, german
ODROIDs: none (plans for XU4)
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by trohn_javolta » Thu Dec 06, 2018 5:05 pm

rooted wrote:I'm not understanding your issue really.

You installed OMV on Armbian, installed samba through OMV interface, uninstalled OMV and it uninstalled samba also? If not then SMB should still be set-up?

After a bit of reading I don't think OMV is doing anything special to the samba configuration.

If you read this page you will see ryecoaaron says as much.

https://forum.openmediavault.org/index. ... ork-Drive/
Samba was a dependency of OMV and I had to purge OMV install due to a PHP error I couldn't resolve. So yes I also removed Samba. Before I backed up smb.conf. Reinstalled samba and copied back smb.conf.
I also don't understand the sudden speed change..
But yeah.. seems I have to start over again with a fresh armbian OMV install.

User avatar
rooted
Posts: 6073
Joined: Fri Dec 19, 2014 9:12 am
languages_spoken: english
Location: Gulf of Mexico, US
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by rooted » Thu Dec 06, 2018 5:08 pm

That would be my suggestion, reinstall and copy the configuration.

Please share the differences here if you don't mind.

trohn_javolta
Posts: 53
Joined: Fri Nov 03, 2017 6:16 am
languages_spoken: english, german
ODROIDs: none (plans for XU4)
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by trohn_javolta » Tue Jan 08, 2019 8:54 pm

Hello, digging this up again.... :/
Well, I reinstalled armbian and omv via armbian-config, unfortunatly I still get like 60 mb/s.
Again I'm sure there's nothing wrong in my lan.
It makes no sense to me....
In htop I see during tranfer via smb the big cores are pretty much maxed out. Only difference to the time I got 100 mb/s is that the cpu temp is lower. Used to have up to 85 °C while file transfer, now it's 65.
Any output I could provide again, or any ideas?
Is there a recommended, light weight server image I could try? I went with armbian right away because I only had very good experiences so far.
Unfortunatly over at armbian forum devs don't have an odroid hc1/2 to test transfer speed so they can't really help me..I think one has but he doesn't seem to be active recently..or just missed/didn't care about my post.

User avatar
igorpec
Posts: 269
Joined: Sat Dec 12, 2015 4:34 pm
languages_spoken: english,german,slovene
ODROIDs: XU4, HC1, C2, C1+
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by igorpec » Tue Jan 08, 2019 9:02 pm

trohn_javolta wrote:
Tue Jan 08, 2019 8:54 pm
Hello, digging this up again.... :/
Well, I reinstalled armbian and omv via armbian-config, unfortunatly I still get like 60 mb/s.
Again I'm sure there's nothing wrong in my lan.
It makes no sense to me....
In htop I see during tranfer via smb the big cores are pretty much maxed out. Only difference to the time I got 100 mb/s is that the cpu temp is lower. Used to have up to 85 °C while file transfer, now it's 65.
Any output I could provide again, or any ideas?
Is there a recommended, light weight server image I could try? I went with armbian right away because I only had very good experiences so far.
Unfortunatly over at armbian forum devs don't have an odroid hc1/2 to test transfer speed so they can't really help me..I think one has but he doesn't seem to be active recently..or just missed/didn't care about my post.
I did quick install to HC1, 5TB drive, Samba from armbian-config, 100 mb/s without a problem. Those are full logs: http://ix.io/1xNg Its Bionic, perhaps this is a problem ... don't know, but at least you have a reference point.
ARMBIAN - follow on Twitter
linux for ARM development boards with user friendly development tools

trohn_javolta
Posts: 53
Joined: Fri Nov 03, 2017 6:16 am
languages_spoken: english, german
ODROIDs: none (plans for XU4)
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by trohn_javolta » Tue Jan 08, 2019 9:11 pm

igorpec wrote:
Tue Jan 08, 2019 9:02 pm

I did quick install to HC1, 5TB drive, Samba from armbian-config, 100 mb/s without a problem. Those are full logs: http://ix.io/1xNg Its Bionic, perhaps this is a problem ... don't know, but at least you have a reference point.
Ah ok, thx. And sry to get on your nerves :?
It's just annoying for me since it used to work nicely.

User avatar
igorpec
Posts: 269
Joined: Sat Dec 12, 2015 4:34 pm
languages_spoken: english,german,slovene
ODROIDs: XU4, HC1, C2, C1+
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by igorpec » Wed Jan 09, 2019 12:09 am

trohn_javolta wrote:
Tue Jan 08, 2019 9:11 pm
igorpec wrote:
Tue Jan 08, 2019 9:02 pm

I did quick install to HC1, 5TB drive, Samba from armbian-config, 100 mb/s without a problem. Those are full logs: http://ix.io/1xNg Its Bionic, perhaps this is a problem ... don't know, but at least you have a reference point.
Ah ok, thx. And sry to get on your nerves :?
It's just annoying for me since it used to work nicely.
:)

Is there some strange process running? What about this - https://www.hecticgeek.com/2015/01/ext4 ... -idle-fix/ - it takes a while on a large drive.
ARMBIAN - follow on Twitter
linux for ARM development boards with user friendly development tools

tkaiser
Posts: 663
Joined: Mon Nov 09, 2015 12:30 am
languages_spoken: english
ODROIDs: C1+, C2, XU4, HC1
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by tkaiser » Wed Jan 09, 2019 4:30 am

trohn_javolta wrote:
Tue Jan 08, 2019 8:54 pm
Any output I could provide
Output from armbianmonitor -u if it's about Armbian/OMV. BTW: I already answered your question in one of the three location where you discuss the very same issue: https://forum.openmediavault.org/index. ... post191808

So what's the filesystem you're using? Is it a 2.5" or a 3.5" HDD and have you ever tested storage performance locally so neither Samba nor network is involved at all -- full disks are slower since ZBR: https://forum.armbian.com/topic/1925-so ... ment=15319

User avatar
rooted
Posts: 6073
Joined: Fri Dec 19, 2014 9:12 am
languages_spoken: english
Location: Gulf of Mexico, US
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by rooted » Wed Jan 09, 2019 4:34 am


tkaiser wrote: So what's the filesystem you're using? Is it a 2.5" or a 3.5" HDD and have you ever tested storage performance locally so neither Samba nor network is involved at all -- full disks are slower since ZBR: https://forum.armbian.com/topic/1925-so ... ment=15319
This, so you can compare apples to apples.

trohn_javolta
Posts: 53
Joined: Fri Nov 03, 2017 6:16 am
languages_spoken: english, german
ODROIDs: none (plans for XU4)
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by trohn_javolta » Wed Jan 09, 2019 5:40 am

tkaiser wrote:
Wed Jan 09, 2019 4:30 am
trohn_javolta wrote:
Tue Jan 08, 2019 8:54 pm
Any output I could provide
Output from armbianmonitor -u if it's about Armbian/OMV. BTW: I already answered your question in one of the three location where you discuss the very same issue: https://forum.openmediavault.org/index. ... post191808

So what's the filesystem you're using? Is it a 2.5" or a 3.5" HDD and have you ever tested storage performance locally so neither Samba nor network is involved at all -- full disks are slower since ZBR: https://forum.armbian.com/topic/1925-so ... ment=15319
Sry my fault, I missed your answer. It's a 3,5" HDD, fs is ext4, 5,5TB of which 2,3TB are used. Didn't know that tranferspeed gets worse on hdd fill up. Does this already explain the poor transfer speed?

Here's uploaded output of armbianmonitor -u: http://ix.io/1xPe

I have not tested storage performance locally, is there a command you could share to do so?

@igor That was a good idea and now I also know there is iotop, but I could only see small disk reads/writes occasionally pop up, also in the IO> column no high percentage :(

tkaiser
Posts: 663
Joined: Mon Nov 09, 2015 12:30 am
languages_spoken: english
ODROIDs: C1+, C2, XU4, HC1
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by tkaiser » Wed Jan 09, 2019 6:08 am

trohn_javolta wrote:
Wed Jan 09, 2019 5:40 am
Here's uploaded output of armbianmonitor -u: http://ix.io/1xPe
Hmm... Logging is (still) broken in Armbian/OMV. Which one is the data disk... sda or sdb?

To do a quick performance test simply cd to the mountpoint in question and then iozone -e -I -a -s 100M -r 1024k -r 16384k -i 0 -i 1

trohn_javolta
Posts: 53
Joined: Fri Nov 03, 2017 6:16 am
languages_spoken: english, german
ODROIDs: none (plans for XU4)
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by trohn_javolta » Wed Jan 09, 2019 6:21 am

tkaiser wrote:
Wed Jan 09, 2019 6:08 am
trohn_javolta wrote:
Wed Jan 09, 2019 5:40 am
Here's uploaded output of armbianmonitor -u: http://ix.io/1xPe
Hmm... Logging is (still) broken in Armbian/OMV. Which one is the data disk... sda or sdb?

To do a quick performance test simply cd to the mountpoint in question and then iozone -e -I -a -s 100M -r 1024k -r 16384k -i 0 -i 1
Sdb is connected via sata bridge, sda is in a usb 3.0 enclosure (powered seperately of course) connected to usb port.
This is the iozone test output:

Code: Select all

root@hc2:/media/dev-disk-by-label-festplatte# iozone -e -I -a -s 100M -r 1024k -r 16384k -i 0 -i 1
        Iozone: Performance Test of File I/O
                Version $Revision: 3.429 $
                Compiled for 32 bit mode.
                Build: linux

        Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                     Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                     Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                     Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
                     Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
                     Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
                     Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer,
                     Vangel Bojaxhi, Ben England, Vikentsi Lapa.

        Run began: Tue Jan  8 22:19:03 2019

        Include fsync in write timing
        O_DIRECT feature enabled
        Auto Mode
        File size set to 102400 kB
        Record Size 1024 kB
        Record Size 16384 kB
        Command line used: iozone -e -I -a -s 100M -r 1024k -r 16384k -i 0 -i 1
        Output is in kBytes/sec
        Time Resolution = 0.000001 seconds.
        Processor cache size set to 1024 kBytes.
        Processor cache line size set to 32 bytes.
        File stride size set to 17 * record size.
                                                              random    random     bkwd    record    stride
              kB  reclen    write  rewrite    read    reread    read     write     read   rewrite      read   fwrite frewrite    fread  freread
          102400    1024   139156   136738   145849   163339
          102400   16384   128561   146915   166427   187816

iozone test complete.

tkaiser
Posts: 663
Joined: Mon Nov 09, 2015 12:30 am
languages_spoken: english
ODROIDs: C1+, C2, XU4, HC1
Contact:

Re: [HC2] [Armbian] Slow transfer speed via Samba

Unread post by tkaiser » Wed Jan 09, 2019 6:27 am

trohn_javolta wrote:
Wed Jan 09, 2019 6:21 am
This is the iozone test output
All fine. Well above 100 MB/s. The next steps I would do then is to test 'network only' (iperf/jperf.exe) and then run also Helios LanTest with 10GbE settings (just because there were several occurrences in OMV forum where users reported bad transfer speeds just to realize later that the client was the issue -- LanTest doesn't rely on local storage)

Post Reply

Return to “Other OS”

Who is online

Users browsing this forum: No registered users and 0 guests