XU4 crashes under heavy load (video/image conversion)

Moderators: mdrjr, odroid

XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Sun Jun 10, 2018 7:30 pm

I have been experiencing complete freezes (fan spinning, SSH and web unresponsive) whenever I run video/image conversion on my Odroid XU4, requiring a hard reboot. Some details on my XU4:

Kernel: linux-odroid-xu3 4.14.47-1
Distro: Arch linux
PSU: 3rd party 5V 6A (same problem occurs with official 5V 4A)
Cooling: official active cooling fan, dynamically adjusted based on temperature

I can now consistently reproduce the crash/freeze if I run ffmpeg to convert a file from avi to mp4 for about a minute. Other services that have (inconsistently) been causing the same symptoms include: Nextcloud server that sometimes converts many image files to different dimensions for preview, and Plex media server that also generates thumbnails from many image files.

The logs (dmesg or journalctl) do not show any message when the machine freezes (checked after the next hard reboot).

Using the 'stress' package, which calculates sqrt(), on all cores does not cause a freeze, even when it raises temperatures to ~90C.

The maximum clock speeds are by default 1.5GHz on cores 0-3 and 2.0GHz on cores 4-7. I have tried to lower the clock speed for cores 4-7 to 1.7 or 1.5GHz, but the problem persists. Temperatures are around 55C when idle and can go up to 75-90C under load. Even though freezes usually occur at high temperature due to high load, the problem occurs even at 75C.

I have also ruled out the PSU as a source of the problem by measuring the voltage cross 1 (5V) and 8 (GND) on the CON11 GPIO pins. The voltage fluctuates between 5V and 5.6V depending on the load (and HDD peripherals).

This issue has been bothering me for months now. Should throttle all cores more aggressively and do more tests? Could this be a driver or hardware issue? I have read a similar problem on a different thread about mining using XU4: https://forum.odroid.com/viewtopic.php?f=99&t=30527. Is this perhaps related?
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby mad_ady » Mon Jun 11, 2018 12:30 am

Hmm, you should try to enable netconsole and export kernel logs to a remote system to see if there is any problem reported before the crash. Search for netconsole on the forum to enable it
User avatar
mad_ady
 
Posts: 4585
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Mon Jun 11, 2018 7:30 am

I have been using "journalctl -f" and "dmesg -wH" to monitor the logs live through SSH but nothing bad shows up when it crashes. Checking the logs after the manual reboot confirms this. The machine freezes in a literal sense. Would netconsole be any different?

The machine is running headless, only accessible through SSH.
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby mad_ady » Mon Jun 11, 2018 11:53 am

It's possible that there are some dmesg messages generated that don't make it over ssh (which is in userspace) and netconsole might show them. But it's also possible for it to crash silently.
Ideally you should have a UART console to see what happens when it crashes.
User avatar
mad_ady
 
Posts: 4585
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Mon Jun 11, 2018 5:07 pm

UART console may be out of reach at the moment because I am debugging off-site. Meanwhile, I have found that underclocking the cores increases stability when doing the same video conversion task. The time-to-failure increases as I decrease the clock speed. Right now I have cores 0-3 clocked at 1.0GHz (originally 1.5GHz) and cores 4-7 at 1.5GHz (originally 2.0GHz). The ffmpeg task finishes successfully after 22 minutes. Any idea why such a symptom occurs? What causes all the instability? How can I find out further?
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby odroid » Mon Jun 11, 2018 5:20 pm

Which CPU governor do you use?
Code: Select all
odroid@odroid:~$ cat /sys/devices/system/cpu/cpu*/cpufreq/scaling_governor
performance
performance
performance
performance
performance
performance
performance
performance


Do you encode a video with H.264 format via ffmpeg?
User avatar
odroid
Site Admin
 
Posts: 28704
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Mon Jun 11, 2018 6:22 pm

CPU governor is ondemand for all 8 cores.

Yes, I encode with H.264.
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby odroid » Mon Jun 11, 2018 6:33 pm

Can you share your ffplay command parameters to reproduce the issue?
User avatar
odroid
Site Admin
 
Posts: 28704
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Mon Jun 11, 2018 7:29 pm

I simply used "ffmpeg -i test_file.avi output.mp4", and it printed:

Code: Select all
ffmpeg version 4.0 Copyright (c) 2000-2018 the FFmpeg developers
  built with gcc 8.1.0 (GCC)
  configuration: --prefix=/usr --disable-debug --disable-static --disable-stripping --enable-avresample --enable-fontconfig --enable-gmp --enable-gnutls --enable-gpl --enable-ladspa --enable-libass --enable-libbluray --enable-libdrm --enable-libfreetype --enable-libfribidi --enable-libgsm --enable-libiec61883 --enable-libmodplug --enable-libmp3lame --enable-libopencore_amrnb --enable-libopencore_amrwb --enable-libopenjpeg --enable-libopus --enable-libpulse --enable-libsoxr --enable-libspeex --enable-libssh --enable-libtheora --enable-libv4l2 --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxcb --enable-libxml2 --enable-libxvid --enable-omx --enable-shared --enable-version3 --host-cflags='"-fPIC"'
  libavutil      56. 14.100 / 56. 14.100
  libavcodec     58. 18.100 / 58. 18.100
  libavformat    58. 12.100 / 58. 12.100
  libavdevice    58.  3.100 / 58.  3.100
  libavfilter     7. 16.100 /  7. 16.100
  libavresample   4.  0.  0 /  4.  0.  0
  libswscale      5.  1.100 /  5.  1.100
  libswresample   3.  1.100 /  3.  1.100
  libpostproc    55.  1.100 / 55.  1.100
Input #0, avi, from 'test_file.avi':
  Duration: 00:22:32.02, start: 0.000000, bitrate: 683 kb/s
    Stream #0:0: Video: mpeg4 (Advanced Simple Profile) (XVID / 0x44495658), yuv420p, 704x396 [SAR 1:1 DAR 16:9], 546 kb/s, 23.98 fps, 23.98 tbr, 23.98 tbn, 23.98 tbc
    Stream #0:1: Audio: mp3 (U[0][0][0] / 0x0
Last edited by winstonyin on Tue Jun 12, 2018 6:00 pm, edited 1 time in total.
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby odroid » Tue Jun 12, 2018 3:41 pm

I'm running the same command. But Ubuntu 18.04 seems to have an older ffmpeg package. Anyway, I will let you know the test result.
Code: Select all
ffmpeg -i /media/odroid/B19A-5D87/big_buck_bunny_1080p_stereo.avi
ffmpeg version 3.4.2-2ubuntu3 Copyright (c) 2000-2018 the FFmpeg developers
  built with gcc 7 (Ubuntu/Linaro 7.3.0-15ubuntu2)
  configuration: --prefix=/usr --extra-version=2ubuntu3 --toolchain=hardened --libdir=/usr/lib/arm-linux-gnueabihf --incdir=/usr/include/arm-linux-gnueabihf --enable-gpl --disable-stripping --enable-avresample --enable-avisynth --d
  libavutil      55. 78.100 / 55. 78.100
  libavcodec     57.107.100 / 57.107.100
  libavformat    57. 83.100 / 57. 83.100
  libavdevice    57. 10.100 / 57. 10.100
  libavfilter     6.107.100 /  6.107.100
  libavresample   3.  7.  0 /  3.  7.  0
  libswscale      4.  8.100 /  4.  8.100
  libswresample   2.  9.100 /  2.  9.100
  libpostproc    54.  7.100 / 54.  7.100
Input #0, avi, from '/media/odroid/B19A-5D87/big_buck_bunny_1080p_stereo.avi':
  Metadata:
    encoder         : MEncoder 2:1.0~rc2-0ubuntu13
  Duration: 00:09:56.46, start: 0.000000, bitrate: 9586 kb/s
    Stream #0:0: Video: msmpeg4v2 (MP42 / 0x3234504D), yuv420p, 1920x1080, 9328 kb/s, 24 fps, 24 tbr, 24 tbn, 24 tbc
    Stream #0:1: Audio: mp3 (U[0][0][0] / 0x0055), 48000 Hz, stereo, s16p, 245 kb/s
Stream mapping:
  Stream #0:0 -> #0:0 (msmpeg4v2 (native) -> h264 (libx264))
  Stream #0:1 -> #0:1 (mp3 (native) -> aac (native))
Press [q] to stop, [?] for help
[libx264 @ 0x55f920] using cpu capabilities: ARMv6 NEON
[libx264 @ 0x55f920] profile High, level 4.0
[libx264 @ 0x55f920] 264 - core 152 r2854 e9a5903 - H.264/MPEG-4 AVC codec - Copyleft 2003-2017 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mix0
Output #0, mp4, to 'output.mp4':
  Metadata:
    encoder         : Lavf57.83.100
    Stream #0:0: Video: h264 (libx264) (avc1 / 0x31637661), yuv420p, 1920x1080, q=-1--1, 24 fps, 12288 tbn, 24 tbc
    Metadata:
      encoder         : Lavc57.107.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
    Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s
    Metadata:
      encoder         : Lavc57.107.100 aac
User avatar
odroid
Site Admin
 
Posts: 28704
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Tue Jun 12, 2018 4:20 pm

I appreciate it. Please test with maximum clock speed, as that has been the most unstable for me.
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby odroid » Tue Jun 12, 2018 4:32 pm

It completed well. I've used "performance" governor at maximum clock and all 8 cores were very busy while the transcoding.
Code: Select all
frame=14315 fps=9.6 q=-1.0 Lsize=  287562kB time=00:09:56.43 bitrate=3949.6kbits/s speed=0.401x   
video:277772kB audio:9446kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.119528%
[libx264 @ 0x55f920] frame I:151   Avg QP:16.47  size:180109
[libx264 @ 0x55f920] frame P:9867  Avg QP:21.14  size: 22764
[libx264 @ 0x55f920] frame B:4297  Avg QP:24.71  size:  7594
[libx264 @ 0x55f920] consecutive B-frames: 56.6%  6.0% 12.6% 24.8%
[libx264 @ 0x55f920] mb I  I16..4: 17.3% 78.3%  4.5%
[libx264 @ 0x55f920] mb P  I16..4:  1.3%  6.7%  0.2%  P16..4: 28.5%  6.6%  4.9%  0.0%  0.0%    skip:51.9%
[libx264 @ 0x55f920] mb B  I16..4:  0.9%  3.8%  0.1%  B16..8: 18.8%  1.8%  0.4%  direct: 1.5%  skip:72.7%  L0:50.8% L1:42.2% BI: 7.0%
[libx264 @ 0x55f920] 8x8 transform intra:80.8% inter:79.0%
[libx264 @ 0x55f920] coded y,uvDC,uvAC intra: 53.1% 55.5% 16.2% inter: 11.0% 13.4% 1.5%
[libx264 @ 0x55f920] i16 v,h,dc,p: 32% 28% 13% 27%
[libx264 @ 0x55f920] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 26% 18% 37%  3%  3%  4%  3%  3%  3%
[libx264 @ 0x55f920] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 29% 17% 15%  4%  9%  9%  7%  5%  5%
[libx264 @ 0x55f920] i8c dc,h,v,p: 48% 23% 22%  6%
[libx264 @ 0x55f920] Weighted P-Frames: Y:0.9% UV:0.7%
[libx264 @ 0x55f920] ref P L0: 75.0% 12.4%  9.9%  2.8%  0.0%
[libx264 @ 0x55f920] ref B L0: 77.9% 19.4%  2.7%
[libx264 @ 0x55f920] ref B L1: 97.4%  2.6%
[libx264 @ 0x55f920] kb/s:3815.03
[aac @ 0x511700] Qavg: 441.845


My Kernel version is
Code: Select all
odroid@odroid:~$ uname -a
Linux odroid 4.14.47-139 #1 SMP PREEMPT Sun Jun 3 20:08:16 -03 2018 armv7l armv7l armv7l GNU/Linux


I used this latest Ubuntu Mate image for the test.
https://wiki.odroid.com/odroid-xu4/os_i ... 4/20180501

I will run the same test a few more times to make sure the stability.
User avatar
odroid
Site Admin
 
Posts: 28704
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Tue Jun 12, 2018 6:05 pm

Thanks for testing. I wonder if the issue is system dependent or due to variance in manufacturing. I noticed that you are using armv7l kernel rather than the armv7h kernel, which I use with Arch. Here are my kernel modules:
Code: Select all
Module                  Size  Used by
raid1                  40960  1
md_mod                126976  1 raid1
ipt_REJECT             16384  1931
nf_reject_ipv4         16384  1 ipt_REJECT
iptable_filter         16384  1
joydev                 20480  0
ads7846                20480  0
spidev                 20480  0
spi_s3c64xx            20480  0
w1_gpio                16384  0
wire                   24576  1 w1_gpio
uio_pdrv_genirq        16384  0
exynos_gpiomem         16384  0
uio                    16384  1 uio_pdrv_genirq
sch_fq_codel           20480  2
ip_tables              24576  1 iptable_filter
ipv6                  389120  218

Just to help debug, here are my kernel parameters:
Code: Select all
dev.raid.speed_limit_max = 200000
dev.raid.speed_limit_min = 1000
dev.scsi.logging_level = 0
fs.aio-max-nr = 65536
fs.aio-nr = 2917
fs.binfmt_misc.status = enabled
fs.dentry-state = 37677   19052   45   0   0   0
fs.dir-notify-enable = 1
fs.epoll.max_user_watches = 263732
fs.file-max = 190282
fs.file-nr = 2688   0   190282
fs.inode-nr = 35142   2593
fs.inode-state = 35131   2593   0   0   0   0   0
fs.inotify.max_queued_events = 16384
fs.inotify.max_user_instances = 128
fs.inotify.max_user_watches = 8192
fs.lease-break-time = 45
fs.leases-enable = 1
fs.mount-max = 100000
fs.mqueue.msg_default = 10
fs.mqueue.msg_max = 10
fs.mqueue.msgsize_default = 8192
fs.mqueue.msgsize_max = 8192
fs.mqueue.queues_max = 256
fs.nfs.idmap_cache_timeout = 600
fs.nfs.nfs_callback_tcpport = 0
fs.nfs.nfs_congestion_kb = 45696
fs.nfs.nfs_mountpoint_timeout = 500
fs.nfs.nlm_grace_period = 0
fs.nfs.nlm_tcpport = 0
fs.nfs.nlm_timeout = 10
fs.nfs.nlm_udpport = 0
fs.nfs.nsm_local_state = 0
fs.nfs.nsm_use_hostnames = 0
fs.nr_open = 1048576
fs.overflowgid = 65534
fs.overflowuid = 65534
fs.pipe-max-size = 1048576
fs.pipe-user-pages-hard = 0
fs.pipe-user-pages-soft = 16384
fs.protected_hardlinks = 1
fs.protected_symlinks = 1
fs.quota.allocated_dquots = 0
fs.quota.cache_hits = 0
fs.quota.drops = 0
fs.quota.free_dquots = 0
fs.quota.lookups = 0
fs.quota.reads = 0
fs.quota.syncs = 32
fs.quota.writes = 0
fs.suid_dumpable = 0
kernel.acct = 4   2   30
kernel.auto_msgmni = 0
kernel.cad_pid = 1
kernel.cap_last_cap = 37
kernel.core_pattern = |/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e
kernel.core_pipe_limit = 0
kernel.core_uses_pid = 1
kernel.ctrl-alt-del = 0
kernel.dmesg_restrict = 0
kernel.domainname = (none)
kernel.ftrace_dump_on_oops = 0
kernel.hostname = feynman
kernel.hotplug =
kernel.keys.gc_delay = 300
kernel.keys.maxbytes = 20000
kernel.keys.maxkeys = 200
kernel.keys.root_maxbytes = 25000000
kernel.keys.root_maxkeys = 1000000
kernel.kptr_restrict = 0
kernel.max_lock_depth = 1024
kernel.modprobe = /sbin/modprobe
kernel.modules_disabled = 0
kernel.msgmax = 8192
kernel.msgmnb = 16384
kernel.msgmni = 32000
kernel.ngroups_max = 65536
kernel.osrelease = 4.14.47-1-ARCH
kernel.ostype = Linux
kernel.overflowgid = 65534
kernel.overflowuid = 65534
kernel.panic = 0
kernel.panic_on_oops = 0
kernel.panic_on_rcu_stall = 0
kernel.panic_on_warn = 0
kernel.perf_cpu_time_max_percent = 25
kernel.perf_event_max_contexts_per_stack = 8
kernel.perf_event_max_sample_rate = 100000
kernel.perf_event_max_stack = 127
kernel.perf_event_mlock_kb = 516
kernel.perf_event_paranoid = 2
kernel.pid_max = 32768
kernel.poweroff_cmd = /sbin/poweroff
kernel.print-fatal-signals = 0
kernel.printk = 7   4   1   7
kernel.printk_delay = 0
kernel.printk_devkmsg = ratelimit
kernel.printk_ratelimit = 5
kernel.printk_ratelimit_burst = 10
kernel.pty.max = 4096
kernel.pty.nr = 3
kernel.pty.reserve = 1024
kernel.random.boot_id = 8c6aa87f-c252-4c53-ace3-3215e15e4337
kernel.random.entropy_avail = 3774
kernel.random.poolsize = 4096
kernel.random.read_wakeup_threshold = 64
kernel.random.urandom_min_reseed_secs = 60
kernel.random.uuid = 11a103d5-e128-43e3-8ee8-bd1eaefb29ea
kernel.random.write_wakeup_threshold = 1024
kernel.randomize_va_space = 1
kernel.real-root-dev = 0
kernel.sched_cfs_bandwidth_slice_us = 5000
kernel.sched_child_runs_first = 0
kernel.sched_rr_timeslice_ms = 100
kernel.sched_rt_period_us = 1000000
kernel.sched_rt_runtime_us = 950000
kernel.seccomp.actions_avail = kill_process kill_thread trap errno trace log allow
kernel.seccomp.actions_logged = kill_process kill_thread trap errno trace log
kernel.sem = 32000   1024000000   500   32000
kernel.sg-big-buff = 32768
kernel.shm_rmid_forced = 0
kernel.shmall = 4278190079
kernel.shmmax = 4278190079
kernel.shmmni = 4096
kernel.sysctl_writes_strict = 1
kernel.sysrq = 16
kernel.tainted = 0
kernel.threads-max = 29750
kernel.timer_migration = 1
kernel.traceoff_on_warning = 0
kernel.tracepoint_printk = 0
kernel.unprivileged_bpf_disabled = 0
kernel.usermodehelper.bset = 4294967295   63
kernel.usermodehelper.inheritable = 4294967295   63
kernel.version = #1 SMP PREEMPT Mon Jun 4 01:53:17 UTC 2018
net.core.bpf_jit_enable = 0
net.core.bpf_jit_harden = 0
net.core.bpf_jit_kallsyms = 0
net.core.busy_poll = 0
net.core.busy_read = 0
net.core.default_qdisc = fq_codel
net.core.dev_weight = 64
net.core.dev_weight_rx_bias = 1
net.core.dev_weight_tx_bias = 1
net.core.flow_limit_cpu_bitmap = 00
net.core.flow_limit_table_len = 4096
net.core.max_skb_frags = 17
net.core.message_burst = 10
net.core.message_cost = 5
net.core.netdev_budget = 300
net.core.netdev_budget_usecs = 2000
net.core.netdev_max_backlog = 1000
net.core.netdev_rss_key = 00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00:00
net.core.netdev_tstamp_prequeue = 1
net.core.optmem_max = 10240
net.core.rmem_default = 163840
net.core.rmem_max = 163840
net.core.rps_sock_flow_entries = 0
net.core.somaxconn = 128
net.core.tstamp_allow_data = 1
net.core.warnings = 0
net.core.wmem_default = 163840
net.core.wmem_max = 163840
net.core.xfrm_acq_expires = 30
net.core.xfrm_aevent_etime = 10
net.core.xfrm_aevent_rseqth = 2
net.core.xfrm_larval_drop = 1
net.ipv4.conf.all.accept_local = 0
net.ipv4.conf.all.accept_redirects = 1
net.ipv4.conf.all.accept_source_route = 0
net.ipv4.conf.all.arp_accept = 0
net.ipv4.conf.all.arp_announce = 0
net.ipv4.conf.all.arp_filter = 0
net.ipv4.conf.all.arp_ignore = 0
net.ipv4.conf.all.arp_notify = 0
net.ipv4.conf.all.bootp_relay = 0
net.ipv4.conf.all.disable_policy = 0
net.ipv4.conf.all.disable_xfrm = 0
net.ipv4.conf.all.drop_gratuitous_arp = 0
net.ipv4.conf.all.drop_unicast_in_l2_multicast = 0
net.ipv4.conf.all.force_igmp_version = 0
net.ipv4.conf.all.forwarding = 0
net.ipv4.conf.all.igmpv2_unsolicited_report_interval = 10000
net.ipv4.conf.all.igmpv3_unsolicited_report_interval = 1000
net.ipv4.conf.all.ignore_routes_with_linkdown = 0
net.ipv4.conf.all.log_martians = 0
net.ipv4.conf.all.mc_forwarding = 0
net.ipv4.conf.all.medium_id = 0
net.ipv4.conf.all.promote_secondaries = 1
net.ipv4.conf.all.proxy_arp = 0
net.ipv4.conf.all.proxy_arp_pvlan = 0
net.ipv4.conf.all.route_localnet = 0
net.ipv4.conf.all.rp_filter = 1
net.ipv4.conf.all.secure_redirects = 1
net.ipv4.conf.all.send_redirects = 1
net.ipv4.conf.all.shared_media = 1
net.ipv4.conf.all.src_valid_mark = 0
net.ipv4.conf.all.tag = 0
net.ipv4.conf.default.accept_local = 0
net.ipv4.conf.default.accept_redirects = 1
net.ipv4.conf.default.accept_source_route = 1
net.ipv4.conf.default.arp_accept = 0
net.ipv4.conf.default.arp_announce = 0
net.ipv4.conf.default.arp_filter = 0
net.ipv4.conf.default.arp_ignore = 0
net.ipv4.conf.default.arp_notify = 0
net.ipv4.conf.default.bootp_relay = 0
net.ipv4.conf.default.disable_policy = 0
net.ipv4.conf.default.disable_xfrm = 0
net.ipv4.conf.default.drop_gratuitous_arp = 0
net.ipv4.conf.default.drop_unicast_in_l2_multicast = 0
net.ipv4.conf.default.force_igmp_version = 0
net.ipv4.conf.default.forwarding = 0
net.ipv4.conf.default.igmpv2_unsolicited_report_interval = 10000
net.ipv4.conf.default.igmpv3_unsolicited_report_interval = 1000
net.ipv4.conf.default.ignore_routes_with_linkdown = 0
net.ipv4.conf.default.log_martians = 0
net.ipv4.conf.default.mc_forwarding = 0
net.ipv4.conf.default.medium_id = 0
net.ipv4.conf.default.promote_secondaries = 0
net.ipv4.conf.default.proxy_arp = 0
net.ipv4.conf.default.proxy_arp_pvlan = 0
net.ipv4.conf.default.route_localnet = 0
net.ipv4.conf.default.rp_filter = 0
net.ipv4.conf.default.secure_redirects = 1
net.ipv4.conf.default.send_redirects = 1
net.ipv4.conf.default.shared_media = 1
net.ipv4.conf.default.src_valid_mark = 0
net.ipv4.conf.default.tag = 0
net.ipv4.conf.eth0.accept_local = 0
net.ipv4.conf.eth0.accept_redirects = 1
net.ipv4.conf.eth0.accept_source_route = 1
net.ipv4.conf.eth0.arp_accept = 0
net.ipv4.conf.eth0.arp_announce = 0
net.ipv4.conf.eth0.arp_filter = 0
net.ipv4.conf.eth0.arp_ignore = 0
net.ipv4.conf.eth0.arp_notify = 0
net.ipv4.conf.eth0.bootp_relay = 0
net.ipv4.conf.eth0.disable_policy = 0
net.ipv4.conf.eth0.disable_xfrm = 0
net.ipv4.conf.eth0.drop_gratuitous_arp = 0
net.ipv4.conf.eth0.drop_unicast_in_l2_multicast = 0
net.ipv4.conf.eth0.force_igmp_version = 0
net.ipv4.conf.eth0.forwarding = 0
net.ipv4.conf.eth0.igmpv2_unsolicited_report_interval = 10000
net.ipv4.conf.eth0.igmpv3_unsolicited_report_interval = 1000
net.ipv4.conf.eth0.ignore_routes_with_linkdown = 0
net.ipv4.conf.eth0.log_martians = 0
net.ipv4.conf.eth0.mc_forwarding = 0
net.ipv4.conf.eth0.medium_id = 0
net.ipv4.conf.eth0.promote_secondaries = 0
net.ipv4.conf.eth0.proxy_arp = 0
net.ipv4.conf.eth0.proxy_arp_pvlan = 0
net.ipv4.conf.eth0.route_localnet = 0
net.ipv4.conf.eth0.rp_filter = 0
net.ipv4.conf.eth0.secure_redirects = 1
net.ipv4.conf.eth0.send_redirects = 1
net.ipv4.conf.eth0.shared_media = 1
net.ipv4.conf.eth0.src_valid_mark = 0
net.ipv4.conf.eth0.tag = 0
net.ipv4.conf.lo.accept_local = 0
net.ipv4.conf.lo.accept_redirects = 1
net.ipv4.conf.lo.accept_source_route = 1
net.ipv4.conf.lo.arp_accept = 0
net.ipv4.conf.lo.arp_announce = 0
net.ipv4.conf.lo.arp_filter = 0
net.ipv4.conf.lo.arp_ignore = 0
net.ipv4.conf.lo.arp_notify = 0
net.ipv4.conf.lo.bootp_relay = 0
net.ipv4.conf.lo.disable_policy = 1
net.ipv4.conf.lo.disable_xfrm = 1
net.ipv4.conf.lo.drop_gratuitous_arp = 0
net.ipv4.conf.lo.drop_unicast_in_l2_multicast = 0
net.ipv4.conf.lo.force_igmp_version = 0
net.ipv4.conf.lo.forwarding = 0
net.ipv4.conf.lo.igmpv2_unsolicited_report_interval = 10000
net.ipv4.conf.lo.igmpv3_unsolicited_report_interval = 1000
net.ipv4.conf.lo.ignore_routes_with_linkdown = 0
net.ipv4.conf.lo.log_martians = 0
net.ipv4.conf.lo.mc_forwarding = 0
net.ipv4.conf.lo.medium_id = 0
net.ipv4.conf.lo.promote_secondaries = 0
net.ipv4.conf.lo.proxy_arp = 0
net.ipv4.conf.lo.proxy_arp_pvlan = 0
net.ipv4.conf.lo.route_localnet = 0
net.ipv4.conf.lo.rp_filter = 0
net.ipv4.conf.lo.secure_redirects = 1
net.ipv4.conf.lo.send_redirects = 1
net.ipv4.conf.lo.shared_media = 1
net.ipv4.conf.lo.src_valid_mark = 0
net.ipv4.conf.lo.tag = 0
net.ipv4.fib_multipath_hash_policy = 0
net.ipv4.fib_multipath_use_neigh = 0
net.ipv4.fwmark_reflect = 0
net.ipv4.icmp_echo_ignore_all = 0
net.ipv4.icmp_echo_ignore_broadcasts = 1
net.ipv4.icmp_errors_use_inbound_ifaddr = 0
net.ipv4.icmp_ignore_bogus_error_responses = 1
net.ipv4.icmp_msgs_burst = 50
net.ipv4.icmp_msgs_per_sec = 1000
net.ipv4.icmp_ratelimit = 1000
net.ipv4.icmp_ratemask = 6168
net.ipv4.igmp_link_local_mcast_reports = 1
net.ipv4.igmp_max_memberships = 20
net.ipv4.igmp_max_msf = 10
net.ipv4.igmp_qrv = 2
net.ipv4.inet_peer_maxttl = 600
net.ipv4.inet_peer_minttl = 120
net.ipv4.inet_peer_threshold = 65664
net.ipv4.ip_default_ttl = 64
net.ipv4.ip_dynaddr = 0
net.ipv4.ip_early_demux = 1
net.ipv4.ip_forward = 0
net.ipv4.ip_forward_use_pmtu = 0
net.ipv4.ip_local_port_range = 32768   60999
net.ipv4.ip_local_reserved_ports =
net.ipv4.ip_no_pmtu_disc = 0
net.ipv4.ip_nonlocal_bind = 0
net.ipv4.ip_unprivileged_port_start = 1024
net.ipv4.ipfrag_high_thresh = 4194304
net.ipv4.ipfrag_low_thresh = 3145728
net.ipv4.ipfrag_max_dist = 64
net.ipv4.ipfrag_secret_interval = 0
net.ipv4.ipfrag_time = 30
net.ipv4.neigh.default.anycast_delay = 100
net.ipv4.neigh.default.app_solicit = 0
net.ipv4.neigh.default.base_reachable_time_ms = 30000
net.ipv4.neigh.default.delay_first_probe_time = 5
net.ipv4.neigh.default.gc_interval = 30
net.ipv4.neigh.default.gc_stale_time = 60
net.ipv4.neigh.default.gc_thresh1 = 128
net.ipv4.neigh.default.gc_thresh2 = 512
net.ipv4.neigh.default.gc_thresh3 = 1024
net.ipv4.neigh.default.locktime = 100
net.ipv4.neigh.default.mcast_resolicit = 0
net.ipv4.neigh.default.mcast_solicit = 3
net.ipv4.neigh.default.proxy_delay = 80
net.ipv4.neigh.default.proxy_qlen = 64
net.ipv4.neigh.default.retrans_time_ms = 1000
net.ipv4.neigh.default.ucast_solicit = 3
net.ipv4.neigh.default.unres_qlen = 86
net.ipv4.neigh.default.unres_qlen_bytes = 163840
net.ipv4.neigh.eth0.anycast_delay = 100
net.ipv4.neigh.eth0.app_solicit = 0
net.ipv4.neigh.eth0.base_reachable_time_ms = 30000
net.ipv4.neigh.eth0.delay_first_probe_time = 5
net.ipv4.neigh.eth0.gc_stale_time = 60
net.ipv4.neigh.eth0.locktime = 100
net.ipv4.neigh.eth0.mcast_resolicit = 0
net.ipv4.neigh.eth0.mcast_solicit = 3
net.ipv4.neigh.eth0.proxy_delay = 80
net.ipv4.neigh.eth0.proxy_qlen = 64
net.ipv4.neigh.eth0.retrans_time_ms = 1000
net.ipv4.neigh.eth0.ucast_solicit = 3
net.ipv4.neigh.eth0.unres_qlen = 86
net.ipv4.neigh.eth0.unres_qlen_bytes = 163840
net.ipv4.neigh.lo.anycast_delay = 100
net.ipv4.neigh.lo.app_solicit = 0
net.ipv4.neigh.lo.base_reachable_time_ms = 30000
net.ipv4.neigh.lo.delay_first_probe_time = 5
net.ipv4.neigh.lo.gc_stale_time = 60
net.ipv4.neigh.lo.locktime = 100
net.ipv4.neigh.lo.mcast_resolicit = 0
net.ipv4.neigh.lo.mcast_solicit = 3
net.ipv4.neigh.lo.proxy_delay = 80
net.ipv4.neigh.lo.proxy_qlen = 64
net.ipv4.neigh.lo.retrans_time_ms = 1000
net.ipv4.neigh.lo.ucast_solicit = 3
net.ipv4.neigh.lo.unres_qlen = 86
net.ipv4.neigh.lo.unres_qlen_bytes = 163840
net.ipv4.ping_group_range = 1   0
net.ipv4.route.error_burst = 1250
net.ipv4.route.error_cost = 250
net.ipv4.route.gc_elasticity = 8
net.ipv4.route.gc_interval = 60
net.ipv4.route.gc_min_interval = 0
net.ipv4.route.gc_min_interval_ms = 500
net.ipv4.route.gc_thresh = -1
net.ipv4.route.gc_timeout = 300
net.ipv4.route.max_size = 2147483647
net.ipv4.route.min_adv_mss = 256
net.ipv4.route.min_pmtu = 552
net.ipv4.route.mtu_expires = 600
net.ipv4.route.redirect_load = 5
net.ipv4.route.redirect_number = 9
net.ipv4.route.redirect_silence = 5120
net.ipv4.tcp_abort_on_overflow = 0
net.ipv4.tcp_adv_win_scale = 1
net.ipv4.tcp_allowed_congestion_control = cubic reno
net.ipv4.tcp_app_win = 31
net.ipv4.tcp_autocorking = 1
net.ipv4.tcp_available_congestion_control = cubic reno
net.ipv4.tcp_available_ulp =
net.ipv4.tcp_base_mss = 1024
net.ipv4.tcp_challenge_ack_limit = 1000
net.ipv4.tcp_congestion_control = cubic
net.ipv4.tcp_dsack = 1
net.ipv4.tcp_early_demux = 1
net.ipv4.tcp_early_retrans = 3
net.ipv4.tcp_ecn = 2
net.ipv4.tcp_ecn_fallback = 1
net.ipv4.tcp_fack = 0
net.ipv4.tcp_fastopen = 1
net.ipv4.tcp_fastopen_blackhole_timeout_sec = 3600
net.ipv4.tcp_fastopen_key = 00000000-00000000-00000000-00000000
net.ipv4.tcp_fin_timeout = 60
net.ipv4.tcp_frto = 2
net.ipv4.tcp_fwmark_accept = 0
net.ipv4.tcp_invalid_ratelimit = 500
net.ipv4.tcp_keepalive_intvl = 75
net.ipv4.tcp_keepalive_probes = 9
net.ipv4.tcp_keepalive_time = 7200
net.ipv4.tcp_l3mdev_accept = 0
net.ipv4.tcp_limit_output_bytes = 262144
net.ipv4.tcp_low_latency = 0
net.ipv4.tcp_max_orphans = 4096
net.ipv4.tcp_max_reordering = 300
net.ipv4.tcp_max_syn_backlog = 128
net.ipv4.tcp_max_tw_buckets = 4096
net.ipv4.tcp_mem = 8691   11589   17382
net.ipv4.tcp_min_rtt_wlen = 300
net.ipv4.tcp_min_tso_segs = 2
net.ipv4.tcp_moderate_rcvbuf = 1
net.ipv4.tcp_mtu_probing = 0
net.ipv4.tcp_no_metrics_save = 0
net.ipv4.tcp_notsent_lowat = 4294967295
net.ipv4.tcp_orphan_retries = 0
net.ipv4.tcp_pacing_ca_ratio = 120
net.ipv4.tcp_pacing_ss_ratio = 200
net.ipv4.tcp_probe_interval = 600
net.ipv4.tcp_probe_threshold = 8
net.ipv4.tcp_recovery = 1
net.ipv4.tcp_reordering = 3
net.ipv4.tcp_retrans_collapse = 1
net.ipv4.tcp_retries1 = 3
net.ipv4.tcp_retries2 = 15
net.ipv4.tcp_rfc1337 = 0
net.ipv4.tcp_rmem = 4096   87380   5933824
net.ipv4.tcp_sack = 1
net.ipv4.tcp_slow_start_after_idle = 1
net.ipv4.tcp_stdurg = 0
net.ipv4.tcp_syn_retries = 6
net.ipv4.tcp_synack_retries = 5
net.ipv4.tcp_syncookies = 1
net.ipv4.tcp_thin_linear_timeouts = 0
net.ipv4.tcp_timestamps = 1
net.ipv4.tcp_tso_win_divisor = 3
net.ipv4.tcp_tw_reuse = 0
net.ipv4.tcp_window_scaling = 1
net.ipv4.tcp_wmem = 4096   16384   4194304
net.ipv4.tcp_workaround_signed_windows = 0
net.ipv4.udp_early_demux = 1
net.ipv4.udp_l3mdev_accept = 0
net.ipv4.udp_mem = 17382   23179   34764
net.ipv4.udp_rmem_min = 4096
net.ipv4.udp_wmem_min = 4096
net.ipv4.xfrm4_gc_thresh = 32768
net.ipv6.anycast_src_echo_reply = 0
net.ipv6.auto_flowlabels = 1
net.ipv6.bindv6only = 0
net.ipv6.conf.all.accept_dad = 0
net.ipv6.conf.all.accept_ra = 1
net.ipv6.conf.all.accept_ra_defrtr = 1
net.ipv6.conf.all.accept_ra_from_local = 0
net.ipv6.conf.all.accept_ra_min_hop_limit = 1
net.ipv6.conf.all.accept_ra_mtu = 1
net.ipv6.conf.all.accept_ra_pinfo = 1
net.ipv6.conf.all.accept_ra_rt_info_max_plen = 0
net.ipv6.conf.all.accept_ra_rt_info_min_plen = 0
net.ipv6.conf.all.accept_ra_rtr_pref = 1
net.ipv6.conf.all.accept_redirects = 1
net.ipv6.conf.all.accept_source_route = 0
net.ipv6.conf.all.addr_gen_mode = 0
net.ipv6.conf.all.autoconf = 1
net.ipv6.conf.all.dad_transmits = 1
net.ipv6.conf.all.disable_ipv6 = 0
net.ipv6.conf.all.disable_policy = 0
net.ipv6.conf.all.drop_unicast_in_l2_multicast = 0
net.ipv6.conf.all.drop_unsolicited_na = 0
net.ipv6.conf.all.enhanced_dad = 1
net.ipv6.conf.all.force_mld_version = 0
net.ipv6.conf.all.force_tllao = 0
net.ipv6.conf.all.forwarding = 0
net.ipv6.conf.all.hop_limit = 64
net.ipv6.conf.all.ignore_routes_with_linkdown = 0
net.ipv6.conf.all.keep_addr_on_down = 0
net.ipv6.conf.all.max_addresses = 16
net.ipv6.conf.all.max_desync_factor = 600
net.ipv6.conf.all.mc_forwarding = 0
net.ipv6.conf.all.mldv1_unsolicited_report_interval = 10000
net.ipv6.conf.all.mldv2_unsolicited_report_interval = 1000
net.ipv6.conf.all.mtu = 1280
net.ipv6.conf.all.ndisc_notify = 0
net.ipv6.conf.all.optimistic_dad = 0
net.ipv6.conf.all.proxy_ndp = 0
net.ipv6.conf.all.regen_max_retry = 3
net.ipv6.conf.all.router_probe_interval = 60
net.ipv6.conf.all.router_solicitation_delay = 1
net.ipv6.conf.all.router_solicitation_interval = 4
net.ipv6.conf.all.router_solicitation_max_interval = 3600
net.ipv6.conf.all.router_solicitations = -1
net.ipv6.conf.all.seg6_enabled = 0
net.ipv6.conf.all.suppress_frag_ndisc = 1
net.ipv6.conf.all.temp_prefered_lft = 86400
net.ipv6.conf.all.temp_valid_lft = 604800
net.ipv6.conf.all.use_oif_addrs_only = 0
net.ipv6.conf.all.use_optimistic = 0
net.ipv6.conf.all.use_tempaddr = 0
net.ipv6.conf.default.accept_dad = 1
net.ipv6.conf.default.accept_ra = 1
net.ipv6.conf.default.accept_ra_defrtr = 1
net.ipv6.conf.default.accept_ra_from_local = 0
net.ipv6.conf.default.accept_ra_min_hop_limit = 1
net.ipv6.conf.default.accept_ra_mtu = 1
net.ipv6.conf.default.accept_ra_pinfo = 1
net.ipv6.conf.default.accept_ra_rt_info_max_plen = 0
net.ipv6.conf.default.accept_ra_rt_info_min_plen = 0
net.ipv6.conf.default.accept_ra_rtr_pref = 1
net.ipv6.conf.default.accept_redirects = 1
net.ipv6.conf.default.accept_source_route = 0
net.ipv6.conf.default.addr_gen_mode = 0
net.ipv6.conf.default.autoconf = 1
net.ipv6.conf.default.dad_transmits = 1
net.ipv6.conf.default.disable_ipv6 = 0
net.ipv6.conf.default.disable_policy = 0
net.ipv6.conf.default.drop_unicast_in_l2_multicast = 0
net.ipv6.conf.default.drop_unsolicited_na = 0
net.ipv6.conf.default.enhanced_dad = 1
net.ipv6.conf.default.force_mld_version = 0
net.ipv6.conf.default.force_tllao = 0
net.ipv6.conf.default.forwarding = 0
net.ipv6.conf.default.hop_limit = 64
net.ipv6.conf.default.ignore_routes_with_linkdown = 0
net.ipv6.conf.default.keep_addr_on_down = 0
net.ipv6.conf.default.max_addresses = 16
net.ipv6.conf.default.max_desync_factor = 600
net.ipv6.conf.default.mc_forwarding = 0
net.ipv6.conf.default.mldv1_unsolicited_report_interval = 10000
net.ipv6.conf.default.mldv2_unsolicited_report_interval = 1000
net.ipv6.conf.default.mtu = 1280
net.ipv6.conf.default.ndisc_notify = 0
net.ipv6.conf.default.optimistic_dad = 0
net.ipv6.conf.default.proxy_ndp = 0
net.ipv6.conf.default.regen_max_retry = 3
net.ipv6.conf.default.router_probe_interval = 60
net.ipv6.conf.default.router_solicitation_delay = 1
net.ipv6.conf.default.router_solicitation_interval = 4
net.ipv6.conf.default.router_solicitation_max_interval = 3600
net.ipv6.conf.default.router_solicitations = -1
net.ipv6.conf.default.seg6_enabled = 0
net.ipv6.conf.default.suppress_frag_ndisc = 1
net.ipv6.conf.default.temp_prefered_lft = 86400
net.ipv6.conf.default.temp_valid_lft = 604800
net.ipv6.conf.default.use_oif_addrs_only = 0
net.ipv6.conf.default.use_optimistic = 0
net.ipv6.conf.default.use_tempaddr = 0
net.ipv6.conf.eth0.accept_dad = 1
net.ipv6.conf.eth0.accept_ra = 0
net.ipv6.conf.eth0.accept_ra_defrtr = 1
net.ipv6.conf.eth0.accept_ra_from_local = 0
net.ipv6.conf.eth0.accept_ra_min_hop_limit = 1
net.ipv6.conf.eth0.accept_ra_mtu = 1
net.ipv6.conf.eth0.accept_ra_pinfo = 1
net.ipv6.conf.eth0.accept_ra_rt_info_max_plen = 0
net.ipv6.conf.eth0.accept_ra_rt_info_min_plen = 0
net.ipv6.conf.eth0.accept_ra_rtr_pref = 1
net.ipv6.conf.eth0.accept_redirects = 1
net.ipv6.conf.eth0.accept_source_route = 0
net.ipv6.conf.eth0.addr_gen_mode = 0
net.ipv6.conf.eth0.autoconf = 1
net.ipv6.conf.eth0.dad_transmits = 1
net.ipv6.conf.eth0.disable_ipv6 = 0
net.ipv6.conf.eth0.disable_policy = 0
net.ipv6.conf.eth0.drop_unicast_in_l2_multicast = 0
net.ipv6.conf.eth0.drop_unsolicited_na = 0
net.ipv6.conf.eth0.enhanced_dad = 1
net.ipv6.conf.eth0.force_mld_version = 0
net.ipv6.conf.eth0.force_tllao = 0
net.ipv6.conf.eth0.forwarding = 0
net.ipv6.conf.eth0.hop_limit = 64
net.ipv6.conf.eth0.ignore_routes_with_linkdown = 0
net.ipv6.conf.eth0.keep_addr_on_down = 0
net.ipv6.conf.eth0.max_addresses = 16
net.ipv6.conf.eth0.max_desync_factor = 600
net.ipv6.conf.eth0.mc_forwarding = 0
net.ipv6.conf.eth0.mldv1_unsolicited_report_interval = 10000
net.ipv6.conf.eth0.mldv2_unsolicited_report_interval = 1000
net.ipv6.conf.eth0.mtu = 1500
net.ipv6.conf.eth0.ndisc_notify = 0
net.ipv6.conf.eth0.optimistic_dad = 0
net.ipv6.conf.eth0.proxy_ndp = 0
net.ipv6.conf.eth0.regen_max_retry = 3
net.ipv6.conf.eth0.router_probe_interval = 60
net.ipv6.conf.eth0.router_solicitation_delay = 1
net.ipv6.conf.eth0.router_solicitation_interval = 4
net.ipv6.conf.eth0.router_solicitation_max_interval = 3600
net.ipv6.conf.eth0.router_solicitations = -1
net.ipv6.conf.eth0.seg6_enabled = 0
net.ipv6.conf.eth0.suppress_frag_ndisc = 1
net.ipv6.conf.eth0.temp_prefered_lft = 86400
net.ipv6.conf.eth0.temp_valid_lft = 604800
net.ipv6.conf.eth0.use_oif_addrs_only = 0
net.ipv6.conf.eth0.use_optimistic = 0
net.ipv6.conf.eth0.use_tempaddr = 0
net.ipv6.conf.lo.accept_dad = -1
net.ipv6.conf.lo.accept_ra = 1
net.ipv6.conf.lo.accept_ra_defrtr = 1
net.ipv6.conf.lo.accept_ra_from_local = 0
net.ipv6.conf.lo.accept_ra_min_hop_limit = 1
net.ipv6.conf.lo.accept_ra_mtu = 1
net.ipv6.conf.lo.accept_ra_pinfo = 1
net.ipv6.conf.lo.accept_ra_rt_info_max_plen = 0
net.ipv6.conf.lo.accept_ra_rt_info_min_plen = 0
net.ipv6.conf.lo.accept_ra_rtr_pref = 1
net.ipv6.conf.lo.accept_redirects = 1
net.ipv6.conf.lo.accept_source_route = 0
net.ipv6.conf.lo.addr_gen_mode = 0
net.ipv6.conf.lo.autoconf = 1
net.ipv6.conf.lo.dad_transmits = 1
net.ipv6.conf.lo.disable_ipv6 = 0
net.ipv6.conf.lo.disable_policy = 0
net.ipv6.conf.lo.drop_unicast_in_l2_multicast = 0
net.ipv6.conf.lo.drop_unsolicited_na = 0
net.ipv6.conf.lo.enhanced_dad = 1
net.ipv6.conf.lo.force_mld_version = 0
net.ipv6.conf.lo.force_tllao = 0
net.ipv6.conf.lo.forwarding = 0
net.ipv6.conf.lo.hop_limit = 64
net.ipv6.conf.lo.ignore_routes_with_linkdown = 0
net.ipv6.conf.lo.keep_addr_on_down = 0
net.ipv6.conf.lo.max_addresses = 16
net.ipv6.conf.lo.max_desync_factor = 600
net.ipv6.conf.lo.mc_forwarding = 0
net.ipv6.conf.lo.mldv1_unsolicited_report_interval = 10000
net.ipv6.conf.lo.mldv2_unsolicited_report_interval = 1000
net.ipv6.conf.lo.mtu = 65536
net.ipv6.conf.lo.ndisc_notify = 0
net.ipv6.conf.lo.optimistic_dad = 0
net.ipv6.conf.lo.proxy_ndp = 0
net.ipv6.conf.lo.regen_max_retry = 3
net.ipv6.conf.lo.router_probe_interval = 60
net.ipv6.conf.lo.router_solicitation_delay = 1
net.ipv6.conf.lo.router_solicitation_interval = 4
net.ipv6.conf.lo.router_solicitation_max_interval = 3600
net.ipv6.conf.lo.router_solicitations = -1
net.ipv6.conf.lo.seg6_enabled = 0
net.ipv6.conf.lo.suppress_frag_ndisc = 1
net.ipv6.conf.lo.temp_prefered_lft = 86400
net.ipv6.conf.lo.temp_valid_lft = 604800
net.ipv6.conf.lo.use_oif_addrs_only = 0
net.ipv6.conf.lo.use_optimistic = 0
net.ipv6.conf.lo.use_tempaddr = -1
net.ipv6.flowlabel_consistency = 1
net.ipv6.flowlabel_reflect = 0
net.ipv6.flowlabel_state_ranges = 0
net.ipv6.fwmark_reflect = 0
net.ipv6.icmp.ratelimit = 1000
net.ipv6.idgen_delay = 1
net.ipv6.idgen_retries = 3
net.ipv6.ip6frag_high_thresh = 4194304
net.ipv6.ip6frag_low_thresh = 3145728
net.ipv6.ip6frag_secret_interval = 0
net.ipv6.ip6frag_time = 60
net.ipv6.ip_nonlocal_bind = 0
net.ipv6.mld_max_msf = 64
net.ipv6.mld_qrv = 2
net.ipv6.neigh.default.anycast_delay = 100
net.ipv6.neigh.default.app_solicit = 0
net.ipv6.neigh.default.base_reachable_time_ms = 30000
net.ipv6.neigh.default.delay_first_probe_time = 5
net.ipv6.neigh.default.gc_interval = 30
net.ipv6.neigh.default.gc_stale_time = 60
net.ipv6.neigh.default.gc_thresh1 = 128
net.ipv6.neigh.default.gc_thresh2 = 512
net.ipv6.neigh.default.gc_thresh3 = 1024
net.ipv6.neigh.default.locktime = 0
net.ipv6.neigh.default.mcast_resolicit = 0
net.ipv6.neigh.default.mcast_solicit = 3
net.ipv6.neigh.default.proxy_delay = 80
net.ipv6.neigh.default.proxy_qlen = 64
net.ipv6.neigh.default.retrans_time_ms = 1000
net.ipv6.neigh.default.ucast_solicit = 3
net.ipv6.neigh.default.unres_qlen = 86
net.ipv6.neigh.default.unres_qlen_bytes = 163840
net.ipv6.neigh.eth0.anycast_delay = 100
net.ipv6.neigh.eth0.app_solicit = 0
net.ipv6.neigh.eth0.base_reachable_time_ms = 30000
net.ipv6.neigh.eth0.delay_first_probe_time = 5
net.ipv6.neigh.eth0.gc_stale_time = 60
net.ipv6.neigh.eth0.locktime = 0
net.ipv6.neigh.eth0.mcast_resolicit = 0
net.ipv6.neigh.eth0.mcast_solicit = 3
net.ipv6.neigh.eth0.proxy_delay = 80
net.ipv6.neigh.eth0.proxy_qlen = 64
net.ipv6.neigh.eth0.retrans_time_ms = 1000
net.ipv6.neigh.eth0.ucast_solicit = 3
net.ipv6.neigh.eth0.unres_qlen = 86
net.ipv6.neigh.eth0.unres_qlen_bytes = 163840
net.ipv6.neigh.lo.anycast_delay = 100
net.ipv6.neigh.lo.app_solicit = 0
net.ipv6.neigh.lo.base_reachable_time_ms = 30000
net.ipv6.neigh.lo.delay_first_probe_time = 5
net.ipv6.neigh.lo.gc_stale_time = 60
net.ipv6.neigh.lo.locktime = 0
net.ipv6.neigh.lo.mcast_resolicit = 0
net.ipv6.neigh.lo.mcast_solicit = 3
net.ipv6.neigh.lo.proxy_delay = 80
net.ipv6.neigh.lo.proxy_qlen = 64
net.ipv6.neigh.lo.retrans_time_ms = 1000
net.ipv6.neigh.lo.ucast_solicit = 3
net.ipv6.neigh.lo.unres_qlen = 86
net.ipv6.neigh.lo.unres_qlen_bytes = 163840
net.ipv6.route.gc_elasticity = 9
net.ipv6.route.gc_interval = 30
net.ipv6.route.gc_min_interval = 0
net.ipv6.route.gc_min_interval_ms = 500
net.ipv6.route.gc_thresh = 1024
net.ipv6.route.gc_timeout = 60
net.ipv6.route.max_size = 4096
net.ipv6.route.min_adv_mss = 1220
net.ipv6.route.mtu_expires = 600
net.ipv6.xfrm6_gc_thresh = 32768
net.netfilter.nf_log.0 = NONE
net.netfilter.nf_log.1 = NONE
net.netfilter.nf_log.10 = NONE
net.netfilter.nf_log.11 = NONE
net.netfilter.nf_log.12 = NONE
net.netfilter.nf_log.2 = NONE
net.netfilter.nf_log.3 = NONE
net.netfilter.nf_log.4 = NONE
net.netfilter.nf_log.5 = NONE
net.netfilter.nf_log.6 = NONE
net.netfilter.nf_log.7 = NONE
net.netfilter.nf_log.8 = NONE
net.netfilter.nf_log.9 = NONE
net.netfilter.nf_log_all_netns = 0
net.unix.max_dgram_qlen = 512
user.max_cgroup_namespaces = 14875
user.max_inotify_instances = 128
user.max_inotify_watches = 8192
user.max_ipc_namespaces = 14875
user.max_mnt_namespaces = 14875
user.max_net_namespaces = 14875
user.max_pid_namespaces = 14875
user.max_user_namespaces = 14875
user.max_uts_namespaces = 14875
vm.admin_reserve_kbytes = 8192
vm.block_dump = 0
vm.compact_unevictable_allowed = 1
vm.dirty_background_bytes = 0
vm.dirty_background_ratio = 10
vm.dirty_bytes = 0
vm.dirty_expire_centisecs = 3000
vm.dirty_ratio = 20
vm.dirty_writeback_centisecs = 500
vm.dirtytime_expire_seconds = 43200
vm.drop_caches = 0
vm.extfrag_threshold = 500
vm.highmem_is_dirtyable = 0
vm.laptop_mode = 0
vm.legacy_va_layout = 0
vm.lowmem_reserve_ratio = 32   32
vm.max_map_count = 65530
vm.min_free_kbytes = 3456
vm.mmap_min_addr = 4096
vm.mmap_rnd_bits = 8
vm.nr_pdflush_threads = 0
vm.oom_dump_tasks = 1
vm.oom_kill_allocating_task = 0
vm.overcommit_kbytes = 0
vm.overcommit_memory = 0
vm.overcommit_ratio = 50
vm.page-cluster = 3
vm.panic_on_oom = 0
vm.percpu_pagelist_fraction = 0
vm.stat_interval = 1
vm.swappiness = 60
vm.user_reserve_kbytes = 63407
vm.vfs_cache_pressure = 100
vm.watermark_scale_factor = 10
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby odroid » Tue Jun 12, 2018 6:41 pm

I have no idea why Arch has "armv7h" kernel.

Code: Select all
odroid@odroid:~$ lsmod
Module                  Size  Used by
fuse                   86016  3
cpufreq_conservative    16384  0
cpufreq_userspace      16384  0
cpufreq_powersave      16384  0
binfmt_misc            20480  1
spidev                 20480  0
sd_mod                 40960  2
sg                     32768  0
evdev                  24576  4
joydev                 20480  0
input_leds             16384  0
spi_s3c64xx            20480  0
gpio_keys              20480  0
uio_pdrv_genirq        16384  0
uio                    16384  1 uio_pdrv_genirq
exynos_gpiomem         16384  0
sch_fq_codel           20480  2
ip_tables              24576  0
ipv6                  385024  58
uas                    20480  0
usb_storage            49152  2 uas
scsi_mod              135168  4 sd_mod,usb_storage,uas,sg
hid_logitech_hidpp     28672  0
hid_logitech_dj        20480  0
usbhid                 45056  0
extcon_usb_gpio        16384  0


Code: Select all
odroid@odroid:~$ cat /proc/cmdline
console=tty1 console=ttySAC2,115200n8 root=UUID=e139ce78-9841-40fe-8823-96a304a09859 rootwait ro fsck.repair=yes net.ifnames=0  HPD=true vout=hdmi usbhid.quirks=0x0eef:0x0005:0x0004 smsc95xx.macaddr=00:1e:06:61:7a:39 false s5p_mfc.mem=16M
User avatar
odroid
Site Admin
 
Posts: 28704
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby rooted » Tue Jun 12, 2018 9:58 pm

Arch is bleeding edge Linux, you should try the official HK Ubuntu release.
User avatar
rooted
 
Posts: 5582
Joined: Fri Dec 19, 2014 9:12 am
Location: Gulf of Mexico, US
languages_spoken: english
ODROIDs: C1, C1+, C2
XU3 Lite, XU4
N1
VU7+
HiFi Shield 2
Smart Power (original)

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby DarkBahamut » Wed Jun 13, 2018 5:18 am

The little cluster voltages are on the low side (IMO) in 4.14, so I could certainly see that being a cause of stability issues. You seemed to get improvement after lowering that cluster too. The A7 cluster also has a 'broken' (incorrectly stepped) voltage curve. trying limiting the A7 cluster (CPU0-3) to 1.4 or maybe 1.3GHz and it may work fine then as these use the same voltage as the 1.5GHz step due to the incorrect curve.

For reference, the 4.14 kernel uses lower voltage at 1.5GHz than the 3.10 kernel does at 1.4GHz on some bins. I wouldn't be surprised if this is the cause of many of the "My XU4 randomly crashes under X load" reports on 4.14.

Problem commit: https://github.com/hardkernel/linux/com ... b65c94eeec (dropped the 1.5GHz voltage by 62.5mV!)
DarkBahamut
 
Posts: 312
Joined: Tue Jan 19, 2016 10:19 am
languages_spoken: english
ODROIDs: XU4, N1

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby rooted » Wed Jun 13, 2018 6:57 am

That commit seems like it may be a mistake. All voltages were raised except 1500mhz
User avatar
rooted
 
Posts: 5582
Joined: Fri Dec 19, 2014 9:12 am
Location: Gulf of Mexico, US
languages_spoken: english
ODROIDs: C1, C1+, C2
XU3 Lite, XU4
N1
VU7+
HiFi Shield 2
Smart Power (original)

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Wed Jun 13, 2018 11:00 am

I would never have found this myself. Your recommended solution is to keep cores 4-7 at 2.0GHz but lower cores 0-3 to 1.4 or 1.3GHz? I will test that. Can this issue be reported so the Arch kernel package could be updated?
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby rooted » Wed Jun 13, 2018 11:03 am

2.0GHz is wasteful really, generates too much heat to be useful since it causes throttling.

1.8GHz and 1.4GHz is what I would choose.
User avatar
rooted
 
Posts: 5582
Joined: Fri Dec 19, 2014 9:12 am
Location: Gulf of Mexico, US
languages_spoken: english
ODROIDs: C1, C1+, C2
XU3 Lite, XU4
N1
VU7+
HiFi Shield 2
Smart Power (original)

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby Ronaldleess » Wed Jun 13, 2018 10:10 pm

rooted wrote:2.0GHz is wasteful really, generates too much heat to be useful since it causes throttling.

1.8GHz and 1.4GHz is what I would choose.


Thanks for that. I was experiencing the same problem (albeit in my case while running mjpeg color correction w/ blender) - and found that I had to disable a couple cores to keep temp < 93, which is where it usually froze. Realistically, what kind of cooling could I add in order to run flat out all cores? I have only standard supplied fan now.
I am The Umbrella Man
Ronaldleess
 
Posts: 57
Joined: Wed May 24, 2017 6:52 am
languages_spoken: english
ODROIDs: XU4 C1 C1+

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby rooted » Wed Jun 13, 2018 11:41 pm

No amount of cooling will allow running the big cores at 2.0 GHz without throttling.
User avatar
rooted
 
Posts: 5582
Joined: Fri Dec 19, 2014 9:12 am
Location: Gulf of Mexico, US
languages_spoken: english
ODROIDs: C1, C1+, C2
XU3 Lite, XU4
N1
VU7+
HiFi Shield 2
Smart Power (original)

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby mad_ady » Wed Jun 13, 2018 11:49 pm

A good russian winter may help though... :D
User avatar
mad_ady
 
Posts: 4585
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby Ronaldleess » Thu Jun 14, 2018 2:51 am

Haha - I keep the thermostat turned up pretty high, because I'm naturally warm blooded (or is it the opposite?). So, that doesn't help at all for cooling the XU4. The XU4 does fine with video editing so long as I disable a couple cores. Same with Krita ...
I am The Umbrella Man
Ronaldleess
 
Posts: 57
Joined: Wed May 24, 2017 6:52 am
languages_spoken: english
ODROIDs: XU4 C1 C1+

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Thu Jun 14, 2018 3:11 pm

I've been running x264 transcoding for a whole day at 1.8GHz (cpu4-7) and 1.4GHz (cpu0-3) without crashing. Thanks everyone for the help. This ends a FEW MONTHS of painful offsite debugging. I will wait for a new official Arch kernel package that fixes this CPU voltage issue.
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby tpoechtrager » Wed Jun 20, 2018 6:07 pm

rooted wrote:No amount of cooling will allow running the big cores at 2.0 GHz without throttling.


I have a fan (this one: https://www.amazon.de/gp/product/B00NEMGCIA) mounted on top of the passive cooler and I do not have any problems with throttling at 2 GHz.
tpoechtrager
 
Posts: 17
Joined: Thu Jan 25, 2018 5:02 am
languages_spoken: german, english
ODROIDs: XU 4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby mad_ady » Wed Jun 20, 2018 6:39 pm

You haven't looked close enough. Even with that fan and the blue heatsink my XU4 reduces the frequency on long loads. The frequency doesn't drop much (thanks to @darkbahamut's thermal management patches), but drops to 1.8 or 1.7
User avatar
mad_ady
 
Posts: 4585
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby rooted » Thu Jun 21, 2018 1:56 am

mad_ady wrote:You haven't looked close enough. Even with that fan and the blue heatsink my XU4 reduces the frequency on long loads. The frequency doesn't drop much (thanks to @darkbahamut's thermal management patches), but drops to 1.8 or 1.7
Where are those patches? They need to be integrated into Hardkernels branch.

I know default behavior is to throttle to like 800mhz which is terrible for performance.
User avatar
rooted
 
Posts: 5582
Joined: Fri Dec 19, 2014 9:12 am
Location: Gulf of Mexico, US
languages_spoken: english
ODROIDs: C1, C1+, C2
XU3 Lite, XU4
N1
VU7+
HiFi Shield 2
Smart Power (original)

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby tpoechtrager » Thu Jun 21, 2018 2:06 am

mad_ady wrote:You haven't looked close enough. Even with that fan and the blue heatsink my XU4 reduces the frequency on long loads. The frequency doesn't drop much (thanks to @darkbahamut's thermal management patches), but drops to 1.8 or 1.7


No it doesn't. Otherwise I wouldn't have stated that claim. Temperature stays below 70°c even on 100% load on all cores for a long time. Maybe the voltage input on your fan isn't optimal. I am powering mine externally through a USB hub.
tpoechtrager
 
Posts: 17
Joined: Thu Jan 25, 2018 5:02 am
languages_spoken: german, english
ODROIDs: XU 4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby mad_ady » Thu Jun 21, 2018 2:11 am

rooted wrote:
mad_ady wrote:You haven't looked close enough. Even with that fan and the blue heatsink my XU4 reduces the frequency on long loads. The frequency doesn't drop much (thanks to @darkbahamut's thermal management patches), but drops to 1.8 or 1.7
Where are those patches? They need to be integrated into Hardkernels branch.

I know default behavior is to throttle to like 800mhz which is terrible for performance.
They have been integrated. As far as I remember light throttling (-100/-200MHz) starts after 80C (or some trip point) in order not to let the board reach 90 so rapidly. DarkBahamut knows better
User avatar
mad_ady
 
Posts: 4585
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Thu Jun 21, 2018 4:47 am

Let's not get distracted by whether throttling occurs. The real issue is an insufficient voltage when the cores are running at the highest frequency.

I've submitted an issue on GitHub regarding the lowered voltage setting for 1.5GHz.

https://github.com/hardkernel/linux/issues/355

If the problem is really caused by that one commit as DarkBahamut suggested, then I imagine it is a very simple fix. Hopefully this can be incorporated into the next update.
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby rooted » Thu Jun 21, 2018 6:07 am

tpoechtrager wrote:
mad_ady wrote:You haven't looked close enough. Even with that fan and the blue heatsink my XU4 reduces the frequency on long loads. The frequency doesn't drop much (thanks to @darkbahamut's thermal management patches), but drops to 1.8 or 1.7


No it doesn't. Otherwise I wouldn't have stated that claim. Temperature stays below 70°c even on 100% load on all cores for a long time. Maybe the voltage input on your fan isn't optimal. I am powering mine externally through a USB hub.
No it's impossible, thermal mass is greater than any cooling capacity.

No point in arguing, it's a fact.

mad_ady wrote:
rooted wrote:
mad_ady wrote:You haven't looked close enough. Even with that fan and the blue heatsink my XU4 reduces the frequency on long loads. The frequency doesn't drop much (thanks to @darkbahamut's thermal management patches), but drops to 1.8 or 1.7
Where are those patches? They need to be integrated into Hardkernels branch.

I know default behavior is to throttle to like 800mhz which is terrible for performance.
They have been integrated. As far as I remember light throttling (-100/-200MHz) starts after 80C (or some trip point) in order not to let the board reach 90 so rapidly. DarkBahamut knows better


That's great, I haven't tested in a long time. Thanks for the information.
User avatar
rooted
 
Posts: 5582
Joined: Fri Dec 19, 2014 9:12 am
Location: Gulf of Mexico, US
languages_spoken: english
ODROIDs: C1, C1+, C2
XU3 Lite, XU4
N1
VU7+
HiFi Shield 2
Smart Power (original)

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby tpoechtrager » Thu Jun 21, 2018 6:58 pm

rooted wrote:
tpoechtrager wrote:
mad_ady wrote:You haven't looked close enough. Even with that fan and the blue heatsink my XU4 reduces the frequency on long loads. The frequency doesn't drop much (thanks to @darkbahamut's thermal management patches), but drops to 1.8 or 1.7


No it doesn't. Otherwise I wouldn't have stated that claim. Temperature stays below 70°c even on 100% load on all cores for a long time. Maybe the voltage input on your fan isn't optimal. I am powering mine externally through a USB hub.
No it's impossible, thermal mass is greater than any cooling capacity.

No point in arguing, it's a fact.


Are you kidding me? My XU4 doesn't throttle a single time even when I keep running 'stress -c 16' over night. Kernel compilation with 8 threads also causes no throttling at all. But sure, it's impossible. ... Why on earth do you think you know my setup better than I do? Even on hot days like today I do not get any throttling (> 25°c room temperature).

I won't continue this discusion anymore, because arguing with "No it's impossible, thermal mass is greater than any cooling capacity." says a lot about you.
tpoechtrager
 
Posts: 17
Joined: Thu Jan 25, 2018 5:02 am
languages_spoken: german, english
ODROIDs: XU 4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby rooted » Fri Jun 22, 2018 1:39 am

tpoechtrager wrote:Why on earth do you think you know my setup better than I do?


I don't know your setup better than you, I know the Exynos 5422 can not run the big cores @ 2ghz without throttling eventually.

It's not a personal opinion, it's from a lot of testing by many people.

What are you testing to make sure it isn't throttling that you are so positive?
User avatar
rooted
 
Posts: 5582
Joined: Fri Dec 19, 2014 9:12 am
Location: Gulf of Mexico, US
languages_spoken: english
ODROIDs: C1, C1+, C2
XU3 Lite, XU4
N1
VU7+
HiFi Shield 2
Smart Power (original)

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby Tomas J. » Fri Jun 22, 2018 2:07 am

tpoechtrager wrote:...My XU4 doesn't throttle a single time ...

What time do you get with "sysbench --test=cpu --cpu-max-prime=100000 --num-threads=8 run" ?
Tomas J.
 
Posts: 15
Joined: Wed Aug 16, 2017 4:23 am
languages_spoken: english
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby tpoechtrager » Fri Jun 22, 2018 2:43 am

Tomas J. wrote:
tpoechtrager wrote:...My XU4 doesn't throttle a single time ...

What time do you get with "sysbench --test=cpu --cpu-max-prime=100000 --num-threads=8 run" ?


Code: Select all
# uname -a
Linux odroid-xu4 4.14.37-1-ARCH #1 SMP PREEMPT Sat May 5 17:09:26 CEST 2018 armv7l GNU/Linux
# sysbench --test=cpu --cpu-max-prime=100000 --num-threads=8 run
WARNING: the --test option is deprecated. You can pass a script name or path on the command line without any options.
WARNING: --num-threads is deprecated, use --threads instead
sysbench 1.0.14 (using bundled LuaJIT 2.1.0-beta2)

Running the test with following options:
Number of threads: 8
Initializing random number generator from current time


Prime numbers limit: 100000

Initializing worker threads...

Threads started!

CPU speed:
    events per second:    19.38

General statistics:
    total time:                          10.2601s
    total number of events:              199

Latency (ms):
         min:                                  280.47
         avg:                                  407.77
         max:                                  874.03
         95th percentile:                      657.93
         sum:                                81146.37

Threads fairness:
    events (avg/stddev):           24.8750/8.68
    execution time (avg/stddev):   10.1433/0.09


May not be 100% accurate because there is some load on the apache server.

rooted wrote:
tpoechtrager wrote:Why on earth do you think you know my setup better than I do?


I don't know your setup better than you, I know the Exynos 5422 can not run the big cores @ 2ghz without throttling eventually.

It's not a personal opinion, it's from a lot of testing by many people.

What are you testing to make sure it isn't throttling that you are so positive?


I already told you how I tested it. I checked the frequency with a simple script monitoring /sys/bus/cpu/devices/cpu*/cpufreq/cpuinfo_cur_freq.
tpoechtrager
 
Posts: 17
Joined: Thu Jan 25, 2018 5:02 am
languages_spoken: german, english
ODROIDs: XU 4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby rooted » Fri Jun 22, 2018 3:49 am

I don't know what's up with your stats but that isn't correct.

From two different XU4, one in a CloudShell 1 and one XU4-Q in a CloudShell 2.

CloudShell

Code: Select all
root@cloudshell:~# sysbench --test=cpu --cpu-max-prime=100000 --num-threads=8 run
sysbench 0.4.12:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 8

Doing CPU performance benchmark

Threads started!
Done.

Maximum prime number checked in CPU test: 100000


Test execution summary:
    total time:                          407.1836s
    total number of events:              10000                                                total time taken by event execution: 3256.0233                                            per-request statistics:
         min:                                235.98ms
         avg:                                325.60ms
         max:                                412.41ms
         approx.  95 percentile:             359.67ms

Threads fairness:
    events (avg/stddev):           1250.0000/114.07
    execution time (avg/stddev):   407.0029/0.10

root@cloudshell:~# uname -a
Linux cloudshell 4.14.40+ #2 SMP PREEMPT Tue May 22 01:12:13 UTC 2018 armv7l GNU/Linux
root@cloudshell:~#


CloudShell 2 (XU4-Q)

Code: Select all
root@odroidxu4:~# sysbench --test=cpu --cpu-max-prime=100000 --num-threads=8 run
sysbench 0.4.12:  multi-threaded system evaluation benchmark

Running the test with following options:
Number of threads: 8

Doing CPU performance benchmark

Threads started!
Done.

Maximum prime number checked in CPU test: 100000


Test execution summary:
    total time:                          465.5813s
    total number of events:              10000
    total time taken by event execution: 3723.0314
    per-request statistics:
         min:                                234.61ms
         avg:                                372.30ms
         max:                                703.94ms
         approx.  95 percentile:             567.24ms

Threads fairness:
    events (avg/stddev):           1250.0000/27.60
    execution time (avg/stddev):   465.3789/0.11

root@odroidxu4:~# uname -a
Linux odroidxu4 4.9.103-odroidxu4 #1 SMP PREEMPT Tue May 29 03:38:14 PDT 2018 armv7l GNU/Linux
root@odroidxu4:~#
User avatar
rooted
 
Posts: 5582
Joined: Fri Dec 19, 2014 9:12 am
Location: Gulf of Mexico, US
languages_spoken: english
ODROIDs: C1, C1+, C2
XU3 Lite, XU4
N1
VU7+
HiFi Shield 2
Smart Power (original)

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby tpoechtrager » Fri Jun 22, 2018 3:57 am

I dont know, maybe they changed something. Your version appears to be way older. Sysbench 0.4.12 has been released in 2009 I think.
tpoechtrager
 
Posts: 17
Joined: Thu Jan 25, 2018 5:02 am
languages_spoken: german, english
ODROIDs: XU 4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby rooted » Fri Jun 22, 2018 4:04 am

tpoechtrager wrote:I dont know, maybe they changed something. Your version appears to be way older. Sysbench 0.4.12 has been released in 2009 I think.
I'm running Debian Stretch, it's the version in apt. I'm guessing by the version you are running Arch.
User avatar
rooted
 
Posts: 5582
Joined: Fri Dec 19, 2014 9:12 am
Location: Gulf of Mexico, US
languages_spoken: english
ODROIDs: C1, C1+, C2
XU3 Lite, XU4
N1
VU7+
HiFi Shield 2
Smart Power (original)

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby dandelot » Tue Jun 26, 2018 12:22 am

With odroid xu4 named q9 Ubuntu Mate 16.04 sysbench version is 0.4.12
With odroid xu4 named q9b Ubuntu Mate 18.04 sysbench version is 1.0.11

The older version of sysbench does take much longer to run, as shown earlier in this thread.
dandelot
 
Posts: 56
Joined: Sun Feb 25, 2018 1:35 am
languages_spoken: english
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby rooted » Tue Jun 26, 2018 1:12 am

dandelot wrote:With odroid xu4 named q9 Ubuntu Mate 16.04 sysbench version is 0.4.12
With odroid xu4 named q9b Ubuntu Mate 18.04 sysbench version is 1.0.11

The older version of sysbench does take much longer to run, as shown earlier in this thread.
The command simply needs adjusted to fit the newer version.
User avatar
rooted
 
Posts: 5582
Joined: Fri Dec 19, 2014 9:12 am
Location: Gulf of Mexico, US
languages_spoken: english
ODROIDs: C1, C1+, C2
XU3 Lite, XU4
N1
VU7+
HiFi Shield 2
Smart Power (original)

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby Ronaldleess » Tue Jun 26, 2018 11:24 pm

@rooted:

By *any* cooling I suspect you mean air-on-heatsink cooling. I suppose liquid cooling would be better, but seems like a ridiculous setup to do. I might consider it though, if it'd knock 20% off of color correction runs.
I am The Umbrella Man
Ronaldleess
 
Posts: 57
Joined: Wed May 24, 2017 6:52 am
languages_spoken: english
ODROIDs: XU4 C1 C1+

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby rooted » Wed Jun 27, 2018 7:03 am

Ronaldleess wrote:@rooted:

By *any* cooling I suspect you mean air-on-heatsink cooling. I suppose liquid cooling would be better, but seems like a ridiculous setup to do. I might consider it though, if it'd knock 20% off of color correction runs.
Yes air, I have wondered if liquid cooling could overcome throttling.
User avatar
rooted
 
Posts: 5582
Joined: Fri Dec 19, 2014 9:12 am
Location: Gulf of Mexico, US
languages_spoken: english
ODROIDs: C1, C1+, C2
XU3 Lite, XU4
N1
VU7+
HiFi Shield 2
Smart Power (original)

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Fri Jun 29, 2018 3:40 pm

Sorry to interrupt, but I'm afraid we have gone off-topic. Isn't the source of the problem identified? I've submitted an issue at https://github.com/hardkernel/linux/issues/355 but there has been little response. How can this be fixed?
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby odroid » Fri Jun 29, 2018 5:03 pm

We tested over 20 boards with lower voltage on LITTEL A7 cores and there was no issue.
But the number of test samples might not be enough.

Can you change the DT file to apply slightly higher voltage and test your board stability?
User avatar
odroid
Site Admin
 
Posts: 28704
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Mon Jul 02, 2018 5:49 pm

Could you give a short description of this DT file and where I can change it? Thank you.
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby joy » Mon Jul 02, 2018 5:57 pm

Hi winstonyin.
Please refer to this point.
https://github.com/hardkernel/linux/blo ... .dtsi#L103

You can use "1312500" as opp-microvolt instead of "1250000".
Code: Select all
   opp-1500000000 {
      opp-hz = /bits/ 64 <1500000000>;
      opp-microvolt = <1312500>;
      clock-latency-ns = <140000>;
   };

Could you check if you have the same issue with the higher opp-voltage value?
joy
 
Posts: 515
Joined: Fri Oct 02, 2015 1:44 pm
languages_spoken: english
ODROIDs: ODROID-C1+, XU4, X

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby dandelot » Tue Jul 03, 2018 8:19 am

Running boinc (seti@home) on 7 CPUs on each of two XU4s.

I've modified the max freq of CPUs 0-3 to 1.3 Ghz on two XU4s
(cpus 4-7 left default) running boinc and each crashes within a couple days,
leaving the fans running on crash as other have noted.

Now big-ish northbridge heatsinks with stock fans.
One maxes about 83C (named q9b MATE 18.04)
and the (older) one 85C (named q9 MATE 16.04).
The older one throttles to 1.8/1.9Ghz on 4-7 the
newer one seems to stay at 2.0Ghz on those cpus.

Governor(s) set to performance.
Just personal datapoints.
dandelot
 
Posts: 56
Joined: Sun Feb 25, 2018 1:35 am
languages_spoken: english
ODROIDs: XU4

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby joy » Tue Jul 10, 2018 9:49 am

@dandelot
Thank you for sharing the valuable test result.
I'm not sure but I doubt the root cause of this thread's issue can be different from the problem with boinc,
because winstonyin said that in this case, with max freq 1.4GHz, there is no issue with ffmpeg conversion.
But also I think your approach is reasonable.

I haven't reproduced the same issue yet, :( so will try.

And it will be worthy that you can share this result in this thread. :)
viewtopic.php?f=99&t=30527&start=100#p223454
Last edited by joy on Tue Jul 10, 2018 9:57 am, edited 1 time in total.
joy
 
Posts: 515
Joined: Fri Oct 02, 2015 1:44 pm
languages_spoken: english
ODROIDs: ODROID-C1+, XU4, X

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby joy » Tue Jul 10, 2018 9:51 am

winstonyin wrote:Could you give a short description of this DT file and where I can change it? Thank you.

Hi winstonyin,
Did you have any chance to try the higher opp voltage and check if there is still the same issue?
joy
 
Posts: 515
Joined: Fri Oct 02, 2015 1:44 pm
languages_spoken: english
ODROIDs: ODROID-C1+, XU4, X

Re: XU4 crashes under heavy load (video/image conversion)

Unread postby winstonyin » Thu Jul 12, 2018 6:31 pm

@joy, sorry for the delay. I'm not quite sure how to let this change reflect on my machine. I assume it requires recompiling the kernel myself, in which case it would be difficult on my prod server.
winstonyin
 
Posts: 20
Joined: Sat May 26, 2018 5:37 pm
languages_spoken: english, chinese, german
ODROIDs: XU4

Next

Return to Issues

Who is online

Users browsing this forum: No registered users and 2 guests