Odroid C2 Crash and no error log

Moderators: mdrjr, odroid

Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Sat Jun 10, 2017 4:07 am

Hi,

Sorry for my english.

I have a Odroid C2 with eMMC5.0 32Go. Since several days my Odroid C2 randomly crash.

In the "syslog, kernel.log" i have not error. I have formatted my eMMC module and reinstalled Ubuntu and i have always the same problem, randomly crash :/

For information, my Odroid C2 is not overclocked.

I do not know what to do. If someone have an idea, i'm listen him.

Than you :)
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby odroid » Sat Jun 10, 2017 10:29 am

Which power supply do you use?
User avatar
odroid
Site Admin
 
Posts: 23623
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Sat Jun 10, 2017 8:54 pm

Hello, i use micro usb power supply 3A @ 5V (it's power supply for raspberry pi 3)

After the futur crash, i go to use an other power supply but it's a 2,4A @ 5V.
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Sun Jun 11, 2017 6:52 pm

If you have a serial console try to see if there are any errors on the console when it crashes. Otherwise, if you have a different device which is always on on the network you can activate netconsole (check out june issue of odroid magazine). Maybe something causes the kernel to crash
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby odroid » Mon Jun 12, 2017 10:36 am

If you have a DMM, please measure the voltage on 5.0V power rail in 40pin header.
http://odroid.com/dokuwiki/doku.php?id= ... connectors
It must be stable at 4.8~5.2Volt.

Or consider using official 5V/2A PSU with DC barrel jack.
User avatar
odroid
Site Admin
 
Posts: 23623
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Tue Jun 13, 2017 5:59 am

Hi,

Thank you for your replies. I have change my power supply with a power supply 2,4A @ 5V and my Odroid C2 have again crashed (Jun 12 20:22):

Code: Select all
Jun 12 20:20:45 monkeydc2 kernel: [84393.187912] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jun 12 20:22:22 monkeydc2 postfix/anvil[10970]: statistics: max connection rate 1/60s for (smtp:154.16.49.87) at Jun 12 20:19:01
Jun 12 20:22:22 monkeydc2 postfix/anvil[10970]: statistics: max connection count 1 for (smtp:154.16.49.87) at Jun 12 20:19:01
Jun 12 20:22:22 monkeydc2 postfix/anvil[10970]: statistics: max cache size 1 at Jun 12 20:19:01
Jun 12 20:22:22 monkeydc2 rsyslogd-2007: action 'action 10' suspended, next retry is Mon Jun 12 20:23:52 2017 [v8.16.0 try http://www.rsyslog.com/e/2007 ]
Jun 12 20:22:45 monkeydc2 kernel: [84513.572944] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jun 12 20:22:46 monkeydc2 kernel: [84514.135934] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Feb 11 17:28:05 monkeydc2 rsyslogd: [origin software="rsyslogd" swVersion="8.16.0" x-pid="687" x-info="http://www.rsyslog.com"] start
Feb 11 17:28:05 monkeydc2 systemd-modules-load[256]: Failed to find module 'lp'
Feb 11 17:28:05 monkeydc2 systemd-modules-load[256]: Failed to find module 'ppdev'


I haven't DMM :/ I think that my problem isn't a power problem. I try to actived "netconsole" for get critical error on my second server (raspberry pi) who is always online and do not crash ^^ but for the moment i have a problem to configure that, nevertheless, I followed the documentation of the magazine odroid of June.

I followed the following steps :

1 - On my Odroid C2 -> Create the file "/etc/modprobe.d/netconsole.conf"

##########################

#Raspberry : 192.168.0.12
options netconsole netconsole=6666@192.168.0.11/eth0,6666@192.168.0.12/b8:XX:XX:XX:XX:XX

##########################


2 - On my Raspberry Pi -> Create the file "/etc/rsyslog.d/netconsole.conf"

##########################

$ ModLoad imudp
$ RuleSet remote

/var/log/C2_netconsole.log
& stop

$InputUDPServerBindRuleset remote
$UDPServerRun 6666

$RuleSet RSYSLOG_DefaultRuleset

##########################

3 - On my Raspberry Pi -> Create the file "/var/log/C2_netconsole.log"

4 - Result :

C2_netconsole.log" is not empty but is not Odroid C2 log but Raspberry Pi log, why ?

A idea ? Thank you :)
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby odroid » Tue Jun 13, 2017 8:44 am

I saw the Netconsole should work on C2.
Please refer this guide.
viewtopic.php?f=52&t=26965
User avatar
odroid
Site Admin
 
Posts: 23623
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Tue Jun 13, 2017 12:56 pm

Hmm, not sure why you're getting other logs as well... You could try to remove the syslog config and temporarly run a netcat on port 6666 instead. The article ended with some links where there were some netcat receiver examples.
Also, you can test netconsole + receiver with:
Code: Select all
c2$ sudo echo "test netconsole" > /dev/kmsg
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Tue Jun 13, 2017 2:44 pm

Here's another test. While running tail -f on your log file, generate a kernel crash on the odroid c2:
Code: Select all
c2$ sync
c2$ sudo su -
c2# echo c > /proc/sysrq-trigger


On your rsyslog log you should see a kernel dump like this:
Code: Select all
Jun 13 08:39:15 192.168.228.10 [599959.896768] SysRq :
Jun 13 08:39:15 Trigger a crash
Jun 13 08:39:15 192.168.228.10 [599959.896852] Unable to handle kernel NULL pointer dereference at virtual address 00000000
Jun 13 08:39:15 192.168.228.10 [599959.902855] pgd = ffffffc05899c000
Jun 13 08:39:15 192.168.228.10 [599959.906304] [00000000] *pgd=000000003e75e003
Jun 13 08:39:15 192.168.228.10 , *pmd=0000000000000000
Jun 13 08:39:15 192.168.228.10 
Jun 13 08:39:15 192.168.228.10 [599959.912604] Internal error: Oops: 96000046 [#1] PREEMPT SMP
Jun 13 08:39:15 192.168.228.10 [599959.918207] Modules linked in:
Jun 13 08:39:15 192.168.228.10  fuse
Jun 13 08:39:15 192.168.228.10  lirc_odroid(C)
Jun 13 08:39:15 192.168.228.10  lirc_dev
Jun 13 08:39:15 192.168.228.10  zram
Jun 13 08:39:15 192.168.228.10  lz4_decompress
Jun 13 08:39:15 192.168.228.10  lz4_compress
Jun 13 08:39:15 192.168.228.10  meson_gpiomem
Jun 13 08:39:15 192.168.228.10  gxbb_wdt
Jun 13 08:39:15 192.168.228.10  netconsole
Jun 13 08:39:15 192.168.228.10  pwm_ctrl
Jun 13 08:39:15 192.168.228.10  pwm_meson
Jun 13 08:39:15 192.168.228.10  aml_i2c
Jun 13 08:39:15 192.168.228.10  sx865x
Jun 13 08:39:15 192.168.228.10  flexfb
Jun 13 08:39:15 192.168.228.10  fbtft_device
Jun 13 08:39:15 192.168.228.10  fbtft
Jun 13 08:39:15 192.168.228.10  syscopyarea
Jun 13 08:39:15 192.168.228.10  sysfillrect
Jun 13 08:39:15 192.168.228.10  sysimgblt
Jun 13 08:39:15 192.168.228.10  fb_sys_fops
Jun 13 08:39:15 192.168.228.10  ipv6
Jun 13 08:39:15 192.168.228.10  autofs4
Jun 13 08:39:15 192.168.228.10 
Jun 13 08:39:15 192.168.228.10 [599959.939860] CPU: 3 PID: 5496 Comm: bash Tainted: G         C   3.14.79-113 #1
Jun 13 08:39:15 192.168.228.10 [599959.947016] task: ffffffc03e12ec80 ti: ffffffc03e758000 task.ti: ffffffc03e758000
Jun 13 08:39:15 192.168.228.10 [599959.954529] PC is at sysrq_handle_crash+0x24/0x30
Jun 13 08:39:15 192.168.228.10 [599959.959265] LR is at __handle_sysrq+0x130/0x198
Jun 13 08:39:15 192.168.228.10 [599959.963833] pc : [<ffffffc00142d144>] lr : [<ffffffc00142dcb0>] pstate: 800001c5
Jun 13 08:39:15 192.168.228.10 [599959.971249] sp : ffffffc03e75bd90
Jun 13 08:39:15 192.168.228.10 [599959.974613] x29: ffffffc03e75bd90
Jun 13 08:39:15 192.168.228.10 x28: ffffffc03e758000
...


If you want to capture the log with netcat, try starting a netcat listener on the rpi:
Code: Select all
rpi$ nc -u -l -p 6666

Don't close the rpi session (or start it inside screen/tmux/byobu).
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Wed Jun 14, 2017 12:12 am

I tried this :

rpi$ nc -u -l -p 6666
c2$ sudo echo "test netconsole" > /dev/kmsg

Result : Nothing and the log is empty

I rechecked following conf files :

c2$ "/etc/modprobe.d/netconsole.conf"
rpi$ "/etc/rsyslog.d/netconsole.conf"

For me all it's ok. I don't understand why i have nothing :/
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Wed Jun 14, 2017 3:33 am

c2$ sudo echo "test netconsole" > /dev/kmsg will not work since sudo applies to the command (echo), not the file redirection. Try c2$ echo "test netconsole" | sudo tee /dev/kmsg. Also check dmesg on c2 to make sure netconsole was activated and loaded correctly. Doublecheck thebdestination mac and make sure it's in capitals.
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Wed Jun 14, 2017 3:53 am

c2$ :

"/var/log/dmesg" :

Code: Select all
(Nothing has been logged yet.)


The destination mac is OK.


"var/syslog" :

Code: Select all
Line 10600: Feb 11 17:28:03 monkeydc2 systemd-modules-load[209]: Failed to insert 'netconsole': Operation not permitted
Line 10604: Feb 11 17:28:03 monkeydc2 systemd-modules-load[209]: Failed to find module 'options netconsole netconsole=6666@192.168.0.11/eth0,6666@192.168.0.12/b8:27:eb:b9:0d:f9'
Line 10604: Feb 11 17:28:03 monkeydc2 systemd-modules-load[209]: Failed to find module 'options netconsole netconsole=6666@192.168.0.11/eth0,6666@192.168.0.12/b8:27:eb:b9:0d:f9'
Line 11543: Feb 11 17:28:03 monkeydc2 kernel: [   17.632090] netpoll: netconsole: couldn't parse config at '192.168.0.11'!
Line 11544: Feb 11 17:28:03 monkeydc2 kernel: [   17.632092] netconsole: cleaning up
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Wed Jun 14, 2017 3:19 pm

Hmm, your output is very puzzling. You should check the dmesg command output.

In syslog I'm getting output like this:
Code: Select all
Feb 11 18:28:05 kbd systemd-modules-load[205]: Inserted module 'netconsole'
...
Feb 11 18:28:05 kbd kernel: [   11.196190] netpoll: netconsole: local port 6666
Feb 11 18:28:05 kbd kernel: [   11.196195] netpoll: netconsole: local IPv4 address 192.168.228.10
Feb 11 18:28:05 kbd kernel: [   11.196196] netpoll: netconsole: interface 'eth0'
Feb 11 18:28:05 kbd kernel: [   11.196198] netpoll: netconsole: remote port 6666
Feb 11 18:28:05 kbd kernel: [   11.196200] netpoll: netconsole: remote IPv4 address 192.168.228.1
Feb 11 18:28:05 kbd kernel: [   11.196201] netpoll: netconsole: remote ethernet address 44:8a:5b:56:37:5a
Feb 11 18:28:05 kbd kernel: [   11.196206] netpoll: netconsole: device eth0 not up yet, forcing it
Feb 11 18:28:05 kbd kernel: [   11.359926] netpoll: netconsole: carrier detect appears untrustworthy, waiting 4 seconds
Feb 11 18:28:05 kbd kernel: [   15.368838] console [netcon0] enabled
Feb 11 18:28:05 kbd kernel: [   15.373624] netconsole: network logging started



I'm not sure why it says failed to insert netconsole - operation not permitted. What kernel version are you running (uname -a)? Netconsole has been enabled only recently, so make sure you update your kernel (maybe this fixes the original stability issue as well). :)
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Wed Jun 14, 2017 9:47 pm

c2$

"dmesg" command output (just netconsole lines) :

Code: Select all
[   17.625222] systemd[1]: Mounting Huge Pages File System...
[   17.632090] netpoll: netconsole: couldn't parse config at '192.168.0.11'!
[   17.632092] netconsole: cleaning up
[   17.649221] systemd[1]: Starting Journal Service...


"uname -a" command output :

Code: Select all
Linux monkeydc2 3.14.79-113 #1 SMP PREEMPT Wed May 10 00:43:15 BRT 2017 aarch64 aarch64 aarch64 GNU/Linux

I think that i use the last version.

Thank you for helping :)
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Wed Jun 14, 2017 10:28 pm

Kernel version looks fine.

Not sure why it can't load. Can you paste back the contents of:
Code: Select all
/etc/modules-load.d/modules.conf
/etc/modprobe.d/netconsole.conf


You can also try to load it manually with this command:
Code: Select all
sudo su -
modprobe netconsole
mkdir /sys/kernel/config/netconsole/target1
cd /sys/kernel/config/netconsole/target1
# set local IP address
echo 192.168.0.11 > local_ip
# set destination IP address
echo 192.168.0.12 > remote_ip
# set local network device name (find it trough ifconfig, examples: eth0, eno1, wlan0)
echo eth0 > dev_name
# find destination MAC address
arping $(cat remote_ip) -f | grep -o ..:..:..:..:..:.. > remote_mac

echo 1 > enabled
dmesg | grep netconsole

Show us if you get any errors while loading it manually
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Wed Jun 14, 2017 10:46 pm

The module is not found :/

Code: Select all
root@monkeydc2:/# sudo /etc/modules-load.d/modules.conf
sudo: /etc/modules-load.d/modules.conf: command not found


Code: Select all
root@monkeydc2:/# sudo /etc/modprobe.d/netconsole.conf
sudo: /etc/modprobe.d/netconsole.conf: command not found


Code: Select all
root@monkeydc2:~# sudo modprobe netconsole
modprobe: ERROR: could not insert 'netconsole': Operation not permitted
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Wed Jun 14, 2017 11:12 pm

Sorry, I didn't provide the complete commands:
Code: Select all
cat /etc/modules-load.d/modules.conf
cat /etc/modprobe.d/netconsole.conf
ls -l /lib/modules/3.14.79-113/kernel/drivers/net/netconsole.ko
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Wed Jun 14, 2017 11:54 pm

No problem !

Code: Select all
root@monkeydc2:~# cat /etc/modules-load.d/modules.conf
# /etc/modules: kernel modules to load at boot time.
# This file contains the names of kernel modules that should be loaded
# at boot time, one per line. Lines beginning with "#" are ignored.
netconsole


Code: Select all
root@monkeydc2:~# cat /etc/modprobe.d/netconsole.conf
options netconsole netconsole=192.168.0.11@6666/eth0,6666@192.168.0.12/b8:27:eb:b9:0d:f9


Code: Select all
root@monkeydc2:~# ls -l /lib/modules/3.14.79-113/kernel/drivers/net/netconsole.k
-rw-r--r-- 1 root root 22824 May 10 06:16 /lib/modules/3.14.79-113/kernel/drivers/net/netconsole.ko
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Thu Jun 15, 2017 12:01 am

Ok, now I've seen the problem. You have netconsole=192.168.0.11@6666/eth0 instead of netconsole=6666@192.168.0.11/eth0
Make the change, reboot, and recheck your logs.
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Thu Jun 15, 2017 12:38 am

Thank you very munch, it's perfect ! Thank you for your patience :)

I don't understand how i was able to invert the port number.
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Thu Jun 15, 2017 1:09 am

Now wait for the crash to reproduce...
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Wed Jun 21, 2017 3:00 am

Hello, for the moment no crash :)

I'll keep you informed
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Wed Jun 21, 2017 1:19 pm

Murphy's law :)
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Sun Jul 02, 2017 7:20 am

Hello,

My Odroid C2 has crashed but i have nothing in the netconsole log, i can just see reboot lines after crash :/
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Sun Jul 02, 2017 2:55 pm

Did it restart automatically? Also, when setting up netconsole, did you run dmesg -n 8? This sets kernel logging verbosity to a maximum (I think)
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Mon Jul 03, 2017 1:01 am

No restart automatically, i have restart by disconnecting and reconnecting the cable.
Where i setting up netconsole to run dmesg -n 8 ? In /etc/modproble.d/netconsole.conf file ?

Just before crash, in the syslog, i can see :

Code: Select all
Jul  1 23:15:02 monkeydc2 avahi-daemon[696]: Withdrawing address record for 192.168.0.11 on eth0.
Jul  1 23:15:02 monkeydc2 avahi-daemon[696]: Leaving mDNS multicast group on interface eth0.IPv4 with address 192.168.0.11.
Jul  1 23:15:02 monkeydc2 avahi-daemon[696]: Interface eth0.IPv4 no longer relevant for mDNS.
Jul  1 23:15:17 monkeydc2 nmbd[2132]: [2017/07/01 23:15:17.982122,  0] ../source3/nmbd/nmbd.c:362(reload_interfaces)
Jul  1 23:15:17 monkeydc2 nmbd[2132]:   reload_interfaces: No subnets to listen to. Waiting..
Jul  1 23:15:22 monkeydc2 whoopsie[789]: [23:15:22] Cannot reach: https://daisy.ubuntu.com
Jul  1 23:15:22 monkeydc2 whoopsie[789]: [23:15:22] offline
Jul  1 23:16:32 monkeydc2 kernel: [611534.821578] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul  1 23:16:32 monkeydc2 rsyslogd-2007: action 'action 10' suspended, next retry is Sat Jul  1 23:18:02 2017 [v8.16.0 try http://www.rsyslog.com/e/2007 ]
Jul  1 23:17:01 monkeydc2 CRON[14700]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Jul  1 23:18:37 monkeydc2 kernel: [611660.260827] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul  1 23:18:37 monkeydc2 rsyslogd-2007: action 'action 10' suspended, next retry is Sat Jul  1 23:20:07 2017 [v8.16.0 try http://www.rsyslog.com/e/2007 ]
Jul  1 23:20:01 monkeydc2 CRON[14929]: (root) CMD (/home/antho/Mes_scripts/SERVEUR--Verification_status_service.sh fail2ban)
Jul  1 23:20:43 monkeydc2 kernel: [611785.700029] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul  1 23:20:43 monkeydc2 rsyslogd-2007: action 'action 10' suspended, next retry is Sat Jul  1 23:22:13 2017 [v8.16.0 try http://www.rsyslog.com/e/2007 ]
Jul  1 23:22:48 monkeydc2 kernel: [611911.139238] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul  1 23:22:48 monkeydc2 rsyslogd-2007: action 'action 10' suspended, next retry is Sat Jul  1 23:24:18 2017 [v8.16.0 try http://www.rsyslog.com/e/2007 ]
Feb 11 17:28:29 monkeydc2 rsyslogd: [origin software="rsyslogd" swVersion="8.16.0" x-pid="664" x-info="http://www.rsyslog.com"] start
Feb 11 17:28:29 monkeydc2 systemd-modules-load[236]: Failed to find module 'lp'
Feb 11 17:28:29 monkeydc2 systemd-modules-load[236]: Failed to find module 'ppdev'
Feb 11 17:28:29 monkeydc2 systemd-modules-load[236]: Failed to find module 'parport_pc'


Thank you
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Mon Jul 03, 2017 1:15 am

You can add the dmesg line in /etc/rc.local
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Mon Jul 03, 2017 2:33 am

Ok, i have add the line to /etc/rc.local file + reboot server :

Code: Select all
#!/bin/sh -e
#
# rc.local
#
# This script is executed at the end of each multiuser runlevel.
# Make sure that the script will "" on success or any other
# value on error.
#
# In order to enable or disable this script just change the execution
# bits.
#
# By default this script does nothing.



if [ -f /aafirstboot ]; then /aafirstboot start ; fi

sysctl -w net.core.somaxconn=65535

dmesg -n 8

exit 0

LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Mon Jul 03, 2017 10:49 pm

My Odroid C2 turn with eMMC module and I would like to test my module with a utility under Ubuntu.

What utility to use to test eMMC sector ?

Thank you
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Tue Jul 04, 2017 2:35 am

Do you want to check the filesystem? Then run fsck /dev/sdX1; fsck /dev/sdX2
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Tue Jul 04, 2017 3:11 pm

I want to check eMMC hardware.
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Tue Jul 04, 2017 4:49 pm

Not sure how you can do that, since by default the eMMC controller hides and often changes the internal blocks around. You could try writing a big data file on the eMMC to fill most of the space, and then calculating the checksum of the file on the eMMC and comparing it with the original checksum. Maybe @odroid knows of a different way of testing.
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby odroid » Tue Jul 04, 2017 6:57 pm

I have no idea other than that.
User avatar
odroid
Site Admin
 
Posts: 23623
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Thu Jul 13, 2017 12:40 am

Hi,

I have wrote a big file (20Gb) and compared the original checksum : It's OK

Since 10 days, I do not have a crash.

I don't understand ^^
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Mon Jul 17, 2017 5:52 pm

Hi,

My Odroid have crashed this morning (08:27:24) :/ And when i turn on my TV, the screen is black and my Odroid C2 do not respond.

The netconsole log continue to be feeded on my Raspberry Pi :

Last lines :

Code: Select all

Jul 17 08:21:08 192.168.0.11 [372899.710081] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:21:18 192.168.0.11 [372909.548814] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:23:13 192.168.0.11 [373025.149429] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:23:14 192.168.0.11 [373025.866707] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:25:19 192.168.0.11 [373150.588743] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:25:24 192.168.0.11 [373155.384434] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:27:24 192.168.0.11 [373276.028074] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:27:31 192.168.0.11 [373282.662196] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:29:30 192.168.0.11 [373401.467389] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:29:37 192.168.0.11 [373408.740023] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:31:35 192.168.0.11 [373526.906703] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:31:36 192.168.0.11 [373528.257857] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:33:41 192.168.0.11 [373652.346011] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:33:45 192.168.0.11 [373657.215542] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:35:46 192.168.0.11 [373777.785284] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:35:54 192.168.0.11 [373786.333254] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:37:51 192.168.0.11 [373903.224588] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:37:52 192.168.0.11 [373903.491213] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:39:57 192.168.0.11 [374028.663862] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:39:58 192.168.0.11 [374029.942095] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:d8:cb:8a:9a:b2:78:08:00 SRC=192.168.0.14 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0x00 TTL=1 ID=30703 PROTO=2
Jul 17 08:42:02 192.168.0.11 [374154.103121] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:42:04 192.168.0.11 [374155.927010] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:d8:cb:8a:9a:b2:78:08:00 SRC=192.168.0.14 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0x00 TTL=1 ID=30705 PROTO=2
Jul 17 08:44:08 192.168.0.11 [374279.542343] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:44:11 192.168.0.11 [374282.884777] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:46:13 192.168.0.11 [374404.981604] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:46:14 192.168.0.11 [374405.416799] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:d8:cb:8a:9a:b2:78:08:00 SRC=192.168.0.14 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0x00 TTL=1 ID=30718 PROTO=2
Jul 17 08:46:43 192.168.0.11 [374434.799043] hdmitx: system: irq 80000004
Jul 17 08:46:43 192.168.0.11 [374434.832893] hdmitx: system: irq 80000002
Jul 17 08:46:43 192.168.0.11 [374434.850938] hdmitx: system: irq 80000004
Jul 17 08:46:43 192.168.0.11 [374434.878058] hdmitx: system: irq 80000002
Jul 17 08:46:43 192.168.0.11 [374434.948834] hdmitx: system: irq 80000004
Jul 17 08:46:43 192.168.0.11 [374434.972370] hdmitx: system: irq 80000002
Jul 17 08:46:43 192.168.0.11 [374435.001757] hdmitx: system: irq 80000004
Jul 17 08:46:46 192.168.0.11 [374438.027654] hdmitx: system: irq 80000002
Jul 17 08:46:49 192.168.0.11 [374440.348560] hdmitx: system: irq 80000004
Jul 17 08:46:49 192.168.0.11 [374441.088174] hdmitx: system: irq 80000002
Jul 17 08:47:13 192.168.0.11 [374464.914089] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:d8:cb:8a:9a:b2:78:08:00 SRC=192.168.0.14 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0x00 TTL=1 ID=30723 PROTO=2
Jul 17 08:47:14 192.168.0.11 [374465.414358] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:d8:cb:8a:9a:b2:78:08:00 SRC=192.168.0.14 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0x00 TTL=1 ID=30726 PROTO=2
Jul 17 08:48:19 192.168.0.11 [374530.420799] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:48:24 192.168.0.11 [374535.440451] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2




The last lines on "syslog" (on my Odroid C2) :

Code: Select all

Jul 17 08:26:58 ODROID_C2 dovecot: lmtp(12843): Disconnect from local: Successful quit
Jul 17 08:26:58 ODROID_C2 postfix/qmgr[2305]: 2C9D0883E8: removed
Jul 17 08:27:00 ODROID_C2 postfix/pickup[11794]: A1EB4883FB: uid=0 from=<fail2ban@mydomain.tld>
Jul 17 08:27:00 ODROID_C2 postfix/cleanup[12840]: A1EB4883FB: message-id=<20170717062700.A1EB4883FB@ODROID_C2.mydomain.tld>
Jul 17 08:27:00 ODROID_C2 opendkim[1091]: A1EB4883FB: DKIM-Signature field added (s=mail, d=mydomain.tld)
Jul 17 08:27:00 ODROID_C2 postfix/qmgr[2305]: A1EB4883FB: from=<fail2ban@mydomain.tld>, size=2944, nrcpt=1 (queue active)
Jul 17 08:27:00 ODROID_C2 dovecot: lmtp(12843): Connect from local
Jul 17 08:27:00 ODROID_C2 dovecot: lmtp(luffyyfful@mydomain.tld): 1c15ELJYbFkrMgAAXyk3Dg: sieve: msgid=<20170717062700.A1EB4883FB@ODROID_C2.mydomain.tld>: stored mail into mailbox 'Fail2ban'
Jul 17 08:27:00 ODROID_C2 postfix/lmtp[12842]: A1EB4883FB: to=<luffyyfful@mydomain.tld>, relay=ODROID_C2.mydomain.tld[private/dovecot-lmtp], delay=0.09, delays=0.07/0/0/0.01, dsn=2.0.0, status=sent (250 2.0.0 <luffyyfful@mydomain.tld> 1c15ELJYbFkrMgAAXyk3Dg Saved)
Jul 17 08:27:00 ODROID_C2 dovecot: lmtp(12843): Disconnect from local: Successful quit
Jul 17 08:27:00 ODROID_C2 postfix/qmgr[2305]: A1EB4883FB: removed
Jul 17 08:27:05 ODROID_C2 dovecot: imap(luffyyfful@mydomain.tld): Connection closed in=1015 out=6031
Jul 17 08:27:18 ODROID_C2 kernel: [373276.028074] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:01:10:da:43:c9:43:d9:08:00 SRC=0.0.0.0 DST=224.0.0.1 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Jul 17 08:27:24 ODROID_C2 kernel: [373282.662196] [UFW BLOCK] IN=eth0 OUT= MAC=01:00:5e:00:00:fb:b8:27:eb:b9:0d:f9:08:00 SRC=192.168.0.12 DST=224.0.0.251 LEN=32 TOS=0x00 PREC=0xC0 TTL=1 ID=0 DF PROTO=2
Feb 11 17:28:30 ODROID_C2 rsyslogd: [origin software="rsyslogd" swVersion="8.16.0" x-pid="763" x-info="http://www.rsyslog.com"] start
Feb 11 17:28:30 ODROID_C2 rsyslogd-2222: command 'KLogPermitNonKernelFacility' is currently not permitted - did you already set it via a RainerScript command (v6+ config)? [v8.16.0 try http://www.rsyslog.com/e/2222 ]
Feb 11 17:28:30 ODROID_C2 rsyslogd: rsyslogd's groupid changed to 110
Feb 11 17:28:30 ODROID_C2 rsyslogd: rsyslogd's userid changed to 106
Feb 11 17:28:30 ODROID_C2 rsyslogd-2039: Could not open output pipe '/dev/xconsole':: No such file or directory [v8.16.0 try http://www.rsyslog.com/e/2039 ]
Feb 11 17:28:30 ODROID_C2 rsyslogd-2007: action 'action 10' suspended, next retry is Thu Feb 11 17:29:00 2016 [v8.16.0 try http://www.rsyslog.com/e/2007 ]
Feb 11 17:28:30 ODROID_C2 systemd-modules-load[255]: Failed to find module 'lp'
Feb 11 17:28:30 ODROID_C2 systemd-modules-load[255]: Failed to find module 'ppdev'
Feb 11 17:28:30 ODROID_C2 systemd-modules-load[255]: Failed to find module 'parport_pc'
Feb 11 17:28:30 ODROID_C2 ureadahead[224]: ureadahead: Error while tracing: No such file or directory
Feb 11 17:28:30 ODROID_C2 ureadahead[224]: Counted 4 CPUs




I think I'll try to install my system on a microSD instead of the eMMC.
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby odroid » Mon Jul 17, 2017 6:58 pm

I couldn't find any clue in your logs.

We've run a C2 to see the stability and its uptime is around 20 days with an 8GB eMMC.
It keeps showing a Youtube video on the Chromium browser. Ethernet is connected.
Click this image to check the uptime.
Screenshot at 2017-07-17 05_44_36.png
Screenshot at 2017-07-17 05_44_36.png (553.37 KiB) Viewed 151 times


Does your application use the heavy network traffic? or heavy CPU usage? or heavy RAM usage? or heavy file IO on eMMC?
I want to try a similar condition on the C2.
User avatar
odroid
Site Admin
 
Posts: 23623
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Mon Jul 17, 2017 10:20 pm

My Odroid have crashed this morning at 08:27:24.

Attached monitoring :

2017.07.17.png
2017.07.17.png (456 KiB) Viewed 136 times
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby odroid » Tue Jul 18, 2017 12:14 pm

Thank you for the graphs. But I can't find any clue yet.
Let's try two more things.
1. Keep tracking the CPU temperature via /sys/devices/virtual/thermal/thermal_zone0/temp
2. Measure the voltage on 5Volt rail on the 40pin header with a DMM. It must stable at 4.8~5.2Volt.
Image
User avatar
odroid
Site Admin
 
Posts: 23623
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: Odroid C2 Crash and no error log

Unread postby LuffyyffuL » Wed Jul 19, 2017 5:17 am

On my Odroid I have 2,1V and on my Raspberry Pi 3 I have 5,2V (GPIO 2 and 6)

I have use the same power supply for my tests.

I use :

https://www.amazon.fr/NorthPada-Raspber ... pi+3&psc=1

I think I touched GPIO when I did my measurements. Now the ODROID do not start and ALIVE LED is off :/
LuffyyffuL
 
Posts: 24
Joined: Sat Jul 11, 2015 2:38 am
languages_spoken: Français
ODROIDs: ODROID C1

Re: Odroid C2 Crash and no error log

Unread postby odroid » Wed Jul 19, 2017 11:57 am

Oops~ I think you fried your C2 probably if you shorted the power rails.
Remove all the USB devices and check the blue LED status again.

Note that C2 needs slightly more power than RPi3 because of faster CPU/GPU/DRAM.
So the micro-USB port couldn't be enough to supply the power to C2 and we recommended to use the DC barrel jack instead of the micro-USB.
User avatar
odroid
Site Admin
 
Posts: 23623
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID

Re: Odroid C2 Crash and no error log

Unread postby jiffysound » Wed Jul 19, 2017 7:57 pm

mad_ady wrote:Hmm, your output is very puzzling. You should check the dmesg command output.

In syslog I'm getting output like this:
Code: Select all
Feb 11 18:28:05 kbd systemd-modules-load[205]: Inserted module 'netconsole'
...
Feb 11 18:28:05 kbd kernel: [   11.196190] netpoll: netconsole: local port 6666
Feb 11 18:28:05 kbd kernel: [   11.196195] netpoll: netconsole: local IPv4 address 192.168.228.10
Feb 11 18:28:05 kbd kernel: [   11.196196] netpoll: netconsole: interface 'eth0'
Feb 11 18:28:05 kbd kernel: [   11.196198] netpoll: netconsole: remote port 6666
Feb 11 18:28:05 kbd kernel: [   11.196200] netpoll: netconsole: remote IPv4 address 192.168.228.1
Feb 11 18:28:05 kbd kernel: [   11.196201] netpoll: netconsole: remote ethernet address 44:8a:5b:56:37:5a
Feb 11 18:28:05 kbd kernel: [   11.196206] netpoll: netconsole: device eth0 not up yet, forcing it
Feb 11 18:28:05 kbd kernel: [   11.359926] netpoll: netconsole: carrier detect appears untrustworthy, waiting 4 seconds
Feb 11 18:28:05 kbd kernel: [   15.368838] console [netcon0] enabled
Feb 11 18:28:05 kbd kernel: [   15.373624] netconsole: network logging started



I'm not sure why it says failed to insert netconsole - operation not permitted. What kernel version are you running (uname -a)? Netconsole has been enabled only recently, so make sure you update your kernel (maybe this fixes the original stability issue as well). :)

Oh man, I am getting the same thing in my syslog when my odroid-c2 crashes, in fact I made a thread just about this issue..sort of viewtopic.php?f=136&t=27708#p196966
My syslog also logs this *Feb 11* when it crashes, I am using the power supply that came with the odroid-c2 (5V/2A PSU with DC barrel jack ) and with a eMMc card as well.
A snippet from my log that is created right before or right after the crash, not sure which. :shock:
Code: Select all
Feb 11 17:28:07 odroid64 kernel: [   17.553803] aml_set_spdif_clk rate
Feb 11 17:28:07 odroid64 kernel: [   17.553809] divider=22,frac=13030400,SDMval=2364
Feb 11 17:28:07 odroid64 kernel: [   17.553817] set normal 512 fs /4 fs
Feb 11 17:28:07 odroid64 kernel: [   17.553824] iec958 mode PCM16
Feb 11 17:28:07 odroid64 kernel: [   17.553833] IEC958 16bi

Notice the time stamps, they are practically 1 hour apart. This syslog spits out this info when my odroid crashes, and when I restart. Could our issue be related ? Sorry for butting into your thread, but the time stamps on both our logs caught my eye.
jiffysound
 
Posts: 33
Joined: Wed Sep 07, 2016 9:49 pm
languages_spoken: english
ODROIDs: odroid c2

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Wed Jul 19, 2017 8:19 pm

The exact timestamp will be somewhere around Feb 11 2016 - which is the default time used by the Odroid when booting up without a rtc clock. This usually gets corrected once ntp or systemd-timesyncd have started, but the boot messages generally have this time stamp. The one hour difference may be due to a different timezone that you're in.

@jiffysound - you should somehow see if your system fully booted before crashing. Something like adding this to /etc/rc.local:
Code: Select all
dmesg -n 8
echo "/etc/rc.local has executed" > /dev/kmsg


But yes, I've seen the C2 crash without any netconsole output, but also I've seen it crash and spit out lots of messages over netconsole. I guess it depends on the type of the problem. If it brings down the kernel completely or the network card, netconsole might not work. So, it's best effort and a serial console might have better output.
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2

Re: Odroid C2 Crash and no error log

Unread postby jiffysound » Wed Jul 19, 2017 9:30 pm

@ mad_ady
Where in /etc/rc.local would I input that code? My current rc.local
Code: Select all
#!/bin/sh -e
#
# rc.local
#
# This script is executed at the end of each multiuser runlevel.
# Make sure that the script will "" on success or any other
# value on error.
#
# In order to enable or disable this script just change the execution
# bits.
#
# By default this script does nothing.


if [ -f /aafirstboot ]; then /aafirstboot start ; fi


if [ -f /aafirstboot ]; then /aafirstboot start ; fi


if [ -f /aafirstboot ]; then /aafirstboot start ; fi


if [ -f /aafirstboot ]; then /aafirstboot start ; fi


if [ -f /aafirstboot ]; then /aafirstboot start ; fi


if [ -f /aafirstboot ]; then /aafirstboot start ; fi

echo none > /sys/class/leds/blue\:heartbeat/trigger
rfkill block bluetooth
exit 0

Would it be at the very end after rfkill block bluethtooth and before exit 0? Something like this
Code: Select all
rfkill block bluetooth
dmesg -n 8
echo "/etc/rc.local has executed" > /dev/kmsg
exit 0
And could this cause any booting issues?
jiffysound
 
Posts: 33
Joined: Wed Sep 07, 2016 9:49 pm
languages_spoken: english
ODROIDs: odroid c2

Re: Odroid C2 Crash and no error log

Unread postby mad_ady » Wed Jul 19, 2017 9:41 pm

Yes, that would be a good place to put it.
The problem with rc.local is that it stops executing once it hits the first error (e.g. first command that doesn't return 0). You will not get stuck at boot by adding things to rc.local, but based on what is executing in it - your command may not execute because of previous errors.
User avatar
mad_ady
 
Posts: 2027
Joined: Wed Jul 15, 2015 5:00 pm
Location: Bucharest, Romania
languages_spoken: english
ODROIDs: XU4, C1+, C2


Return to Ubuntu

Who is online

Users browsing this forum: No registered users and 5 guests