Ubuntu 18.04.3 upgrade crashes XU4

Post Reply
Charles R
Posts: 13
Joined: Sun Aug 21, 2016 11:31 pm
languages_spoken: english
ODROIDs: C2 | XU4
Has thanked: 1 time
Been thanked: 1 time
Contact:

Ubuntu 18.04.3 upgrade crashes XU4

Unread post by Charles R » Fri Aug 30, 2019 10:31 pm

I have been running 18.04 on my XU4 since close to release without issue. Yesterday I did an apt upgrade (I believe) without a reboot and installed pihole. Afterwards everything was fine and pihole was running great. That is until I rebooted. Each time it would freeze at random crng init done and I could do a crtl-alt-del and it would reboot although again freeze at the same spot.

Eventually I said what the heck I'll start from scratch and used Etcher to create the install media. 18.04 (latest download) installed fine and I could reboot without issue. That is until I did an upgrade and then it would freeze as above. First I tried Minimal and then Mate with the same result. After a couple of times (each) I tried 16.04 and it installed fine and upgraded without issue. Leaving me to think it's not an hardware issue rather something in the 18.04.3 upgrade?
These users thanked the author Charles R for the post:
fse (Fri Aug 30, 2019 11:54 pm)

fse
Posts: 49
Joined: Tue Feb 03, 2015 8:40 pm
languages_spoken: english
ODROIDs: XU4, C1
Has thanked: 2 times
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by fse » Fri Aug 30, 2019 11:49 pm

Identical issue here. After update (also kernel) freeze at the same spot :-(

Matioupi
Posts: 57
Joined: Fri Aug 05, 2016 3:56 pm
languages_spoken: english
Has thanked: 0
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by Matioupi » Sat Aug 31, 2019 12:10 am

Same issue here, did not saw your post so I openned a new redundant one...

Charles R
Posts: 13
Joined: Sun Aug 21, 2016 11:31 pm
languages_spoken: english
ODROIDs: C2 | XU4
Has thanked: 1 time
Been thanked: 1 time
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by Charles R » Sat Aug 31, 2019 12:20 am

Matioupi wrote:
Sat Aug 31, 2019 12:10 am
Same issue here, did not saw your post so I openned a new redundant one...
Just glad I'm not the only one!

User avatar
mad_ady
Posts: 6680
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1, H2, N2
Location: Bucharest, Romania
Has thanked: 194 times
Been thanked: 148 times
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by mad_ady » Sat Aug 31, 2019 1:00 am

Are you guys running on emmc? If yes, which one? I've seen a xu4 boot its kernel, but the kernel could not see the rootfs on emmc (on a friend's xu4). It gets stuck on initramfs (over serial). Initramfs didn't see a /dev/mmcblk0. Here is some output:

Code: Select all

Exynos5422 # fatls mmc 0
    63517   exynos5422-odroidxu3.dtb 
  8314254   uinitrd 
  5689408   zimage 
     9654   boot.ini 
     9650   boot.ini.old 
      753   boot.ini.default 
    62462   exynos5422-odroidxu3-lite.dtb 
    63484   exynos5422-odroidxu4.dtb 
    56387   exynos5422-odroidhc1.dtb 
    63628   exynos5422-odroidxu4-kvm.dtb 

10 file(s), 0 dir(s)
Exynos5422 # ext4ls mmc 0:2
<DIR>       4096 .
<DIR>       4096 ..
<DIR>      16384 lost+found
<DIR>       4096 tmp
<DIR>       4096 proc
<DIR>       4096 srv
<DIR>       4096 mnt
        47054848 core
<DIR>       4096 lib
<DIR>       4096 snap
<DIR>       4096 bin
<DIR>       4096 var
<DIR>       4096 home
<DIR>       4096 opt
<DIR>      12288 sbin
<DIR>       4096 root
<DIR>      16384 etc
<DIR>       4096 usr
<DIR>       4096 dev
<DIR>       4096 run
<DIR>       4096 boot
<DIR>       4096 sys
<DIR>       4096 media
             932 webmin-setup.out
But mmcblk0 is not seen once the kernel boots..,

fse
Posts: 49
Joined: Tue Feb 03, 2015 8:40 pm
languages_spoken: english
ODROIDs: XU4, C1
Has thanked: 2 times
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by fse » Sat Aug 31, 2019 1:11 am

i use emmc and that looks like it is the problem

Matioupi
Posts: 57
Joined: Fri Aug 05, 2016 3:56 pm
languages_spoken: english
Has thanked: 0
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by Matioupi » Sat Aug 31, 2019 1:17 am

I use eMMC too, and I confirm that amongst all package upgrades, the issue comes from upgrading linux-odoird-5422 package

Matioupi
Posts: 57
Joined: Fri Aug 05, 2016 3:56 pm
languages_spoken: english
Has thanked: 0
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by Matioupi » Sat Aug 31, 2019 1:18 am

and my eMMC is v0.3 16G

fse
Posts: 49
Joined: Tue Feb 03, 2015 8:40 pm
languages_spoken: english
ODROIDs: XU4, C1
Has thanked: 2 times
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by fse » Sat Aug 31, 2019 1:30 am

linux-odoird-5422 looks like the issue, is there an easy way to downgrade that package? (like boot from sd, chroot, downgrade?)

User avatar
mad_ady
Posts: 6680
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1, H2, N2
Location: Bucharest, Romania
Has thanked: 194 times
Been thanked: 148 times
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by mad_ady » Sat Aug 31, 2019 1:37 am

My friend told me his emmc is red. My orange one doesn't show issues, so it must be emmc specific.

fse
Posts: 49
Joined: Tue Feb 03, 2015 8:40 pm
languages_spoken: english
ODROIDs: XU4, C1
Has thanked: 2 times
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by fse » Sat Aug 31, 2019 1:42 am

my eMMC is also v0.3 32G and its broken

Charles R
Posts: 13
Joined: Sun Aug 21, 2016 11:31 pm
languages_spoken: english
ODROIDs: C2 | XU4
Has thanked: 1 time
Been thanked: 1 time
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by Charles R » Sat Aug 31, 2019 1:58 am

fse wrote:
Sat Aug 31, 2019 1:42 am
my eMMC is also v0.3 32G and its broken
Mine is red v0.3 32GB too - broken.

fse
Posts: 49
Joined: Tue Feb 03, 2015 8:40 pm
languages_spoken: english
ODROIDs: XU4, C1
Has thanked: 2 times
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by fse » Sat Aug 31, 2019 2:12 am

i booted from sdcard and its boots into the emmc env directly (odd) but there is no downgrade package in http://deb.odroid.in/5422-s/pool/main/l ... roid-5422/ so i cant test it

User avatar
mad_ady
Posts: 6680
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1, H2, N2
Location: Bucharest, Romania
Has thanked: 194 times
Been thanked: 148 times
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by mad_ady » Sat Aug 31, 2019 2:51 am

Here's an older kernel that should work:
https://www.mediafire.com/file/2effz0hi ... ar.gz/file

Be warned about trusting random files from strangers on the internet! :)

Unpack it and copy media/boot/* to your emmc vfat partition. Copy the tar.gz there as well (compressed). Boot from emmc - it should boot, but you'll be missing the kernel modules. Extract them from the archive and copy them to /lib/modules and reboot again.

That should fix the issue till @mdrjr or @tobetter revert the change that broke some emmcs.
These users thanked the author mad_ady for the post (total 2):
fse (Sat Aug 31, 2019 6:51 pm) • aol (Mon Sep 02, 2019 8:17 pm)

mdrjr
Site Admin
Posts: 11726
Joined: Fri Feb 22, 2013 11:34 pm
languages_spoken: english, portuguese
ODROIDs: -
Location: Brazil
Has thanked: 1 time
Been thanked: 13 times
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by mdrjr » Sat Aug 31, 2019 1:00 pm

Hello people :)

I've removed the upgrade package for now..
I"m investigating the issue.

mdrjr
Site Admin
Posts: 11726
Joined: Fri Feb 22, 2013 11:34 pm
languages_spoken: english, portuguese
ODROIDs: -
Location: Brazil
Has thanked: 1 time
Been thanked: 13 times
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by mdrjr » Sat Aug 31, 2019 2:17 pm

I've just tested with a green eMMC (very old..) no issues...
Will test others and try to find the issue.. Will test red in a few minutes :)

hkmang
Posts: 3
Joined: Sat Aug 31, 2019 1:16 am
languages_spoken: english
ODROIDs: XU4
Has thanked: 1 time
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by hkmang » Sat Aug 31, 2019 4:06 pm

Yes! I have the same issue. But my eMMC is orange one (128 GB)

fse
Posts: 49
Joined: Tue Feb 03, 2015 8:40 pm
languages_spoken: english
ODROIDs: XU4, C1
Has thanked: 2 times
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by fse » Sat Aug 31, 2019 4:40 pm

mad_ady wrote:
Sat Aug 31, 2019 2:51 am
Be warned about trusting random files from strangers on the internet! :)
Rofl, odroid is not openhardware so the chain of trust never hit the ground and got properly rooted, ergo your contribution is extremely welcome, thank you :!:

aol
Posts: 4
Joined: Tue May 17, 2016 2:28 am
languages_spoken: english
ODROIDs: XU4
Has thanked: 2 times
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by aol » Sat Aug 31, 2019 5:20 pm

mdrjr wrote:
Sat Aug 31, 2019 2:17 pm
I've just tested with a green eMMC (very old..) no issues...
Will test others and try to find the issue.. Will test red in a few minutes :)
Hello

Mine is also a 64GB green one but it doesn't work. I thought it was red, that is why Mad_Ady said his friends one was red.
Thanks Mad_Ady for helping

fse
Posts: 49
Joined: Tue Feb 03, 2015 8:40 pm
languages_spoken: english
ODROIDs: XU4, C1
Has thanked: 2 times
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by fse » Sat Aug 31, 2019 6:50 pm

mad_ady wrote:
Sat Aug 31, 2019 2:51 am
That should fix the issue till @mdrjr or @tobetter revert the change that broke some emmcs.
Thanks, that fixed it :-D

Matioupi
Posts: 57
Joined: Fri Aug 05, 2016 3:56 pm
languages_spoken: english
Has thanked: 0
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by Matioupi » Sat Aug 31, 2019 9:52 pm

mdrjr wrote:
Sat Aug 31, 2019 2:17 pm
I've just tested with a green eMMC (very old..) no issues...
Will test others and try to find the issue.. Will test red in a few minutes :)
Hello, so were you able to reproduce the issue with a v0.3 eMMC ?

aol
Posts: 4
Joined: Tue May 17, 2016 2:28 am
languages_spoken: english
ODROIDs: XU4
Has thanked: 2 times
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by aol » Sun Sep 01, 2019 1:18 am

aol wrote:
Sat Aug 31, 2019 5:20 pm
mdrjr wrote:
Sat Aug 31, 2019 2:17 pm
I've just tested with a green eMMC (very old..) no issues...
Will test others and try to find the issue.. Will test red in a few minutes :)
Hello

Mine is also a 64GB green one but it doesn't work. I thought it was red, that is why Mad_Ady said his friends one was red.
Thanks Mad_Ady for helping
@mdrjr I have a green 64GB emmc on an xu4 and a 32 GB SD card in a hc1. The hc1 was having other issues while upgrading, but after the update was completed ok, I took the SD out and inserted on xu4, booting from it, but left also the emmc connected. There wasn't any /dev/mmcblk0* after booting the new kernel, even from sd card. So you just boot the new kernel from any sd, just changing the emmc card, I think there is enough to reproduce the issue .
My xu4 board is pretty old, 2 or 3 years old, i don't know if it is relevant

mdrjr
Site Admin
Posts: 11726
Joined: Fri Feb 22, 2013 11:34 pm
languages_spoken: english, portuguese
ODROIDs: -
Location: Brazil
Has thanked: 1 time
Been thanked: 13 times
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by mdrjr » Sun Sep 01, 2019 10:03 am

Hi @aol, I could reprocude the issue already and happens only on eMMC, I'm looking on why it happens now ... Something from upstream kernel broke it.. I didn't catch the issue because the board that verifies a kernel build runs from a microsd !

mdrjr
Site Admin
Posts: 11726
Joined: Fri Feb 22, 2013 11:34 pm
languages_spoken: english, portuguese
ODROIDs: -
Location: Brazil
Has thanked: 1 time
Been thanked: 13 times
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by mdrjr » Sun Sep 01, 2019 11:00 am

Update:
I've found the issue a proper update is being released and I'll post instructions on how to recover from the bad update in a couple hours.

mdrjr
Site Admin
Posts: 11726
Joined: Fri Feb 22, 2013 11:34 pm
languages_spoken: english, portuguese
ODROIDs: -
Location: Brazil
Has thanked: 1 time
Been thanked: 13 times
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by mdrjr » Sun Sep 01, 2019 11:08 am

How to recovery from the bad update.

1. Download https://deb.odroid.in/xu4/zImage
2. Copy zImage file to your eMMC fat partition (you'll replace the file there)

You'll need to connect the eMMC to your PC to do this.

oversim
Posts: 51
Joined: Wed Feb 18, 2015 7:59 pm
languages_spoken: english
ODROIDs: C1 , XU4
Has thanked: 0
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by oversim » Sun Sep 01, 2019 8:50 pm

mdrjr wrote:
Sun Sep 01, 2019 11:00 am
Update:
I've found the issue a proper update is being released and I'll post instructions on how to recover from the bad update in a couple hours.
My XU4 found a 5422 again this morning. Is it safe now?
Two days ago was in issue but I recovered it downgrading the kernel using a file found in this thread (thanks!)

oversim
Posts: 51
Joined: Wed Feb 18, 2015 7:59 pm
languages_spoken: english
ODROIDs: C1 , XU4
Has thanked: 0
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by oversim » Sun Sep 01, 2019 8:57 pm

aol wrote:
Sun Sep 01, 2019 1:18 am
My xu4 board is pretty old, 2 or 3 years old, i don't know if it is relevant
Same mine. And I had this issue with a 32 emmc card

aol
Posts: 4
Joined: Tue May 17, 2016 2:28 am
languages_spoken: english
ODROIDs: XU4
Has thanked: 2 times
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by aol » Sun Sep 01, 2019 10:02 pm

mdrjr wrote:
Sun Sep 01, 2019 11:00 am
Update:
I've found the issue a proper update is being released and I'll post instructions on how to recover from the bad update in a couple hours.
It worked for me. And also the new version. Thank you mdrjr

Matioupi
Posts: 57
Joined: Fri Aug 05, 2016 3:56 pm
languages_spoken: english
Has thanked: 0
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by Matioupi » Mon Sep 02, 2019 12:47 am

I just compiled the kernel and I confirm this commit solves the issue : https://github.com/hardkernel/linux/com ... d84c918a7e
Thank to odroid team for reactivity !

mdrjr
Site Admin
Posts: 11726
Joined: Fri Feb 22, 2013 11:34 pm
languages_spoken: english, portuguese
ODROIDs: -
Location: Brazil
Has thanked: 1 time
Been thanked: 13 times
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by mdrjr » Mon Sep 02, 2019 2:39 am

Hi Guys, updating is safe now :)
These users thanked the author mdrjr for the post:
Charles R (Mon Sep 02, 2019 12:15 pm)

Charles R
Posts: 13
Joined: Sun Aug 21, 2016 11:31 pm
languages_spoken: english
ODROIDs: C2 | XU4
Has thanked: 1 time
Been thanked: 1 time
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by Charles R » Mon Sep 02, 2019 12:14 pm

mdrjr wrote:
Mon Sep 02, 2019 2:39 am
Hi Guys, updating is safe now :)
Appreciate the quick reaction to the issue. Was going to pickup a new Raspberry Pi however with this service I might grab another ODROID...

oversim
Posts: 51
Joined: Wed Feb 18, 2015 7:59 pm
languages_spoken: english
ODROIDs: C1 , XU4
Has thanked: 0
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by oversim » Mon Sep 02, 2019 1:25 pm

aol wrote:
Sun Sep 01, 2019 10:02 pm
It worked for me. And also the new version. Thank you mdrjr
+1!
Thanks again!

mdrjr
Site Admin
Posts: 11726
Joined: Fri Feb 22, 2013 11:34 pm
languages_spoken: english, portuguese
ODROIDs: -
Location: Brazil
Has thanked: 1 time
Been thanked: 13 times
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by mdrjr » Mon Sep 02, 2019 4:27 pm

Thanks for the understanding :)

I'm adding an extra test step before releases to ensure emmc function
These users thanked the author mdrjr for the post (total 2):
aol (Mon Sep 02, 2019 8:17 pm) • odroid (Tue Sep 03, 2019 9:29 am)

Charles R
Posts: 13
Joined: Sun Aug 21, 2016 11:31 pm
languages_spoken: english
ODROIDs: C2 | XU4
Has thanked: 1 time
Been thanked: 1 time
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by Charles R » Tue Sep 10, 2019 4:19 am

I ended up installing 16.04 and configuring it before the fix was released.Since I use it for serving media, backups and such being down wasn't too bad outside of losing the print server. I was going to stay at 16.04 and made a backup via Win32 Disk Imager (restored the backup to verify it works) however I ended up reinstalling 18.04 and configuring it... now I have a backup of both 16.04 and 18.04. I was going to configure dual boot with a SD card (SanDisk Extreme Pro) and boot off of the eMMC storage should the need arise but with the backups I think I'll pass. Anyway it just might be my imagination but even the fast SD card (up to 170MB/s) seemed much slower during installation and updating.

belegdol
Posts: 4
Joined: Sat Sep 07, 2019 2:44 am
languages_spoken: english
ODROIDs: hc1
Has thanked: 0
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by belegdol » Sun Sep 15, 2019 11:30 pm

I am not sure if this is related, but my HC1 failed to boot from SD card after I compiled the initial 4.14.141 kernel for armbian and did a forced cold boot (it did survive the normal reboot). I have described the symptoms here:
https://forum.armbian.com/topic/11451-o ... -not-boot/
Unpacking vmlinuz from the updated 4.14.141 deb made the board boot again. Please feel free to ignore if this is not related.

mdrjr
Site Admin
Posts: 11726
Joined: Fri Feb 22, 2013 11:34 pm
languages_spoken: english, portuguese
ODROIDs: -
Location: Brazil
Has thanked: 1 time
Been thanked: 13 times
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by mdrjr » Mon Sep 16, 2019 1:51 am

Thats not related if you build against our tree in the past couple days

belegdol
Posts: 4
Joined: Sat Sep 07, 2019 2:44 am
languages_spoken: english
ODROIDs: hc1
Has thanked: 0
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by belegdol » Mon Sep 16, 2019 2:04 am

mdrjr wrote:Thats not related if you build against our tree in the past couple days
I built the faulty build before your revert has landed, the vmlinuz fixing the issue was built after it.

Wysłane z mojego Nexus 9 przy użyciu Tapatalka


eluzerkharix
Posts: 2
Joined: Tue Oct 22, 2019 10:01 am
languages_spoken: english
Has thanked: 0
Been thanked: 0
Contact:

Re: Ubuntu 18.04.3 upgrade crashes XU4

Unread post by eluzerkharix » Tue Oct 22, 2019 10:06 am

Charles R wrote:
Fri Aug 30, 2019 10:31 pm
I have been running 18.04 on my XU4 since close to release without issue. Yesterday I did an apt upgrade (I believe) without a reboot and installed pihole. Afterwards everything was fine and pihole was running great. That is until I rebooted. Each time it would freeze at random crng init done and I could do a crtl-alt-del and it would reboot although again freeze at the same spot.
Speed Test Scrabble Word Finder Solitaire
Eventually I said what the heck I'll start from scratch and used Etcher to create the install media. 18.04 (latest download) installed fine and I could reboot without issue. That is until I did an upgrade and then it would freeze as above. First I tried Minimal and then Mate with the same result. After a couple of times (each) I tried 16.04 and it installed fine and upgraded without issue. Leaving me to think it's not an hardware issue rather something in the 18.04.3 upgrade?
is there an easy way to downgrade that package? (like boot from sd, chroot, downgrade?)

Post Reply

Return to “Ubuntu”

Who is online

Users browsing this forum: No registered users and 5 guests