emmc disk error

Post Reply
mbonamusa
Posts: 215
Joined: Mon Feb 25, 2013 9:08 pm
languages_spoken: catalan, spanish, english
ODROIDs: ODROID-X2, U2, U3, XU4, C1, C2
Has thanked: 0
Been thanked: 1 time
Contact:

emmc disk error

Post by mbonamusa »

In the last few days I've been finding that some C2 boards stop working after a few minuts of booring or after a one or two reboots.
I've connected UART-USB board and I've seen that always there are emmc disc errors like this:

Code: Select all

[    6.841467] systemd[1]: Starting Create list of required static device nodes for the current kernel...
[    6.855106] systemd[1]: Created slice system-serial\x2dgetty.slice.
[    6.866387] systemd[1]: Mounting Debug File System...
[    6.877266] systemd[1]: Mounting POSIX Message Queue File System...
[    6.889415] systemd[1]: Started Read required files in advance.
[    6.901075] systemd[1]: Mounting Huge Pages File System...
[    6.910569] systemd[1]: Reached target Remote File Systems.
[    6.921204] systemd[1]: Starting Remount Root and Kernel File Systems...
[    6.930060] EXT4-fs (mmcblk0p2): re-mounted. Opts: errors=remount-ro
[    6.938307] systemd[1]: Starting Nameserver information manager...
[    6.951418] systemd[1]: Mounted Debug File System.
[    6.960918] systemd[1]: Mounted POSIX Message Queue File System.
[    6.970498] systemd[1]: Mounted Huge Pages File System.
[    6.979985] systemd[1]: Started Journal Service.
[    7.054760] [aml_sd_emmc_irq] emmc: response ecc,vstat:0x2400,virqc:3fff

[    7.061460] aml_sd_emmc_data_thread 2155 emmc: cmd:18
[    7.070377] [aml_sd_emmc_irq] emmc: resp_timeout,vstat:0x2800,virqc:3fff

[    7.077515] aml_sd_emmc_data_thread : 2100
[    7.086427] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.118202] [aml_sd_emmc_irq] emmc: response ecc,vstat:0x2400,virqc:3fff
[    7.118202]
[    7.118203] aml_sd_emmc_data_thread 2155 emmc: cmd:18
[    7.118237] [aml_sd_emmc_irq] emmc: resp_timeout,vstat:0x2800,virqc:3fff
[    7.118237]
[    7.118237] aml_sd_emmc_data_thread : 2100
[    7.118269] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.165427] [aml_sd_emmc_irq] emmc: response ecc,vstat:0x2400,virqc:3fff
[    7.165427]
[    7.165427] aml_sd_emmc_data_thread 2155 emmc: cmd:18
[    7.165462] [aml_sd_emmc_irq] emmc: resp_timeout,vstat:0x2800,virqc:3fff
[    7.165462]
[    7.165462] aml_sd_emmc_data_thread : 2100
[    7.165509] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.179038] [aml_sd_emmc_irq] emmc: response ecc,vstat:0x2400,virqc:3fff
[    7.179038]
[    7.179038] aml_sd_emmc_data_thread 2155 emmc: cmd:18
[    7.179073] [aml_sd_emmc_irq] emmc: resp_timeout,vstat:0x2800,virqc:3fff
[    7.179073]
[    7.179074] aml_sd_emmc_data_thread : 2100
[    7.179101] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.520008] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.587073] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.596736] mmcblk0: response CRC error sending r/w cmd command, card status 0x900
[    7.605877] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.614791] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.622081] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.633353] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.640923] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.649085] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.656890] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.664420] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.672130] mmcblk0: response CRC error sending r/w cmd command, card status 0x400900
[    7.787676] end_request: I/O error, dev mmcblk0, sector 3194912
[    7.792148] end_request: I/O error, dev mmcblk0, sector 3194920
[    7.798634] end_request: I/O error, dev mmcblk0, sector 3194928
[    7.805193] end_request: I/O error, dev mmcblk0, sector 3194936
[    7.809753] end_request: I/O error, dev mmcblk0, sector 3194944
[    7.819040] end_request: I/O error, dev mmcblk0, sector 3194952
[    7.824838] end_request: I/O error, dev mmcblk0, sector 3194960
[    7.829024] end_request: I/O error, dev mmcblk0, sector 3194968
[    7.837669] end_request: I/O error, dev mmcblk0, sector 3194976
[    7.841547] end_request: I/O error, dev mmcblk0, sector 3194984
[   11.944666] mmcblk0: error -110 sending status command, retrying
[   11.949543] mmcblk0: error -110 sending status command, retrying
[   11.955899] mmcblk0: error -110 sending status command, aborting
If I rewrite the emmc disk, the problem appears again. If I change the disk the problem goes away, so it seems not a C2 board problem. It seems an emmc disks problem!
It happens in a 10% of emmc disks (I'm mounting hundreds of boards) and I'm very worried!

Do you have any information about this?

(I've attached the entire boot log)
Attachments
c2 emmc error.txt
(59.01 KiB) Downloaded 71 times

User avatar
tobetter
Posts: 5526
Joined: Mon Feb 25, 2013 10:55 am
languages_spoken: Korean, English
ODROIDs: X, X2, U2, U3, XU3, C1
Location: Paju, South Korea
Has thanked: 222 times
Been thanked: 649 times
Contact:

Re: emmc disk error

Post by tobetter »

Did you purchase from Hardkernel?
Can you please share the photo of bottom of the eMMC?
Which OS are you running with them?

mbonamusa
Posts: 215
Joined: Mon Feb 25, 2013 9:08 pm
languages_spoken: catalan, spanish, english
ODROIDs: ODROID-X2, U2, U3, XU4, C1, C2
Has thanked: 0
Been thanked: 1 time
Contact:

Re: emmc disk error

Post by mbonamusa »

Hello,

Yes! I always buy at hardkernel!

SO: I'm using my own image based on "ubuntu64-16.04lts-mate-odroid-c2-20161017.img". I simply added some packages to avoid to be installing them every time. (opencv, mysql, php, apache, etc)
I've been using this image during more than 1 year, flashing about 80 disks with any problem. But since my last purchases durant last month of odroid C2 + 8G emmc disk I've already flashed about 40 boards with 6 disks with this error. (above 10%).

I'm using the hardkernel USB3.0 eMMC Module Writer. I've made some tests with USB2.0 SDcard reader with the same result.
Attachments
c2 board.jpg
c2 board.jpg (458.29 KiB) Viewed 2208 times

User avatar
odroid
Site Admin
Posts: 34922
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English, Korean, Japanese
ODROIDs: ODROID
Has thanked: 957 times
Been thanked: 773 times
Contact:

Re: emmc disk error

Post by odroid »

You have to use a more recent Kernel 3.16.72-46 or the latest Ubuntu 18.04.3 image to fix the eMMC driver stability issue.
viewtopic.php?f=139&t=36509#p269771
https://wiki.odroid.com/odroid-c2/os_images/ubuntu/v3.1

mbonamusa
Posts: 215
Joined: Mon Feb 25, 2013 9:08 pm
languages_spoken: catalan, spanish, english
ODROIDs: ODROID-X2, U2, U3, XU4, C1, C2
Has thanked: 0
Been thanked: 1 time
Contact:

Re: emmc disk error

Post by mbonamusa »

I will try the image you suggest me, but can I use the minimal image version?
So the problem is not due to the emmc discs? In that case, if I record the disks with the image you suggest me will it work? or on the contrary the emmc disks that failed have been bad forever?

mad_ady
Posts: 8333
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, C4, N1, N2, H2, Go, Go Advance
Location: Bucharest, Romania
Has thanked: 574 times
Been thanked: 439 times
Contact:

Re: emmc disk error

Post by mad_ady »

It should work fine with the correct kernel version. There is no hardware damage.

mbonamusa
Posts: 215
Joined: Mon Feb 25, 2013 9:08 pm
languages_spoken: catalan, spanish, english
ODROIDs: ODROID-X2, U2, U3, XU4, C1, C2
Has thanked: 0
Been thanked: 1 time
Contact:

Re: emmc disk error

Post by mbonamusa »

I tried this image (https://wiki.odroid.com/odroid-c2/os_images/ubuntu/v3.1) and all is fine now.
I have some boards installed "around the world" with the bad image with this emmc CRC error problem and I can't change the emmc disc on them, so is there any possibility to update the kernel or what is needed on these boards remotely (ssh)?

User avatar
odroid
Site Admin
Posts: 34922
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English, Korean, Japanese
ODROIDs: ODROID
Has thanked: 957 times
Been thanked: 773 times
Contact:

Re: emmc disk error

Post by odroid »

Which "around the world" OS image did you try?

mad_ady
Posts: 8333
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, C4, N1, N2, H2, Go, Go Advance
Location: Bucharest, Romania
Has thanked: 574 times
Been thanked: 439 times
Contact:

Re: emmc disk error

Post by mad_ady »

I think he means he doesn't have physical access to other odroids.
Sure you can upgrade kernel and uboot remotely without issues (but test the steps on a local unit first).

You'll need to get the uboot, kernel and firmware deb packages, copy them over to the remote systems (scp), uninstall uboot/kernel/firmware packages from there and install the new ones with dpkg. Then reboot. You'll also need to apt-mark hold the new packages so they don't get downgraded by mistake.

Note that the kernel package name changed between 3.14 and 3.16

mbonamusa
Posts: 215
Joined: Mon Feb 25, 2013 9:08 pm
languages_spoken: catalan, spanish, english
ODROIDs: ODROID-X2, U2, U3, XU4, C1, C2
Has thanked: 0
Been thanked: 1 time
Contact:

Re: emmc disk error

Post by mbonamusa »

mad_ady wrote:
Tue Dec 17, 2019 2:54 pm
I think he means he doesn't have physical access to other odroids.
Sure you can upgrade kernel and uboot remotely without issues (but test the steps on a local unit first).

You'll need to get the uboot, kernel and firmware deb packages, copy them over to the remote systems (scp), uninstall uboot/kernel/firmware packages from there and install the new ones with dpkg. Then reboot. You'll also need to apt-mark hold the new packages so they don't get downgraded by mistake.

Note that the kernel package name changed between 3.14 and 3.16
Yes, I mean that!
I've sended some boards at some places around the world, so I can't take them to my office to change the emmc disk. These boards have the c2 2.1 version image (kernel 3.14.79-116)

I'll try you have suggested. But I'm afraid it could disconnected during uboot/kernel/firmware update procedure. Then I suppose the C2 board could become a brick!

I'll tell you.

mad_ady
Posts: 8333
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, C4, N1, N2, H2, Go, Go Advance
Location: Bucharest, Romania
Has thanked: 574 times
Been thanked: 439 times
Contact:

Re: emmc disk error

Post by mad_ady »

Work out the exact steps with a local board running the original OS. The risk is having power issues during the upgrade, or disk problems (you can force a fsck and reboot before trying). Or network failure that prevents you from downloading the new packages.

User avatar
odroid
Site Admin
Posts: 34922
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English, Korean, Japanese
ODROIDs: ODROID
Has thanked: 957 times
Been thanked: 773 times
Contact:

Re: emmc disk error

Post by odroid »

Sorry for my misunderstanding. :(

Post Reply

Return to “Issues”

Who is online

Users browsing this forum: No registered users and 1 guest