Help with backup HK Ubuntu 18.04

Post Reply
wallyz21
Posts: 286
Joined: Thu Apr 04, 2019 11:00 am
languages_spoken: english
ODROIDs: N2
Has thanked: 13 times
Been thanked: 32 times
Contact:

Help with backup HK Ubuntu 18.04

Post by wallyz21 »

The time has come to upgrade HK Ubuntu 18.04 MATE desktop system to something later.

However I need to backup all my /home directory first.

I have a 680GB USB3 HDD (2.5 inch) that I plugged in attempted to use to perform a backup.

After a few minutes of writing to the drive Ubuntu crashes.

I tried another externally powered 3.5 inch 1TB USB 3 HDD and that did the same.

I have to admit I have never tried USB3 HDD with this system before but I am surprised it is crashing.

Is there anything I can do to stop the crashing when I use an external USB3 HDD?
Walter Zambotti
N2 - Ubuntu Mate Desktop

User avatar
odroid
Site Admin
Posts: 37793
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English, Korean
ODROIDs: ODROID
Has thanked: 1919 times
Been thanked: 1186 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by odroid »

Show us "lsusb" and "lsusb -t" outputs to check if your issue is caused by UASP driver or not.
BTW, are you running Kernel 4.9.241 with Ubuntu 18.04?

wallyz21
Posts: 286
Joined: Thu Apr 04, 2019 11:00 am
languages_spoken: english
ODROIDs: N2
Has thanked: 13 times
Been thanked: 32 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by wallyz21 »

odroid wrote:
Wed Jul 21, 2021 5:20 pm
Show us "lsusb" and "lsusb -t" outputs to check if your issue is caused by UASP driver or not.
BTW, are you running Kernel 4.9.241 with Ubuntu 18.04?
Yes Ubuntu 18.04 with kernel 4.9.241-77

odroid@odroid:~$ lsusb
Bus 002 Device 002: ID 05e3:0620 Genesys Logic, Inc.
Bus 002 Device 001: ID 1d6b:0003 Linux Foundation 3.0 root hub
Bus 001 Device 003: ID 045e:0745 Microsoft Corp. Nano Transceiver v1.0 for Bluetooth
Bus 001 Device 004: ID 0bda:a811 Realtek Semiconductor Corp.
Bus 001 Device 007: ID 0bc2:2322 Seagate RSS LLC
Bus 001 Device 002: ID 05e3:0610 Genesys Logic, Inc. 4-port hub
Bus 001 Device 001: ID 1d6b:0002 Linux Foundation 2.0 root hub
odroid@odroid:~$ lsusb -t
/: Bus 02.Port 1: Dev 1, Class=root_hub, Driver=xhci-hcd/1p, 5000M
|__ Port 1: Dev 2, If 0, Class=Hub, Driver=hub/4p, 5000M
/: Bus 01.Port 1: Dev 1, Class=root_hub, Driver=xhci-hcd/2p, 480M
|__ Port 1: Dev 2, If 0, Class=Hub, Driver=hub/4p, 480M
|__ Port 1: Dev 7, If 0, Class=Mass Storage, Driver=usb-storage, 480M
|__ Port 3: Dev 4, If 0, Class=Vendor Specific Class, Driver=rtl88XXau, 480M
|__ Port 2: Dev 3, If 0, Class=Human Interface Device, Driver=usbhid, 12M
|__ Port 2: Dev 3, If 1, Class=Human Interface Device, Driver=usbhid, 12M
|__ Port 2: Dev 3, If 2, Class=Human Interface Device, Driver=usbhid, 12M
odroid@odroid:
Walter Zambotti
N2 - Ubuntu Mate Desktop

wallyz21
Posts: 286
Joined: Thu Apr 04, 2019 11:00 am
languages_spoken: english
ODROIDs: N2
Has thanked: 13 times
Been thanked: 32 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by wallyz21 »

That's odd lshw shows the drive but that it is connected via USB2 with only 100mA voltage!!!

*-usb:0
description: USB hub
product: USB2.1 Hub
vendor: GenesysLogic
physical id: 1
bus info: usb@1:1
version: 93.04
capabilities: usb-2.10
configuration: driver=hub maxpower=100mA slots=4 speed=480Mbit/s
*-usb:0
description: Mass storage device
product: Expansion
vendor: Seagate
physical id: 1
bus info: usb@1:1.1
logical name: scsi0
version: 0.00
serial: NA813ASA
capabilities: usb-2.10 scsi emulated scsi-host
configuration: driver=usb-storage maxpower=100mA speed=480Mbit/s
*-disk
description: SCSI Disk
product: Expansion
vendor: Seagate
physical id: 0.0.0
bus info: scsi@0:0.0.0
logical name: /dev/sda
version: 9300
serial: NA813ASA
size: 596GiB (640GB)
capabilities: partitioned partitioned:dos
configuration: ansiversion=6 logicalsectorsize=512 sectorsize=51

Not sure if that is correct!!!
Walter Zambotti
N2 - Ubuntu Mate Desktop

User avatar
odroid
Site Admin
Posts: 37793
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English, Korean
ODROIDs: ODROID
Has thanked: 1919 times
Been thanked: 1186 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by odroid »

I have no idea why your external HDD worked in USB 2.0 mode instead of USB 3.0.
But, USB 2.0 with mass-storage mode should not cause any system crashing probably.
Can you check dmesg output while copying files?

wallyz21
Posts: 286
Joined: Thu Apr 04, 2019 11:00 am
languages_spoken: english
ODROIDs: N2
Has thanked: 13 times
Been thanked: 32 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by wallyz21 »

Not sure what is going on but I unplugged the HDD from one USB3 port and plugged it into another and in that port it does show as a USB 3 device with a 144mA power draw and is seems to be working without crashing.

However while it is not crashing the the throughput is extremely low. I am copy about 60Gb of data and it is averaging less than 1mb per second and is peeking at 2.6mb per second.

Something seems wrong with the USB3 driver implementation!!!

Anyway I will test the drive under 21.04 and see what happens.
Walter Zambotti
N2 - Ubuntu Mate Desktop

User avatar
odroid
Site Admin
Posts: 37793
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English, Korean
ODROIDs: ODROID
Has thanked: 1919 times
Been thanked: 1186 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by odroid »

Extremely slow. It should be 70~80MB/s with EXT4 file system at least .
Which file system do you use on your external HDD?
Try checking dmesg outputs.

wallyz21
Posts: 286
Joined: Thu Apr 04, 2019 11:00 am
languages_spoken: english
ODROIDs: N2
Has thanked: 13 times
Been thanked: 32 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by wallyz21 »

odroid wrote:
Fri Jul 23, 2021 10:03 am
Extremely slow. It should be 70~80MB/s with EXT4 file system at least .
Which file system do you use on your external HDD?
Try checking dmesg outputs.
Yep EXT4 considering the source is a 128GB eMMc.
Walter Zambotti
N2 - Ubuntu Mate Desktop

User avatar
mad_ady
Posts: 9563
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, C4, N1, N2, H2, Go, Go Advance
Location: Bucharest, Romania
Has thanked: 604 times
Been thanked: 697 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by mad_ady »

Are you copying loads of small files or writing an image? Please detail more how you're doing your backup..

User avatar
tobetter
Posts: 8193
Joined: Mon Feb 25, 2013 10:55 am
languages_spoken: Korean, English
ODROIDs: Many
Location: Paju, South Korea
Has thanked: 475 times
Been thanked: 1281 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by tobetter »

@wallyz, maybe you can test on Linux kernel 5.11 without installing OS to memory card. From the Petitboot, run netboot_default command and select "Ubuntu 20.04 Live System (Experimental)" in the menu. This will load Ubuntu 20.04 server image to the memory through the network and help you to run generic small Linux system. Unfortunately, I forgot to upgrade it with @mad_ady's backup tool but you can install it if required.
viewtopic.php?f=52&t=22930&hilit=backup&start=200

User avatar
mad_ady
Posts: 9563
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, C4, N1, N2, H2, Go, Go Advance
Location: Bucharest, Romania
Has thanked: 604 times
Been thanked: 697 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by mad_ady »

@tobetter don't worry - I didn't get a chance to test it either.... Maybe - just maybe - if the painters finnish painting the appartment a couple of days earlier, I may get a chance by the middle of August... I miss going to the office, because at least there I could look busy while playing on my odroids... :( The bosses at home (mainly the kids) aren't so forgiving...

wallyz21
Posts: 286
Joined: Thu Apr 04, 2019 11:00 am
languages_spoken: english
ODROIDs: N2
Has thanked: 13 times
Been thanked: 32 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by wallyz21 »

I managed to get it to backup.

I tried the follow commands :

$ sudo cp -ruv /home/odroid /media/usb0/home/odroid

and

$ sudo rsync --info=progress2 -auvz /home/odroid /media/usb0/home/odroid

And to monitor I used :

$ iostat -y 5 /dev/mmcblk0 /dev/sda
Walter Zambotti
N2 - Ubuntu Mate Desktop

wallyz21
Posts: 286
Joined: Thu Apr 04, 2019 11:00 am
languages_spoken: english
ODROIDs: N2
Has thanked: 13 times
Been thanked: 32 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by wallyz21 »

In order to test the drive under 21.04 I can just plug it into my other Odroid N2 system which is already on that version!

Simple!!!
Last edited by wallyz21 on Sat Jul 24, 2021 8:40 pm, edited 2 times in total.
Walter Zambotti
N2 - Ubuntu Mate Desktop

wallyz21
Posts: 286
Joined: Thu Apr 04, 2019 11:00 am
languages_spoken: english
ODROIDs: N2
Has thanked: 13 times
Been thanked: 32 times
Contact:

Re: Help with backup HK Ubuntu 18.04

Post by wallyz21 »

So I have now tested the USB3 HDD on my N2 21.04 5.13 system and I am getting 76Mbytes per second.

So the older 4.9 kernel may be the issue.
These users thanked the author wallyz21 for the post:
odroid (Mon Jul 26, 2021 9:41 am)
Walter Zambotti
N2 - Ubuntu Mate Desktop

Post Reply

Return to “Ubuntu”

Who is online

Users browsing this forum: No registered users and 2 guests