[SOLVED] Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post Reply
krausn
Posts: 12
Joined: Thu Dec 07, 2023 11:44 pm
languages_spoken: english
Has thanked: 3 times
Been thanked: 2 times
Contact:

[SOLVED] Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post by krausn »

Hi!
I'm currently building a kubernetes cluster with 3xM1S.
As storage I want to use Longhorn, but unfortunately the 5.10 kernel is missing the required iscsi support.
For now I use unofficial 22.04 with kernel 6.10. Iscsi is working there.

It seems 22.04 is slower than 20.04. Anyone else witnessed low performance with 2204?

User avatar
tobetter
Posts: 13094
Joined: Mon Feb 25, 2013 10:55 am
languages_spoken: Korean, English
ODROIDs: Many
Location: Paju, South Korea
Has thanked: 996 times
Been thanked: 2275 times
Contact:

Re: Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post by tobetter »

How did you measure the performance to compare?

krausn
Posts: 12
Joined: Thu Dec 07, 2023 11:44 pm
languages_spoken: english
Has thanked: 3 times
Been thanked: 2 times
Contact:

Re: Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post by krausn »

Sorry, no real measurement.
It's just that all reaction times "feel" slower.
But what I can say is that loadavg was higher and
temperature (cat /sys/devices/virtual/thermal/thermal_zone0/temp) up to 10 degrees higher on exact same usage.

User avatar
tobetter
Posts: 13094
Joined: Mon Feb 25, 2013 10:55 am
languages_spoken: Korean, English
ODROIDs: Many
Location: Paju, South Korea
Has thanked: 996 times
Been thanked: 2275 times
Contact:

Re: Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post by tobetter »

krausn wrote: ↑
Sun Dec 17, 2023 12:17 am
Sorry, no real measurement.
It's just that all reaction times "feel" slower.
But what I can say is that loadavg was higher and
temperature (cat /sys/devices/virtual/thermal/thermal_zone0/temp) up to 10 degrees higher on exact same usage.
It must be because of different kernel version.
I can add iSCSC driver to 5.10 kernel. if you want, and compare with 6.1.
These users thanked the author tobetter for the post:
krausn (Sun Dec 17, 2023 10:01 pm)

krausn
Posts: 12
Joined: Thu Dec 07, 2023 11:44 pm
languages_spoken: english
Has thanked: 3 times
Been thanked: 2 times
Contact:

Re: Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post by krausn »

tobetter wrote: ↑
Sun Dec 17, 2023 12:45 am
It must be because of different kernel version.
I can add iSCSC driver to 5.10 kernel. if you want, and compare with 6.1.
That would be great. Thanks!

User avatar
tobetter
Posts: 13094
Joined: Mon Feb 25, 2013 10:55 am
languages_spoken: Korean, English
ODROIDs: Many
Location: Paju, South Korea
Has thanked: 996 times
Been thanked: 2275 times
Contact:

Re: Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post by tobetter »

krausn wrote: ↑
Sun Dec 17, 2023 10:02 pm
tobetter wrote: ↑
Sun Dec 17, 2023 12:45 am
It must be because of different kernel version.
I can add iSCSC driver to 5.10 kernel. if you want, and compare with 6.1.
That would be great. Thanks!
New kernel package with iSCSI driver is uploaded.

Code: Select all

sudo apt update
sudo apt upgrade
sudo apt reboot

Code: Select all

odroid@server:~$ uname -a
Linux server 5.10.0-odroid-arm64 #1 SMP Ubuntu 5.10.160-202312181038~focal (2023-12-18) aarch64 aarch64 aarch64 GNU/Linux
odroid@server:~$ sudo modprobe iscsi_tcp
odroid@server:~$ lsmod | grep iscsi
iscsi_tcp              20480  0
libiscsi_tcp           24576  1 iscsi_tcp
libiscsi               40960  2 libiscsi_tcp,iscsi_tcp
scsi_transport_iscsi    90112  3 libiscsi_tcp,iscsi_tcp,libiscsi

krausn
Posts: 12
Joined: Thu Dec 07, 2023 11:44 pm
languages_spoken: english
Has thanked: 3 times
Been thanked: 2 times
Contact:

Re: Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post by krausn »

I will try πŸ‘
Any specific measurements I should do in 22.04 before I reinstall 20.04?
What would be useful for better comparison?

krausn
Posts: 12
Joined: Thu Dec 07, 2023 11:44 pm
languages_spoken: english
Has thanked: 3 times
Been thanked: 2 times
Contact:

Re: Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post by krausn »

tobetter wrote: ↑
Mon Dec 18, 2023 12:18 pm
krausn wrote: ↑
Sun Dec 17, 2023 10:02 pm
tobetter wrote: ↑
Sun Dec 17, 2023 12:45 am
It must be because of different kernel version.
I can add iSCSC driver to 5.10 kernel. if you want, and compare with 6.1.
That would be great. Thanks!
New kernel package with iSCSI driver is uploaded.

Code: Select all

sudo apt update
sudo apt upgrade
sudo apt reboot

Code: Select all

odroid@server:~$ uname -a
Linux server 5.10.0-odroid-arm64 #1 SMP Ubuntu 5.10.160-202312181038~focal (2023-12-18) aarch64 aarch64 aarch64 GNU/Linux
odroid@server:~$ sudo modprobe iscsi_tcp
odroid@server:~$ lsmod | grep iscsi
iscsi_tcp              20480  0
libiscsi_tcp           24576  1 iscsi_tcp
libiscsi               40960  2 libiscsi_tcp,iscsi_tcp
scsi_transport_iscsi    90112  3 libiscsi_tcp,iscsi_tcp,libiscsi

Is "SCSI disk support" enabled as well?
I tried to mound an iSCSI disk from my san, but it is not creating a device.

Can you check?
Device Drivers --->
SCSI device support --->
<*> SCSI disk support
[*] SCSI low-level drivers --->
<*> iSCSI Initiator over TCP/IP
SCSI Transports --->
-*- iSCSI Transport Attributes

User avatar
tobetter
Posts: 13094
Joined: Mon Feb 25, 2013 10:55 am
languages_spoken: Korean, English
ODROIDs: Many
Location: Paju, South Korea
Has thanked: 996 times
Been thanked: 2275 times
Contact:

Re: Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post by tobetter »

krausn wrote: ↑
Mon Dec 18, 2023 8:42 pm
tobetter wrote: ↑
Mon Dec 18, 2023 12:18 pm
krausn wrote: ↑
Sun Dec 17, 2023 10:02 pm
tobetter wrote: ↑
Sun Dec 17, 2023 12:45 am
It must be because of different kernel version.
I can add iSCSC driver to 5.10 kernel. if you want, and compare with 6.1.
That would be great. Thanks!
New kernel package with iSCSI driver is uploaded.

Code: Select all

sudo apt update
sudo apt upgrade
sudo apt reboot

Code: Select all

odroid@server:~$ uname -a
Linux server 5.10.0-odroid-arm64 #1 SMP Ubuntu 5.10.160-202312181038~focal (2023-12-18) aarch64 aarch64 aarch64 GNU/Linux
odroid@server:~$ sudo modprobe iscsi_tcp
odroid@server:~$ lsmod | grep iscsi
iscsi_tcp              20480  0
libiscsi_tcp           24576  1 iscsi_tcp
libiscsi               40960  2 libiscsi_tcp,iscsi_tcp
scsi_transport_iscsi    90112  3 libiscsi_tcp,iscsi_tcp,libiscsi

Is "SCSI disk support" enabled as well?
I tried to mound an iSCSI disk from my san, but it is not creating a device.

Can you check?
Device Drivers --->
SCSI device support --->
<*> SCSI disk support
[*] SCSI low-level drivers --->
<*> iSCSI Initiator over TCP/IP
SCSI Transports --->
-*- iSCSI Transport Attributes
I think we have kernel features, and you can check out the features:

Code: Select all

zcat /proc/config.gz | grep SCSI
$ zcat /proc/config.gz | grep SCSI
CONFIG_BLK_SCSI_REQUEST=y
# SCSI device support
CONFIG_SCSI_MOD=y
CONFIG_SCSI=y
CONFIG_SCSI_DMA=y
CONFIG_SCSI_NETLINK=y
CONFIG_SCSI_PROC_FS=y
# SCSI support type (disk, tape, CD-ROM)
CONFIG_SCSI_CONSTANTS=y
CONFIG_SCSI_LOGGING=y
CONFIG_SCSI_SCAN_ASYNC=y
# SCSI Transports
CONFIG_SCSI_SPI_ATTRS=m
CONFIG_SCSI_FC_ATTRS=m
CONFIG_SCSI_ISCSI_ATTRS=m
CONFIG_SCSI_SAS_ATTRS=m
CONFIG_SCSI_SAS_LIBSAS=m
CONFIG_SCSI_SAS_ATA=y
CONFIG_SCSI_SAS_HOST_SMP=y
CONFIG_SCSI_SRP_ATTRS=m
# end of SCSI Transports
CONFIG_SCSI_LOWLEVEL=y
CONFIG_ISCSI_TCP=m
CONFIG_ISCSI_BOOT_SYSFS=m
CONFIG_SCSI_CXGB3_ISCSI=m
CONFIG_SCSI_CXGB4_ISCSI=m
CONFIG_SCSI_BNX2_ISCSI=m
CONFIG_SCSI_BNX2X_FCOE=m
CONFIG_BE2ISCSI=m
CONFIG_SCSI_HPSA=m
CONFIG_SCSI_3W_9XXX=m
CONFIG_SCSI_3W_SAS=m
CONFIG_SCSI_ACARD=m
CONFIG_SCSI_AACRAID=m
CONFIG_SCSI_AIC7XXX=m
CONFIG_SCSI_AIC79XX=m
CONFIG_SCSI_AIC94XX=m
CONFIG_SCSI_HISI_SAS=m
CONFIG_SCSI_MVSAS=m
CONFIG_SCSI_MVSAS_DEBUG=y
CONFIG_SCSI_MVSAS_TASKLET=y
CONFIG_SCSI_MVUMI=m
CONFIG_SCSI_ADVANSYS=m
CONFIG_SCSI_ARCMSR=m
CONFIG_SCSI_ESAS2R=m
CONFIG_SCSI_MPT3SAS=m
CONFIG_SCSI_MPT2SAS_MAX_SGE=128
CONFIG_SCSI_MPT3SAS_MAX_SGE=128
CONFIG_SCSI_MPT2SAS=m
CONFIG_SCSI_SMARTPQI=m
CONFIG_SCSI_UFSHCD=m
CONFIG_SCSI_UFSHCD_PCI=m
CONFIG_SCSI_UFS_DWC_TC_PCI=m
CONFIG_SCSI_UFSHCD_PLATFORM=m
CONFIG_SCSI_UFS_CDNS_PLATFORM=m
CONFIG_SCSI_UFS_DWC_TC_PLATFORM=m
CONFIG_SCSI_UFS_BSG=y
CONFIG_SCSI_UFS_HPB=y
CONFIG_SCSI_HPTIOP=m
CONFIG_SCSI_MYRB=m
CONFIG_SCSI_MYRS=m
CONFIG_SCSI_SNIC=m
CONFIG_SCSI_SNIC_DEBUG_FS=y
CONFIG_SCSI_DMX3191D=m
CONFIG_SCSI_FDOMAIN=m
CONFIG_SCSI_FDOMAIN_PCI=m
CONFIG_SCSI_GDTH=m
CONFIG_SCSI_IPS=m
CONFIG_SCSI_INITIO=m
CONFIG_SCSI_INIA100=m
CONFIG_SCSI_STEX=m
CONFIG_SCSI_SYM53C8XX_2=m
CONFIG_SCSI_SYM53C8XX_DMA_ADDRESSING_MODE=1
CONFIG_SCSI_SYM53C8XX_DEFAULT_TAGS=16
CONFIG_SCSI_SYM53C8XX_MAX_TAGS=64
CONFIG_SCSI_SYM53C8XX_MMIO=y
CONFIG_SCSI_IPR=m
CONFIG_SCSI_IPR_TRACE=y
CONFIG_SCSI_IPR_DUMP=y
CONFIG_SCSI_QLOGIC_1280=m
CONFIG_SCSI_QLA_FC=m
CONFIG_SCSI_QLA_ISCSI=m
CONFIG_SCSI_LPFC=m
CONFIG_SCSI_LPFC_DEBUG_FS=y
CONFIG_SCSI_DC395x=m
CONFIG_SCSI_AM53C974=m
CONFIG_SCSI_WD719X=m
CONFIG_SCSI_DEBUG=m
CONFIG_SCSI_PMCRAID=m
CONFIG_SCSI_PM8001=m
CONFIG_SCSI_BFA_FC=m
CONFIG_SCSI_CHELSIO_FCOE=m
CONFIG_SCSI_DH=y
CONFIG_SCSI_DH_RDAC=m
CONFIG_SCSI_DH_HP_SW=m
CONFIG_SCSI_DH_EMC=m
CONFIG_SCSI_DH_ALUA=m
# end of SCSI device support
# NOTE: USB_STORAGE depends on SCSI but BLK_DEV_SD may
CONFIG_NFSD_SCSILAYOUT=y
Can you check the kernel version with uname -a?

krausn
Posts: 12
Joined: Thu Dec 07, 2023 11:44 pm
languages_spoken: english
Has thanked: 3 times
Been thanked: 2 times
Contact:

Re: Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post by krausn »

Here the kernel I use: SMP Ubuntu 5.10.160-202312181038~focal (2023-12-18)

When I connect to iSCSI on my nas, 22.04 creates a block device /dev/sdb and I can see it with lsblk.
dmesg:

Code: Select all

[170745.561166] scsi 1:0:0:1: Direct-Access     SYNOLOGY Storage          4.0  PQ: 0 ANSI: 5
[170745.575139] sd 1:0:0:1: Attached scsi generic sg2 type 0
[170745.577075] sd 1:0:0:1: [sdb] 2097152 512-byte logical blocks: (1.07 GB/1.00 GiB)
[170745.578502] sd 1:0:0:1: [sdb] Write Protect is off
[170745.578537] sd 1:0:0:1: [sdb] Mode Sense: 43 00 10 08
[170745.580519] sd 1:0:0:1: [sdb] Write cache: enabled, read cache: enabled, supports DPO and FUA
[170745.581389] sd 1:0:0:1: [sdb] Preferred minimum I/O size 512 bytes
[170745.581421] sd 1:0:0:1: [sdb] Optimal transfer size 16384 logical blocks > dev_max (8192 logical blocks)
[170745.625152] sd 1:0:0:1: [sdb] Attached SCSI disk
When I do the same on 20.04 I do not get a device.

Code: Select all

[12122.669329] scsi host1: iSCSI Initiator over TCP/IP
[12122.711688] scsi 1:0:0:1: Direct-Access     SYNOLOGY Storage          4.0  PQ: 0 ANSI: 5
[12122.714644] scsi 1:0:0:1: alua: supports implicit TPGS
[12122.714666] scsi 1:0:0:1: alua: device naa.60014058dc1a739dff70d40d6d8b94dc port group 0 rel port 1
[12122.715100] scsi 1:0:0:1: Attached scsi generic sg2 type 0
[12122.725490] scsi 1:0:0:1: alua: transition timeout set to 60 seconds
[12122.725510] scsi 1:0:0:1: alua: port group 00 state A non-preferred supports TOlUSNA
I found in google that maybe scsi disk support might be missing...

Any idea?

krausn
Posts: 12
Joined: Thu Dec 07, 2023 11:44 pm
languages_spoken: english
Has thanked: 3 times
Been thanked: 2 times
Contact:

Re: Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post by krausn »

Found the difference:
5.10.0-odroid-arm64 CONFIG_BLK_DEV_SD=m
6.1.0-odroid-arm64 CONFIG_BLK_DEV_SD=y

After

Code: Select all

modprobe sd_mod 
it works in 20.04

Thanks, for your support!
These users thanked the author krausn for the post:
tobetter (Tue Dec 19, 2023 6:59 am)

salimsa
Posts: 1
Joined: Thu Mar 28, 2024 3:49 pm
languages_spoken: english
ODROIDs: ODROID-N2L
Has thanked: 0
Been thanked: 0
Contact:

Re: [SOLVED] Missing kernel support for ISCSI in 20.04/Slow Ubuntu 22.04

Post by salimsa »

I have the same problem. I can't see the disk shred with iscsi on ubuntu 20.04. Can you help me with the steps you tried and fix the issue

Post Reply

Return to β€œUbuntu”

Who is online

Users browsing this forum: No registered users and 1 guest