Kubernetes CGROUP PIDS

Post Reply
magicroomy
Posts: 15
Joined: Thu Aug 01, 2013 5:41 am
languages_spoken: english
ODROIDs: odroid-x, odroid-u3, odroid-c1, odroid-c2
Has thanked: 0
Been thanked: 1 time
Contact:

Kubernetes CGROUP PIDS

Unread post by magicroomy » Mon Jan 27, 2020 8:24 pm

My basic goal is to teach my MC1 kubernetes.
I read countless tutorials and docs about the subject ( all are not current).
I always run against the following problem:
At some point in time the kubernetes guys at google decided that kubernetes requires a kernel feature called CGROUP PIDS.
In some forums I read that activating the CGROUP PIDS and recompiling the kernel leads to the system not booting anymore. I tried myself and can agree.
Does anybody know if there is progress made on this subject?
Perfect would be is somebody could tell me where to find a full sd card image containing a kernel with activated CGROUP PIDS.
I tried ubuntu with 4.14 kernel, I also tried armbian with 4.14 kernels or even 5.X kernels.. nothing worked.

User avatar
igorpec
Posts: 479
Joined: Sat Dec 12, 2015 4:34 pm
languages_spoken: english,german,slovene
ODROIDs: XU4, HC1, C2, C1+
Has thanked: 19 times
Been thanked: 43 times
Contact:

Re: Kubernetes CGROUP PIDS

Unread post by igorpec » Mon Jan 27, 2020 9:47 pm

> with 4.14 kernel

We tried to enable this on 4.14.y but it doesn't wants to work ...

> even 5.X kernels.. nothing worked.

There it looks its enabled ... its in source config https://github.com/armbian/build/blob/m ... onfig#L149 while this doesn't mean it was actually build with this support. Check config in /boot directory to see if this was enabled or not. If not, this needs to be deeply investigated.

> Perfect would be

Its some work behind this and that solution.
ARMBIAN - follow on Twitter
linux for ARM development boards with user friendly development tools

User avatar
mad_ady
Posts: 7375
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1, H2, N2, Go, Go Advance
Location: Bucharest, Romania
Has thanked: 358 times
Been thanked: 258 times
Contact:

Re: Kubernetes CGROUP PIDS

Unread post by mad_ady » Tue Jan 28, 2020 4:02 am

How does it behave with cgroup pid active? Does the kernel boot?Does it gets stuck in userspace? Any last messages?

magicroomy
Posts: 15
Joined: Thu Aug 01, 2013 5:41 am
languages_spoken: english
ODROIDs: odroid-x, odroid-u3, odroid-c1, odroid-c2
Has thanked: 0
Been thanked: 1 time
Contact:

Re: Kubernetes CGROUP PIDS

Unread post by magicroomy » Tue Jan 28, 2020 2:42 pm

I can't tell if the kernel does anything while it should be booting, since I do not have a UART serial. (about to order one)
The effect is that I had a system up and running and could connect via ssh terminal.
After the kernel update, I cannot reach the odroid anymore. It also does not respond to ping.

User avatar
mad_ady
Posts: 7375
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1, H2, N2, Go, Go Advance
Location: Bucharest, Romania
Has thanked: 358 times
Been thanked: 258 times
Contact:

Re: Kubernetes CGROUP PIDS

Unread post by mad_ady » Tue Jan 28, 2020 2:53 pm

How about the blue led state? Is it blinking?

magicroomy
Posts: 15
Joined: Thu Aug 01, 2013 5:41 am
languages_spoken: english
ODROIDs: odroid-x, odroid-u3, odroid-c1, odroid-c2
Has thanked: 0
Been thanked: 1 time
Contact:

Re: Kubernetes CGROUP PIDS

Unread post by magicroomy » Wed Jan 29, 2020 5:07 am

Ok, here is what I did..
1. Download and flash image from here: https://wiki.odroid.com/odroid-xu4/os_i ... 10-minimal
2.Partially follow the instructions here : https://wiki.odroid.com/odroid-xu4/os_i ... 4/20190929
- I followed the instructions up to the point ---make odroidxu4_defconfig
- after I did this, I changed the .config and enabled CGROUP_PIDS by adding CGROUP_PIDS=y
- then I continued with make -j8 etc.
I copied the new kernel , installed the modules, all as described on the page mentioned under 2
When I finally say reboot. The odroid never comes back.
Blue led is constantly on.

User avatar
mad_ady
Posts: 7375
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1, H2, N2, Go, Go Advance
Location: Bucharest, Romania
Has thanked: 358 times
Been thanked: 258 times
Contact:

Re: Kubernetes CGROUP PIDS

Unread post by mad_ady » Wed Jan 29, 2020 5:12 am

It's hard to troubleshoot without a serial cable. Try enabling that option from within make menuconfig - maybe it has some dependencies.

magicroomy
Posts: 15
Joined: Thu Aug 01, 2013 5:41 am
languages_spoken: english
ODROIDs: odroid-x, odroid-u3, odroid-c1, odroid-c2
Has thanked: 0
Been thanked: 1 time
Contact:

Re: Kubernetes CGROUP PIDS

Unread post by magicroomy » Thu Jan 30, 2020 3:59 am

I tried the menuconfig way... same result. LED in constant blue. Odroid does not respond anymore to ssh or can even ping. It also does not appear listed in my router.

magicroomy
Posts: 15
Joined: Thu Aug 01, 2013 5:41 am
languages_spoken: english
ODROIDs: odroid-x, odroid-u3, odroid-c1, odroid-c2
Has thanked: 0
Been thanked: 1 time
Contact:

Re: Kubernetes CGROUP PIDS

Unread post by magicroomy » Thu Jan 30, 2020 5:17 am

Well I solved my actual problem: get Kubernetes running. I followed the odroid magazine article about installing kubernetes on a n2.
It seems the most important step here is to tell docker not to use CGROUPS but systemd as cgroup driver.

/etc/docker/daemon.json

{
"exec-opts": ["native.cgroupdriver=systemd"],
"log-driver": "json-file",
"log-opts": {
"max-size": "100m"
},
"storage-driver": "overlay2"
}

I assume this does not force kubernetes to struggle with CGroup PIDS.
The issue of this topic actually still exists. The kernel as described above seems to have a problem with CGROUP PIDS.
Nevertheless, from my point of view, this topic can be closed.
Thank you for your help.
These users thanked the author magicroomy for the post:
odroid (Thu Jan 30, 2020 10:17 am)

Post Reply

Return to “Ubuntu”

Who is online

Users browsing this forum: No registered users and 3 guests