SD-less netbooting / PXE

Post Reply
movax
Posts: 7
Joined: Mon Mar 09, 2015 9:10 am
languages_spoken: english
ODROIDs: XU4, XU3, C1, C1+, C2, SHOW
Contact:

SD-less netbooting / PXE

Unread post by movax » Fri Jun 01, 2018 4:41 am

Hi,

I am really interested in being able to use DHCP/BOOTP/TFTP/iPXE enabled booting, with no other storage devices attached to a board. IPv6 in bootloader would be very welcome, but I can consider this optional in the first implementation.

Similar to what Raspberry Pi 3 can do now: https://www.raspberrypi.org/documentati ... utorial.md

My use case is to buy 70+ ODROID-N1 boards for a cluster, with or without additional SATA drives, mostly for distributed algorithms testing (Erlang, Go), replicated storage (Ceph, Lustre), coherent distributed data caching (custom solution), cluster management (Kubernetes), scalable monitoring (Prometheues), cryptocurrency research (blockchain replication, sharding and load balancing). I already do have 32 old Dell PCs, and upgrading to something smaller, and more of it, would be beneficial for me (less space, less power, quieter, more nodes - means testing more extreme availability, even if every node is weaker). Amount of RAM, available 2 SATA ports over PCIe, and gigabit ethernet, and reasonable CPU performance, together with reasonable price (I might consider buying Lite version [no SATA ports and chip] too, for a separate Compute/Cache only cluster) are really making me consider this as a next contender :) (I dropped Raspberry Pi 3, because USB and Ethernet performance are both poor, and amount of RAM is very limiting, also I do not need/want WiFi).

Not using SD cards would make this easier for multiple reasons: Cheaper, less likely for storage device to fail, easier cluster upgrades, etc.

And even if I decide to use SD card, netbooting would allow me to install software on all SD cards quicker and automatically. I use FAI for cluster management / reinstallation right now.


Thanks!

PS. I do own 2 ODROID-C2, 1 ODROID-C1, 2 ODROID-XU4, and few other fruit boards (probably 20 in total, including various Raspberrys, Bananas, Oranges, CHIP and PINE/ROCK boards).

User avatar
mad_ady
Posts: 5387
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1, H2, N2
Location: Bucharest, Romania
Contact:

Re: SD-less netbooting / PXE

Unread post by mad_ady » Fri Jun 01, 2018 12:38 pm

There is a discussion about adding a 16M spi flash on the N1. The development boards don't have it, but some people (myself included) added it through gpio.
Tests by hardkernel showed it can boot uboot and kernel from spi and you can have the kernel either load rootfs from nfs/sata, or use kexec and load a different kernel elsewhere.
However, community tests were unable to reproduce this behavior. There was corruption when writing the flash and I had to write at 2k at a time with pauses in between, but even then the spi uboot would fail to boot.

Hopefully Hardkernel will decide to make the n1 (or a variant of it) and these problems will be solved. I agree spi boot offers great flexibility.

vbd
Posts: 2
Joined: Thu Nov 29, 2018 8:58 pm
languages_spoken: english, french
ODROIDs: C2
Location: France
Contact:

Re: SD-less netbooting / PXE

Unread post by vbd » Fri Nov 30, 2018 7:57 pm

Hi movax,
I know I'm quite late for this discussion and you probably will never see this question but: did you succeed into using netboot (and maybe no sd cards?) with your boards and running a container solution (i.e. docker, since you listed kubernetes)? I myself encountered quite a lot of issues since (I think) docker does not allow for the use of network based storage (NFS, etc.) due to it's implementation.

I would really like to ear about your experiences with all that.

joy
Posts: 675
Joined: Fri Oct 02, 2015 1:44 pm
languages_spoken: english
ODROIDs: ODROID-C1+, XU4, X
Contact:

Re: SD-less netbooting / PXE

Unread post by joy » Wed Dec 26, 2018 8:45 am

It will be awesome that netbooting works without pre-installed cards.
Also I'm interested in being able to netbooting without a heavy kernel/rootfs.

Already there is a reference of XU4 here.
I haven't tried it yet on N1 but it will be worthy to try it on N1.
https://wiki.odroid.com/odroid-xu4/appl ... ot?s[]=pxe

And petitboot has netbooting functionalities.
http://jk.ozlabs.org/blog/post/158/netb ... petitboot/

It must be a good item for next ODROIDs. :)
A very basic flow of petitboot has been almost completed, so, I'd like to implement network booting on petitboot first as the next step and I will.

umiddelb
Posts: 450
Joined: Thu Jan 29, 2015 6:42 am
languages_spoken: English, German
ODROIDs: ODROID-C1, ODROID-XU4, ODROID-C2
Contact:

Re: SD-less netbooting / PXE

Unread post by umiddelb » Thu Dec 27, 2018 6:54 pm

If you manage to put the u-boot firmware on spi flash memory this should be possible, since u-boot is able to fetch its payload via tftp instead of loading it from eMMC/mSD.

Post Reply

Return to “General Chat”

Who is online

Users browsing this forum: No registered users and 1 guest