Xen 4.4 on the XU

Post Reply
tklengyel
Posts: 16
Joined: Sat Feb 08, 2014 5:09 am
languages_spoken: english
ODROIDs: XU
Has thanked: 0
Been thanked: 0
Contact:

Xen 4.4 on the XU

Unread post by tklengyel » Fri Feb 21, 2014 1:05 am

Hi everyone,
I'm currently working on getting Xen 4.4 to run on the XU, but figured ask here if anyone else is working on that too. As the first step, I got kernel 3.13 compiled with the necessary Xen options enabled and verified that the kernel boots by itself. I also get Xen 4.4 compiled but unfortunately I can't seem to get it to boot. I'm trying to adapt the boot information for Arndale from the Xen Wiki (http://wiki.xenproject.org/wiki/Xen_ARM ... ns/Arndale). Xen is compiled with

Code: Select all

make dist-xen XEN_TARGET_ARCH=arm32
One modification I made to the wiki was with making the xen-uimage

Code: Select all

 mkimage -A arm -T kernel -a 0x40008000 -e 0x40008000 -C none -d "./xen/xen" xen-uImage
This is my current boot.ini:

Code: Select all


boot.ini command = setenv xen_addr_r 0x42000000
boot.ini command = setenv dtb_addr_r 0x46000000
boot.ini command = setenv kernel_addr_r 0x49000000
boot.ini command = setenv ramdisk_addr_r 0x60000000
boot.ini command = setenv xen_path /xen-uImage
boot.ini command = setenv kernel_path /uImage-xen-dom0
boot.ini command = setenv ramdisk_path /uInitrd-xen-dom0
boot.ini command = setenv dtb_path /exynos5410-odroidxu.dtb
boot.ini command = setenv xen_bootargs 'sync_console console=tty1 console=ttySAC2,115200n8'
boot.ini command = setenv dom0_bootargs "${bootrootfs} ${fb_control} fb_x_res=${fb_x_res} fb_y_res=${fb_y_res} vout=${vout} hdmi_phy_res=${hdmi_phy_res} led_blink=${led_blink}"

boot.ini command = setenv bootcmd "fatload mmc 0:1 ${xen_addr_r} ${xen_path}; fatload mmc 0:1 ${kernel_addr_r} ${kernel_path}; fatload mmc 0:1 ${ramdisk_addr_r} ${ramdisk_path}; fatload mmc 0:1 ${dtb_addr_r} ${dtb_path}; bootm ${xen_addr_r} ${ramdisk_addr_r} ${dtb_addr_r}"

boot.ini command = boot
And this is the output:

Code: Select all

## Booting kernel from Legacy Image at 42000000 ...
   Image Name:
   Image Type:   ARM Linux Kernel Image (uncompressed)
   Data Size:    656144 Bytes = 640.8 KiB
   Load Address: 40008000
   Entry Point:  40008000
   Verifying Checksum ... OK

## Loading init Ramdisk from Legacy Image at 60000000 ...
   Image Name:   uInitrd
   Image Type:   ARM Linux RAMDisk Image (uncompressed)
   Data Size:    1840391 Bytes = 1.8 MiB
   Load Address: 00000000
   Entry Point:  00000000
   Verifying Checksum ... OK

## Flattened Device Tree blob at 46000000
   Booting using the fdt blob at 0x46000000
   Loading Kernel Image ... OK

OK

   Using Device Tree in place at 46000000, end 460098c0

Starting kernel ...
No output seen after that and dom0 doesn't seem to boot as no DHCP request is seen on the wire. :(
Attachments
odroidxu-xen-3.13.txt
(83.79 KiB) Downloaded 277 times

mdrjr
Site Admin
Posts: 11736
Joined: Fri Feb 22, 2013 11:34 pm
languages_spoken: english, portuguese
ODROIDs: -
Location: Brazil
Has thanked: 1 time
Been thanked: 19 times
Contact:

Re: Xen 4.4 on the XU

Unread post by mdrjr » Fri Feb 21, 2014 2:07 am

I think that KVM instructions aren't working.

tklengyel
Posts: 16
Joined: Sat Feb 08, 2014 5:09 am
languages_spoken: english
ODROIDs: XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by tklengyel » Fri Feb 21, 2014 2:52 am

Thanks to folks on #xenarm I got the output from Xen printed after recompiling with "make dist-xen XEN_TARGET_ARCH=arm32 CONFIG_EARLY_PRINTK=exynos5250"
Starting kernel ...

.- UART enabled -
- CPU 00000000 booting -
- Xen must be entered in NS Hyp mode -
- Boot failed -
So I guess that is a u-boot issue?

@mdrjr: When I compiled the kernel with LPAE and the KVM options, it crashed. That was a couple days ago though.

mdrjr
Site Admin
Posts: 11736
Joined: Fri Feb 22, 2013 11:34 pm
languages_spoken: english, portuguese
ODROIDs: -
Location: Brazil
Has thanked: 1 time
Been thanked: 19 times
Contact:

Re: Xen 4.4 on the XU

Unread post by mdrjr » Fri Feb 21, 2014 3:02 am

I think its on u-boot that isn't going onto hypv mode.

tklengyel
Posts: 16
Joined: Sat Feb 08, 2014 5:09 am
languages_spoken: english
ODROIDs: XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by tklengyel » Fri Feb 21, 2014 3:11 am

That's what I think too. I tried building https://github.com/medicalwei/u-boot-od ... its/master but it fails with

Code: Select all

nonsec_virt.S: Assembler messages:
nonsec_virt.S:178: Error: selected processor does not support ARM mode `smc #0'
make[2]: *** [nonsec_virt.o] Error 1
make[2]: Leaving directory `/home/mrx/workspace/u-boot-odroidxu-hyp/arch/arm/cpu/armv7'
make[1]: *** [arch/arm/cpu/armv7/libarmv7.o] Error 2
make[1]: Leaving directory `/home/mrx/workspace/u-boot-odroidxu-hyp'
make: *** [smdk5410] Error 2
Bump.

mdrjr
Site Admin
Posts: 11736
Joined: Fri Feb 22, 2013 11:34 pm
languages_spoken: english, portuguese
ODROIDs: -
Location: Brazil
Has thanked: 1 time
Been thanked: 19 times
Contact:

Re: Xen 4.4 on the XU

Unread post by mdrjr » Fri Feb 21, 2014 3:42 am

What toolchain you are using? try some GCC4.6 to build that./

tklengyel
Posts: 16
Joined: Sat Feb 08, 2014 5:09 am
languages_spoken: english
ODROIDs: XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by tklengyel » Fri Feb 21, 2014 5:40 am

I used gcc 4.8 on the device itself. I installed 4.6 as well, but get the same result

Code: Select all

gcc-4.6   -D__ASSEMBLY__ -g  -Os   -fno-common -ffixed-r8 -msoft-float  -D__KERNEL__ -DCONFIG_SYS_TEXT_BASE=0x43E00000 -I/root/u-boot-odroidxu-hyp/include -fno-builtin -ffreestanding -nostdinc -isystem /usr/lib/gcc/arm-linux-gnueabi/4.6/include -pipe  -DCONFIG_ARM -D__ARM__ -marm -mno-thumb-interwork -mabi=aapcs-linux -march=armv7-a   -o nonsec_virt.o nonsec_virt.S -c
nonsec_virt.S: Assembler messages:
nonsec_virt.S:178: Error: selected processor does not support ARM mode `smc #0'
make[1]: *** [nonsec_virt.o] Error 1
make[1]: Leaving directory `/root/u-boot-odroidxu-hyp/arch/arm/cpu/armv7'
make: *** [arch/arm/cpu/armv7/libarmv7.o] Error 2

User avatar
memeka
Posts: 4420
Joined: Mon May 20, 2013 10:22 am
languages_spoken: english
ODROIDs: XU rev2 + eMMC + UART
U3 + eMMC + IO Shield + UART
Has thanked: 2 times
Been thanked: 57 times
Contact:

Re: Xen 4.4 on the XU

Unread post by memeka » Fri Feb 21, 2014 5:44 am

there are a few things to fix...

For ARM mode `smc #0' error, you need to open up those files (there will be like 3 or so, including nonsec_virt.S), find the "asm" instructions, and add this as the first asm instruction:

Code: Select all

.arch_extension sec\n\t
there will be some other issues after this, but I forgot which ones :)

EDIT: I remembered one of them - you'll get errors in some modules, disable in your config CFQ IO scheduler.

tklengyel
Posts: 16
Joined: Sat Feb 08, 2014 5:09 am
languages_spoken: english
ODROIDs: XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by tklengyel » Fri Feb 21, 2014 5:57 am

Thanks, that did the trick! I didn't get any errors in modules with gcc 4.8 luckily. =)

Edit: the fixes are up at https://github.com/tklengyel/u-boot-odroidxu-hyp

User avatar
memeka
Posts: 4420
Joined: Mon May 20, 2013 10:22 am
languages_spoken: english
ODROIDs: XU rev2 + eMMC + UART
U3 + eMMC + IO Shield + UART
Has thanked: 2 times
Been thanked: 57 times
Contact:

Re: Xen 4.4 on the XU

Unread post by memeka » Fri Feb 21, 2014 6:56 am

I think it's better instead of those fixes to just revert this commit:
https://github.com/tklengyel/u-boot-odr ... 7a60d116d0

Can you boot xen?

tklengyel
Posts: 16
Joined: Sat Feb 08, 2014 5:09 am
languages_spoken: english
ODROIDs: XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by tklengyel » Fri Feb 21, 2014 8:15 am

I tried booting just the kernel first and that hung so I'll have to reset the device.. which I can only do tomorrow, so yet to be seen =)

tklengyel
Posts: 16
Joined: Sat Feb 08, 2014 5:09 am
languages_spoken: english
ODROIDs: XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by tklengyel » Fri Feb 21, 2014 9:45 pm

So I tried compiling u-boot from that repository in a variety of ways, reverting to https://github.com/tklengyel/u-boot-odr ... 7a60d116d0, but no difference, still get "- Xen must be entered in NS Hyp mode -" :/

Edit: I guess knowing how to properly upgrade the u-boot on the eMMC would be nice =)

tklengyel
Posts: 16
Joined: Sat Feb 08, 2014 5:09 am
languages_spoken: english
ODROIDs: XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by tklengyel » Fri Feb 21, 2014 11:38 pm

So this my understanding of the u-boot flash process. I'm obviously doing something wrong as the device won't even boot from the sdcard (led light remains red and the fan doesn't turn on).

Code: Select all

make ARCH=arm smdk5410_config
make ARCH=arm
make -C sd_fuse
./sd_fuse/mkbl2 u-boot.bin u-boot_bl2.bin 16384

dd if=./u-boot_bl2.bin of=/dev/sdd seek=31
dd if=./u-boot.bin of=/dev/sdd seek=63

tklengyel
Posts: 16
Joined: Sat Feb 08, 2014 5:09 am
languages_spoken: english
ODROIDs: XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by tklengyel » Sat Feb 22, 2014 12:03 am

After more carefully reading http://odroid.com/dokuwiki/doku.php?id=en:odroid-xu, I see the smdk5410-spl.bin in the spl folder is the one that needs to flashed, and it also needs to be signed. So here it is, please sign it ;) The forum doesn't let me attach it with .bin extension so i changed it to .txt..
Attachments
smdk5410-spl_bin.txt
(14 KiB) Downloaded 268 times

User avatar
odroid
Site Admin
Posts: 33297
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Has thanked: 376 times
Been thanked: 449 times
Contact:

Re: Xen 4.4 on the XU

Unread post by odroid » Sat Feb 22, 2014 2:34 am

Can you reupload the binary in a .zip file?

We will sign on your binary next Monday.

User avatar
odroid
Site Admin
Posts: 33297
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Has thanked: 376 times
Been thanked: 449 times
Contact:

Re: Xen 4.4 on the XU

Unread post by odroid » Sun Feb 23, 2014 2:36 pm

tklengyel.20140222.zip
(7.61 KiB) Downloaded 188 times
Signed one.

tklengyel
Posts: 16
Joined: Sat Feb 08, 2014 5:09 am
languages_spoken: english
ODROIDs: XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by tklengyel » Mon Feb 24, 2014 8:53 pm

Thanks, u-boot seems to boot now but I get the following error:

Code: Select all

## Booting kernel from Legacy Image at 42000000 ...
   Image Name:
   Image Type:   ARM Linux Kernel Image (uncompressed)
   Data Size:    656144 Bytes = 640.8 KiB
   Load Address: 40008000
   Entry Point:  40008000
   Verifying Checksum ... OK
## Loading init Ramdisk from Legacy Image at 60000000 ...
   Image Name:   uInitrd
   Image Type:   ARM Linux RAMDisk Image (uncompressed)
   Data Size:    1840391 Bytes = 1.8 MiB
   Load Address: 00000000
   Entry Point:  00000000
   Verifying Checksum ... OK
## Flattened Device Tree blob at 46000000
   Booting using the fdt blob at 0x46000000
   Loading Kernel Image ... OK
OK
undefined instruction
pc : [<bfc6f66c>]        lr : [<bfc6f52c>]
sp : bfb65998  ip : 00000002   fp : 00000000
r10: bfcac2f4  r9 : 00000000   r8 : bfb65f30
r7 : bfc702f8  r6 : bfcacb00   r5 : bfcacb00  r4 : 00000000
r3 : 10482000  r2 : 10480000   r1 : 00063fff  r0 : 410fc0f0
Flags: nZCv  IRQs off  FIQs off  Mode SVC_32
Resetting CPU ...

emmc resetting ...
resetting ...

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Tue Mar 11, 2014 11:53 pm

Hello tklengyel,
Your signed bl2 still doesnot get the CPU in HYP mode. In another thread (KVM related) there is sisgned bl2 from fanta which gets the cpu up in hyp mode.
Here is the output of Xen 4.5 (latest from git) usingyour signed bl2:

Code: Select all

## Booting kernel from Legacy Image at 50000000 ...
   Image Name:   
   Image Type:   ARM Linux Kernel Image (uncompressed)
   Data Size:    656144 Bytes = 640.8 KiB
   Load Address: 80200000
   Entry Point:  80200000
   Verifying Checksum ... OK
## Flattened Device Tree blob at 42000000
   Booting using the fdt blob at 0x42000000
   Loading Kernel Image ... OK
OK
   reserving fdt memory region: addr=42000000 size=7000
   Loading Device Tree to 4fff6000, end 4fffffff ... OK

Starting kernel ...

e- UART enabled -
- CPU 00000000 booting -
- Xen must be entered in NS Hyp mode -
- Boot failed -
I think we need the fanta hyp mode + the arndale fixes for penning the other cpus etc for this to work fully. Also the dtb has to be patched with the ARM generic timer for XEN to come up.
- Suriyan
Last edited by suriyan on Wed Mar 12, 2014 12:05 am, edited 1 time in total.

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Wed Mar 12, 2014 12:02 am

And this is the output from using fanta's signed bl2 (cpu0 in hyp mode) and a dts patch for the ARM generic timer in the dtb.

Code: Select all

## Booting kernel from Legacy Image at 50000000 ...
   Image Name:   
   Image Type:   ARM Linux Kernel Image (uncompressed)
   Data Size:    656144 Bytes = 640.8 KiB
   Load Address: 80200000
   Entry Point:  80200000
   Verifying Checksum ... OK
## Flattened Device Tree blob at 42000000
   Booting using the fdt blob at 0x42000000
   Loading Kernel Image ... OK
OK
   reserving fdt memory region: addr=42000000 size=7000
   Loading Device Tree to 4fff6000, end 4fffffff ... OK

Starting kernel ...

e- UART enabled -
- CPU 00000000 booting -
- Xen starting in Hyp mode -
- Zero BSS -
- Setting up control registers -
- Turning on paging -
- Ready -
Checking for initrd in /chosen
RAM: 0000000040000000 - 000000004fffffff
RAM: 0000000050000000 - 000000005fffffff
RAM: 0000000060000000 - 000000006fffffff
RAM: 0000000070000000 - 000000007fffffff
RAM: 0000000080000000 - 000000008fffffff
RAM: 0000000090000000 - 000000009fffffff
RAM: 00000000a0000000 - 00000000afffffff
RAM: 00000000b0000000 - 00000000bfdfffff

MODULE[1]: 000000004fff6000 - 0000000050000000 
MODULE[2]: 0000000060000000 - 0000000060a00000 
 RESVD[0]: 0000000042000000 - 0000000042007000

Command line: console=dtuart dtuart=/serial@12C20000
Placing Xen at 0x00000000bfc00000-0x00000000bfe00000
Xen heap: 00000000ae000000-00000000be000000 (65536 pages)
Dom heap: 458240 pages
Looking for UART console /serial@12C20000
 Xen 4.5-unstable
(XEN) Xen version 4.5-unstable (suriyan@) (arm-linux-gcc (Buildroot 2014.02) 4.8.2) debug=y Mon Mar 10 08:54:01 PDT 2014
(XEN) Latest ChangeSet: Thu Mar 6 11:32:48 2014 +0000 git:4888ac58
(XEN) Processor: 412fc0f3: "ARM Limited", variant: 0x2, part 0xc0f, rev 0x3
(XEN) 32-bit Execution:
(XEN)   Processor Features: 00001131:00011011
(XEN)     Instruction Sets: AArch32 Thumb Thumb-2 ThumbEE Jazelle
(XEN)     Extensions: GenericTimer Security
(XEN)   Debug Features: 02010555
(XEN)   Auxiliary Features: 00000000
(XEN)   Memory Model Features: 10201105 20000000 01240000 02102211
(XEN)  ISA Features: 02101110 13112111 21232041 11112131 10011142 00000000
(XEN) WARNING: Unrecognized/unsupported device tree compatible list
(XEN) Available platform support:
(XEN)     - VERSATILE EXPRESS
(XEN)     - SAMSUNG EXYNOS5
(XEN)     - CALXEDA MIDWAY
(XEN)     - TI OMAP5
(XEN)     - Allwinner A20
(XEN) Generic Timer IRQ: phys=30 hyp=26 virt=27
(XEN) Using generic timer at 24000 KHz
(XEN) GIC initialization:
(XEN)         gic_dist_addr=0000000010481000
(XEN)         gic_cpu_addr=0000000010482000
(XEN)         gic_hyp_addr=0000000010484000
(XEN)         gic_vcpu_addr=0000000010486000
(XEN)         gic_maintenance_irq=25
(XEN) GIC: 256 lines, 8 cpus, secure (IID 0200043b).
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Allocated console ring of 32 KiB.
(XEN) VFP implementer 0x41 architecture 4 part 0x30 variant 0xf rev 0x0
(XEN) Bringing up CPU1
(XEN) Failed to bring up CPU1
(XEN) Failed to bring up CPU 1 (error -19)
(XEN) Bringing up CPU2
(XEN) Failed to bring up CPU2
(XEN) Failed to bring up CPU 2 (error -19)
(XEN) Bringing up CPU3
(XEN) Failed to bring up CPU3
(XEN) Failed to bring up CPU 3 (error -19)
(XEN) Brought up 1 CPUs
(XEN) *** LOADING DOMAIN 0 ***
(XEN) Populate P2M 0x68000000->0x70000000 (1:1 mapping for dom0)
(XEN) Loading kernel from boot module 2
(XEN) Loading zImage from 0000000060000000 to 000000006fa00000-000000006fe7b9a8
(XEN) Loading dom0 DTB to 0x000000006f800000-0x000000006f8068ab
(XEN) Scrubbing Free RAM: ...................done.
(XEN) Initial low memory virq threshold set at 0x4000 pages.
(XEN) Std. Loglevel: All
(XEN) Guest Loglevel: All
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 260kB init memory.
As you can see it has trouble getting the other CPUs up.

mdrjr
Site Admin
Posts: 11736
Joined: Fri Feb 22, 2013 11:34 pm
languages_spoken: english, portuguese
ODROIDs: -
Location: Brazil
Has thanked: 1 time
Been thanked: 19 times
Contact:

Re: Xen 4.4 on the XU

Unread post by mdrjr » Wed Mar 12, 2014 12:19 am

Does XEN supports Trustzone?

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Wed Mar 12, 2014 12:30 am

I do not have the details about this, but looks like this thread has some information regarding trustzone vs hypervisor mode wrt XEN.
http://osdir.com/ml/general/2014-01/msg16814.html

tklengyel
Posts: 16
Joined: Sat Feb 08, 2014 5:09 am
languages_spoken: english
ODROIDs: XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by tklengyel » Sun Mar 16, 2014 7:20 am

mdrjr wrote:Does XEN supports Trustzone?
No, it doesn't. It could potentially be used for run-time integrity checking? Or XSM perhaps? Not sure.

@suriyan: I see your post on xen-devel by the way that you got the CPUs to be brought up during Xen boot. What was the trick beside using fanta's signed images from the other thread? From your log it seem like Xen booted fine. What was your issue? Dom0 didn't boot? I sort-of moved my development to Arndale in the meanwhile but I guess I'll revisit the XU next week and see how far I get.

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Tue Mar 18, 2014 2:49 am

Hello tklengyel,
In my follow up posts, I have mentionted all the changes in the xen-dev mailing list. There is also a couple of code added to u-boot to get the CPU cores turned on, and to start the Arch timer to start ticking (this is done in xen too). The cpu part we are not bothered currently as we want to make it work with one CPU first!
Cheers
- Suriyan

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Fri Mar 21, 2014 2:14 am

Hello odroid,
Could you please sign this bl2 for me? The arch timer needs to be set in secure mode, and I hope this does it.
Thanks as usual!
- Suriyan
Attachments
smdk5410-spl.bin.tgz
(3.65 KiB) Downloaded 242 times

tklengyel
Posts: 16
Joined: Sat Feb 08, 2014 5:09 am
languages_spoken: english
ODROIDs: XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by tklengyel » Wed Apr 02, 2014 8:45 pm

suriyan: have you managed to boot dom0 on the XU? I made the patches you described in http://lists.xen.org/archives/html/xen- ... 01966.html and Xen boots but no output from dom0:

Code: Select all

 Xen 4.5-unstable
(XEN) Xen version 4.5-unstable (ssjtoma@sec.in.tum.de) (arm-linux-gnueabihf-gcc (crosstool-NG linaro-1.13.1-4.8-2014.02 - Linaro GCC 2014.02) 4.8.3 20140203 (prerelease)) debug=y Tue Apr  1 16:19:24 CEST 2014
(XEN) Latest ChangeSet: Tue Feb 11 15:27:24 2014 +0100 git:9011c26-dirty
(XEN) Console output is synchronous.
(XEN) Processor: 412fc0f3: "ARM Limited", variant: 0x2, part 0xc0f, rev 0x3
(XEN) 32-bit Execution:
(XEN)   Processor Features: 00001131:00011011
(XEN)     Instruction Sets: AArch32 Thumb Thumb-2 ThumbEE Jazelle
(XEN)     Extensions: GenericTimer Security
(XEN)   Debug Features: 02010555
(XEN)   Auxiliary Features: 00000000
(XEN)   Memory Model Features: 10201105 20000000 01240000 02102211
(XEN)  ISA Features: 02101110 13112111 21232041 11112131 10011142 00000000
(XEN) Platform: SAMSUNG EXYNOS5
(XEN) Set SYSRAM to 00000000bfc0004c (0020004c)
(XEN) Generic Timer IRQ: phys=30 hyp=26 virt=27
(XEN) Using generic timer at 24000 KHz
(XEN) GIC initialization:
(XEN)         gic_dist_addr=0000000010481000
(XEN)         gic_cpu_addr=0000000010482000
(XEN)         gic_hyp_addr=0000000010484000
(XEN)         gic_vcpu_addr=0000000010486000
(XEN)         gic_maintenance_irq=25
(XEN) GIC: 256 lines, 8 cpus, secure (IID 0200043b).
(XEN) XSM Framework v1.0.0 initialized
(XEN) xsm: Policy len = 0x00000000000025e7 start at 0x0000000041000000
(XEN) Flask:  Initializing.
(XEN) AVC INITIALIZED
(XEN) Flask: 128 avtab hash slots, 276 rules.
(XEN) Flask: 128 avtab hash slots, 276 rules.
(XEN) Flask:  3 users, 3 roles, 39 types, 1 bools
(XEN) Flask:  11 classes, 276 rules
(XEN) Flask:  Starting in permissive mode.
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Allocated console ring of 32 KiB.
(XEN) VFP implementer 0x41 architecture 4 part 0x30 variant 0xf rev 0x0
(XEN) Bringing up CPU1
(XEN) 'A' pressed -> using alternative key handling

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Thu Apr 03, 2014 2:37 pm

yes, dom0 works with Xen.

You need more patches to get other CPUs up. I am still working on that aspect.
To start with, just use one CPU => comment out the other 3 cpus in the dts used.
That shall get past your trying ot boot up CPU1 hang.

Also, to get dom0 output, you need to do the little hack in kernel/printk/printk.c
- Suriyan

Zozel
Posts: 38
Joined: Tue Nov 19, 2013 8:53 pm
languages_spoken: english
ODROIDs: ODROID-XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by Zozel » Wed Oct 01, 2014 9:05 pm

suriyan wrote:yes, dom0 works with Xen.

You need more patches to get other CPUs up. I am still working on that aspect.
To start with, just use one CPU => comment out the other 3 cpus in the dts used.
That shall get past your trying ot boot up CPU1 hang.

Also, to get dom0 output, you need to do the little hack in kernel/printk/printk.c
- Suriyan
Hey suriyan, I need to ask you something. Have you succeeded arriving at a login prompt on ODROID-XU with your 13.3 Dom0? Didn't you have any MMC-driver related crashes?
I have output of Dom0, the timer is successfully initialised, but the kernel crashes somewhere inside the MMC driver and fails to mount the rootfs - please see bottom-pasted Dom0 relevant part of the log.

What I did:
* followed your posts on xen-devel ( http://www.gossamer-threads.com/lists/xen/devel/321354 ), applied the patches you suggested and succeeded in booting a Dom0 on ODROID-XU with output and with the timer successfully initialised. Had to patch on the linux kernel, the DTB and the xen 4.4 stable source, as you suggested.

Details:
* just to be more specific, I used the odroid-3.13.y-linaro branch of the git repo https://github.com/hardkernel/linux.git
* MMC crash log of Dom0:

Code: Select all

Synopsys Designware Multimedia Card Interface Driver
[    1.765187] dwmmc_exynos 12200000.mmc: dummy supplies not allowed

[    1.770778] dwmmc_exynos 12200000.mmc: no vmmc regulator found: -19

[    1.777097] dwmmc_exynos 12200000.mmc: dw_mci_init_dma: could not alloc DMA memory

[    1.784724] dwmmc_exynos 12200000.mmc: Using PIO mode.

[    1.789932] dwmmc_exynos 12200000.mmc: Version ID is 241a

[    1.795516] dwmmc_exynos 12200000.mmc: DW MMC controller at irq 107, 64 bit host data width, 128 deep fifo

[    1.834583] dwmmc_exynos 12200000.mmc: 1 slots initialized

[    1.838925] dwmmc_exynos 12220000.mmc: dummy supplies not allowed

[    1.844876] dwmmc_exynos 12220000.mmc: no vmmc regulator found: -19

[    1.851205] dwmmc_exynos 12220000.mmc: dw_mci_init_dma: could not alloc DMA memory

[    1.858838] dwmmc_exynos 12220000.mmc: Using PIO mode.

[    1.864058] dwmmc_exynos 12220000.mmc: Version ID is 241a

[    1.869635] dwmmc_exynos 12220000.mmc: DW MMC controller at irq 109, 64 bit host data width, 128 deep fifo

[    1.909592] dwmmc_exynos 12220000.mmc: 1 slots initialized

6ledtrig-cpu: registered to indicate activity on CPUs
6hidraw: raw HID events driver (C) Jiri Kosina
6usbcore: registered new interface driver usbhid
6usbhid: USB HID core driver
d------------[ cut here ]------------
2kernel BUG at drivers/mmc/core/core.c:239!
0Internal error: Oops - BUG: 0 [#1] SMP THUMB2
dModules linked in:
dCPU: 0 PID: 6 Comm: kworker/u2:0 Not tainted 3.13.11+ #4
dWorkqueue: kmmcd mmc_rescan
dtask: cf8b9040 ti: cf8d0000 task.ti: cf8d0000
PC is at mmc_start_request+0x8a/0x90
LR is at __mmc_start_req+0x4d/0x64
pc : [<c038d452>]    lr : [<c038d535>]    psr: 20000133
sp : cf8d1d20  ip : 00000000  fp : cf8d1d68
r10: cecf4800  r9 : cf813000  r8 : cecf5c00
r7 : ffffffff  r6 : 00000000  r5 : cf813000  r4 : cf8d1d98
r3 : cf8d1d68  r2 : 00000000  r1 : 00000200  r0 : 00000001
Flags: nzCv  IRQs on  FIQs on  Mode SVC_32  ISA Thumb  Segment kernel
Control: 70c5387d  Table: 50003000  DAC: fffffffd

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Wed Oct 01, 2014 9:42 pm

Hi Zozel,
Some points.
1. Xen has full support currently. If you build the staging branch no code changes in Xen are required.
2.
a. Use the linux 3.13 in my github: git clone https://github.com/suriyanr/linux.git
This is based of hsnaves 3.13 tree for the XU, and it has hdmi working. I have added some nice to have things, like an odroidxu_xen_defconfig which when used builds a dom0 kernel. Also exynos5410.dtsi has been modified to things that Xen looks for. Hence, the dtb from here would be perfect for Xen.
b. In the same tree you will find an sd_fuse directory, with the bits for trustzone/bl2 which set CNTFRQ as well.

If you use the bits from above, you dont need to modify anything and will get XEN booted up with dom0.

Please let me know if the above works. I think a nice Xen focussed uboot.ini file would be apt. I shall push that in to the sd_fuse directory if needed. (Edit: Pushed to git - boot.ini)
Thanks
- Suriyan

Zozel
Posts: 38
Joined: Tue Nov 19, 2013 8:53 pm
languages_spoken: english
ODROIDs: ODROID-XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by Zozel » Wed Oct 01, 2014 10:09 pm

1. Very nice, just to be sure, you meant the staging-4.4 branch, right?
2. a. AWESOME, b. 2 x AWESOME, I suppose I can leave my current u-boot.bin unchanged and replace only BL1, SPL & TZSW then?

I'll be doing this right now and I'll come to post the results.
Thanks a lot!!
Zozel

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Wed Oct 01, 2014 10:18 pm

Zozel wrote:just to be sure, you meant the staging-4.4 branch, right?
No, I meant the staging branch and not staging-4.4

Also, I have found in the past sometimes that the bl2 is tied to a u-boot.bin. In case your u-boot.bin does not work, just use the one provided in sd_fuse.

Zozel
Posts: 38
Joined: Tue Nov 19, 2013 8:53 pm
languages_spoken: english
ODROIDs: ODROID-XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by Zozel » Wed Oct 01, 2014 10:25 pm

There is no u-boot.bin in the sd_fuse directory, that's why I asked. Can you push that as well?
Thanks

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Wed Oct 01, 2014 10:53 pm

Zozel wrote:There is no u-boot.bin in the sd_fuse directory, that's why I asked. Can you push that as well?
Thanks
Ah!. I didn't know that! Pushed!
Looks like .bin is in the .gitignore list and hence it didnt pick it up the first time around!
Do also try using your custom u-boot.bin s and let me know if that works too!
Thanks
- Suriyan

Zozel
Posts: 38
Joined: Tue Nov 19, 2013 8:53 pm
languages_spoken: english
ODROIDs: ODROID-XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by Zozel » Wed Oct 01, 2014 11:04 pm

Tried with both my custom u-boot.bin and with the pushed u-boot.bin and unfortunately the results are exactly the same :(

Code: Select all

[    2.497740] Synopsys Designware Multimedia Card Interface Driver

[    2.504232] dwmmc_exynos 12200000.mmc: dummy supplies not allowed

[    2.509772] dwmmc_exynos 12200000.mmc: no vmmc regulator found: -19

[    2.516091] dwmmc_exynos 12200000.mmc: dw_mci_init_dma: could not alloc DMA memory

[    2.523716] dwmmc_exynos 12200000.mmc: Using PIO mode.

[    2.528920] dwmmc_exynos 12200000.mmc: Version ID is 241a

[    2.534637] dwmmc_exynos 12200000.mmc: DW MMC controller at irq 107, 64 bit host data width, 128 deep fifo

[    2.569840] dwmmc_exynos 12200000.mmc: 1 slots initialized

[    2.574194] dwmmc_exynos 12220000.mmc: dummy supplies not allowed

[    2.580140] dwmmc_exynos 12220000.mmc: no vmmc regulator found: -19

[    2.586461] dwmmc_exynos 12220000.mmc: dw_mci_init_dma: could not alloc DMA memory

[    2.594083] dwmmc_exynos 12220000.mmc: Using PIO mode.

[    2.599291] dwmmc_exynos 12220000.mmc: Version ID is 241a

[    2.605005] dwmmc_exynos 12220000.mmc: DW MMC controller at irq 109, 64 bit host data width, 128 deep fifo

[    2.649826] dwmmc_exynos 12220000.mmc: 1 slots initialized

[    2.652008] ------------[ cut here ]------------

[    2.652014] kernel BUG at drivers/mmc/core/core.c:239!

[    2.652020] Internal error: Oops - BUG: 0 [#1] SMP THUMB2

[    2.652029] Modules linked in:

[    2.652037] CPU: 0 PID: 6 Comm: kworker/u8:0 Not tainted 3.13.11+ #1

[    2.652055] Workqueue: kmmcd mmc_rescan

[    2.652062] task: cf899040 ti: cf8de000 task.ti: cf8de000

[    2.652069] PC is at mmc_start_request+0x8a/0x90


[    2.652075] LR is at __mmc_start_req+0x4d/0x64

[    2.652083] pc : [<c038d4aa>]    lr : [<c038d58d>]    psr: 20000133

[    2.652083] sp : cf8dfd20  ip : 00000000  fp : cf8dfd68

[    2.652087] r10: cee42000  r9 : cedb0000  r8 : cec97000

[    2.652093] r7 : ffffffff  r6 : 00000000  r5 : cedb0000  r4 : cf8dfd98

[    2.652098] r3 : cf8dfd68  r2 : 00000000  r1 : 00000200  r0 : 00000001

[    2.652105] Flags: nzCv  IRQs on  FIQs on  Mode SVC_32  ISA Thumb  Segment kernel

[    2.652111] Control: 70c5387d  Table: 50003000  DAC: fffffffd
I'll post the exact commands I used below. Does the current combination (staging xen+your kernel & u-boot+your u-boot env) work for you? No MMC driver crash?

Zozel
Posts: 38
Joined: Tue Nov 19, 2013 8:53 pm
languages_spoken: english
ODROIDs: ODROID-XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by Zozel » Wed Oct 01, 2014 11:18 pm

STEPS I WENT THROUGH:

1) XEN:

git clone git://xenbits.xen.org/xen.git -b staging --depth 1 xen-staging
cd xen-staging
export ARCH=arm [this might not be needed]
export CROSS_COMPILE=arm-linux-gnueabihf-
./configure
make dist-xen XEN_TARGET_ARCH=arm32 CONFIG_EARLY_PRINTK=exynos5410 debug=y
mkdir ../output
mkimage -A arm -T kernel -a 0x60000000 -e 0x60000000 -C none -d xen/xen ../output/xen-uImage
cd ..

2) DOM0:

git clone https://github.com/suriyanr/linux.git --depth 1 suriyan-linaro
cd suriyan-linaro
export ARCH=arm
export CROSS_COMPILE=arm-linux-gnueabihf-
make odroidxu_xen_defconfig
make zImage dtbs modules
mkdir ../output/MOD_PATH/
make modules_install INSTALL_MOD_PATH=../output/MOD_PATH/
cd ..

3) SD-card:

insert SD-card => /dev/sdb (and /dev/sdb1 is an ext3 partition containing the rootfs)
cd suriyan-linaro/sd_fuse
./sd_fusing.sh /dev/sdb [all well]
mount /dev/sdb1 /mnt/extern
rm -rf /mnt/extern/lib/modules/
rm -rf /mnt/extern/lib/firmware/
cp -R output/MOD_PATH/lib/firmware /mnt/extern/lib/
cp -R output/MOD_PATH/lib/modules /mnt/extern/lib/
umount /dev/sdb1

4) ...continue by inserting sd-card in board and booting xen...

No other details, but just an extra point - my setup is a bit different in the sense that:
* I formatted the SD-card, created only one ext3 partition and created a rootfs from scratch (which is why /dev/sdb1 is mounted above and not /dev/sdb2)
* I am loading zImage, the dtb and xen-uImage from PXE (which is why it was ok with me to leave only the partition containing the rootfs on the sd-card)

Zozel
Posts: 38
Joined: Tue Nov 19, 2013 8:53 pm
languages_spoken: english
ODROIDs: ODROID-XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by Zozel » Wed Oct 01, 2014 11:24 pm

If it works for you, the only thing left for me to blame would be my rootfs (although I don't see why the rootfs would have anything to do with this crash since the crash happens even before the mounting of rootfs is attempted).
On this note I'd appreciate it very much if (when you have the time) you could dd-copy your working sd-card contents in a prebuilt image and put it somewhere on the web.

Until then I'll await your response regarding whether the MMC driver crashes for you or not.

Thanks

Zozel
Posts: 38
Joined: Tue Nov 19, 2013 8:53 pm
languages_spoken: english
ODROIDs: ODROID-XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by Zozel » Wed Oct 01, 2014 11:49 pm

Only noticed this now.
Are you booting from eMMC? (mmcblk0?)
I'm using the external SD-card (which is seen as mmcblk1, not mmcblk0).

If so, this is certainly my problem, although on another relevant note: if I'm booting the zImage + dtb DIRECTLY i.e without xen, it all works perfectly (the rootfs is mounted, I have the login prompt).
I can't see why booting with XEN would screw this up :(

Thanks
Last edited by Zozel on Wed Oct 01, 2014 11:57 pm, edited 1 time in total.

Zozel
Posts: 38
Joined: Tue Nov 19, 2013 8:53 pm
languages_spoken: english
ODROIDs: ODROID-XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by Zozel » Wed Oct 01, 2014 11:56 pm

Zozel wrote:... (although I don't see why the rootfs would have anything to do with this crash since the crash happens even before the mounting of rootfs is attempted).

Thanks
Zozel wrote:Only noticed this now.
Are you booting from eMMC? (mmcblk0?)
I'm using the external SD-card (which is seen as mmcblk1, not mmcblk0).

If so, this is certainly my problem, although on another relevant note: if I'm booting the zImage + dtb without xen, it all works perfectly (the rootfs is mounted, I have the login prompt).
I can't see why booting with XEN would screw this up :(

Thanks
I'm getting stupid...again, eMMC booting vs SD-card booting shouldn't matter theoretically.

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Thu Oct 02, 2014 12:37 am

Hi Zozel, i am using sd card too. Can you please check that the zimage and dtb are the same with and without xen? Check for commit id and date please. I remember hitting the mmc rootfs crash when using the linaro 3.13.y tree from hardkernel.

Zozel
Posts: 38
Joined: Tue Nov 19, 2013 8:53 pm
languages_spoken: english
ODROIDs: ODROID-XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by Zozel » Thu Oct 02, 2014 12:49 am

Checked, they are the same.
Attached you have the different outputs - booting without Xen (i.e directly zImage + DTB) and booting with Xen.
zImage & DTB are most assuredly the same in both cases since they are loaded through PXE (same u-boot commands) and you can also draw that conclusion from kernel log.

Relevant lines:

Code: Select all

[    0.000000] Linux version 3.13.11+ (root@czuzu-VirtualBox) (gcc version 4.8.2 (Ubuntu/Linaro 4.8.2-16ubuntu4) ) #1 SMP Wed Oct 1 16:40:34 EEST 2014
[    0.000000] Kernel was built at commit id '5c7326c'
Attachments
xen_log.txt
Log when booting zImage as Dom0 of XEN
(54.01 KiB) Downloaded 202 times
noxen_log.txt
Log when booting zImage + DTB directly
(30.72 KiB) Downloaded 190 times

Zozel
Posts: 38
Joined: Tue Nov 19, 2013 8:53 pm
languages_spoken: english
ODROIDs: ODROID-XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by Zozel » Thu Oct 02, 2014 1:13 am

Suriyan, so for you Dom0's MMC driver doesn't crash ?

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Thu Oct 02, 2014 1:50 am

Zozel wrote:Suriyan, so for you Dom0's MMC driver doesn't crash ?
No it doesnt!

BTW, can you show the u-boot output when you boot XEN. Mainly I want to see the xen_bootargs and dom0_bootargs that you set.

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Thu Oct 02, 2014 1:57 am

I checked your dom0 args as seen in the xen boot log of dom0. They seem fine, except for one that I noticed: vmalloc=256M
Can you please check if that makes any difference. Also, do you set any dom0_mem?
Try to set those, and then we can debug some more.
Edit: I see you have set dom0 to 256 M. Can you to start with make it 768M and vmalloc to 256M and see if that resolves your issue.
Edit2: Definitely looks like a memory related issue. If you look at your xen boot log, notice the DMA failure:
DMA: failed to allocate 256 KiB pool for atomic coherent allocation
- Suriyan

Zozel
Posts: 38
Joined: Tue Nov 19, 2013 8:53 pm
languages_spoken: english
ODROIDs: ODROID-XU
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by Zozel » Thu Oct 02, 2014 2:31 am

Suriyan, guess what?

Code: Select all

* Stopping System V runlevel compatibility[74G[ OK ]
Linaro 14.04 linaro-developer hvc0

linaro-developer login: root

Password: 

Last login: Sat Jan  1 01:00:39 UTC 2000 on tty1

Welcome to Linaro 14.04 (GNU/Linux 3.13.11+ armv7l)


 * Documentation:  https://wiki.linaro.org/

root@linaro-developer:~# 
It was a memory related issue indeed.
Setting vmalloc=256M and dom0_mem=768M solved the MMC crash problem.

Thank you very very much!

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Thu Oct 02, 2014 2:55 am

Great that it got resolved! Awesomeness!!

suriyan
Posts: 473
Joined: Wed Jun 26, 2013 2:41 pm
languages_spoken: english
ODROIDs: odroid-u2/xu-e/u3/x2/xu3/c1
Has thanked: 0
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by suriyan » Sun Jul 05, 2015 12:47 am

Just for completeness sake, the XEN wiki has all the steps:
http://wiki.xenproject.org/wiki/Xen_ARM ... s/OdroidXU

GopikaBG
Posts: 26
Joined: Tue Dec 31, 2019 1:29 pm
languages_spoken: english
ODROIDs: odroid xu4
Has thanked: 4 times
Been thanked: 0
Contact:

Re: Xen 4.4 on the XU

Unread post by GopikaBG » Tue Jan 14, 2020 9:30 pm

HI,

Can someone please explain how domu get network in odroid.
xen dom0 and domu are booted up successfully

Post Reply

Return to “Projects”

Who is online

Users browsing this forum: No registered users and 1 guest