Add-on to H2 - M2 to pciE slot

User avatar
Mullcom
Posts: 94
Joined: Sun Jun 30, 2019 1:41 am
languages_spoken: english
Has thanked: 53 times
Been thanked: 6 times
Contact:

Add-on to H2 - M2 to pciE slot

Unread post by Mullcom » Mon Jul 08, 2019 6:44 am

I am trying to finding a way to add more networks ports and i may finding this item.

https://www.ebay.com/itm/M2-NGFF-NVMe-I ... 701?_ul=SE

Skickat från min SM-G955F via Tapatalk


There has ben so much good information in this thread so i am going to collect much of it and put it att first post. So it get easy for new readers.




Working progress down below.......

### ITEMS TO BUY

#ADDON

2X-SOCKET



4X-SOCKET
Four lanes PCIe - R42SR:
-Status :: not tested
-Link :: eBay , Aliexpress



16X-SOCKET
Four lanes PCIe - R43SF:
-Status :: not tested
-Link :: eBay , Aliexpress

#NETWORKCARD

More info Goto post



SSF

-Modell :: Mellanox ConnectX (Mellanox MT25408)
-Info :: Do work AOK on the H2
(No major issue detected so far, shutdown intermittent issue to be explored further)
-Link :: eBay (old card)
-Status :: working

-Modell :: Mellanox ConnectX-2 (Mellanox MHQH29C-XTR)
-Info :: dual Port with 40gbit
-Link :: eBay (old card)
-Status :: working

-Modell :: Mellanox ConnectX-3
-Status :: not working


RJ45

-Modell :: LR-link 10Gb (6880BT)
-Info ::
-Status :: not tested
-Link goto


### SCHEME OF THE CARD
PciX 4 lains
M2 pciX H2


### INFORMATIV TIPS FROM USERS

Domih deliver information. Go to Link

Domih deliver info about samba copy. Go to Link

RomiaT have a fix for Sara Arry drives

Go to post1 and post2













Last edited by Mullcom on Mon Jul 08, 2019 6:44 am, edited 17 times in total.

User avatar
odroid
Site Admin
Posts: 32368
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Has thanked: 147 times
Been thanked: 325 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by odroid » Mon Jul 08, 2019 10:49 am

One Korean user reported this adapter worked with a P400 video card.
https://www.aliexpress.com/item/32838873569.html

BTW, what do you want to make with 3~4 network ports?

brad
Posts: 969
Joined: Tue Mar 29, 2016 1:22 pm
languages_spoken: english
ODROIDs: C2 N1 N2 H2 (64 bit ftw)
Location: Australia
Has thanked: 16 times
Been thanked: 34 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by brad » Mon Jul 08, 2019 5:01 pm

I would like to test out the functionality for M.2 to PCIex4 as well and waiting for an adaptor I ordered to test it out. Here are my notes so far...

PLANNED INITIAL SETUP

- M.2 to PCIe x 4 adaptor (M Key type)
I ordered an ATD link adaptor - http://www.adt.link/product/R42.html (I ordered R42SL but I think it should have been R42SR to make it best fit)

- Radeon RX 470 Graphics Card
I have one of these already for testing which is used in another machine and try to turn this H2 into a mini portable gaming machine.

- External Power via PC PSU for initial testing
I think I will power the PCIE socket with HDD power source on the H2, this will allow the H2 to turn off the PCIe port (and disconnect the cards external power source on shutdown). External power to to the GPU's 6 pins power will be supplied initially via PC ATX power source for testing

If the PCIE slot works as expected I have a few cards to try. I expect to hit bandwidth limitations with the GPU as pcie x 4 2.0 but will be interesting to see how well it performs if it works.

- GPU listed above Radeon RX 470 Graphics Card
- Gigabit network interface
- PCIE firewire card (for interfacing to an older Audio interface I have - make it into a DSP machine with realtime linux kernel)

If all goes well then I need to make a new case for the H2 with a PCIE slot and then find a way to supply a adequate level of power (for GPU) using a small form factor 12v power supply inside the case as well. It will have a slot for at least 1 SSD as well.

Hopefully I don't set fire to anything with my experiment :) I plan to test some gaming performance and compute power.
Last edited by brad on Mon Jul 08, 2019 5:36 pm, edited 1 time in total.

User avatar
Mullcom
Posts: 94
Joined: Sun Jun 30, 2019 1:41 am
languages_spoken: english
Has thanked: 53 times
Been thanked: 6 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by Mullcom » Mon Jul 08, 2019 5:20 pm

odroid wrote:One Korean user reported this adapter worked with a P400 video card.
https://www.aliexpress.com/item/32838873569.html

BTW, what do you want to make with 3~4 network ports?
Hello.

I am building me a router and use H2 to Handel all my traffic in the future.

I don't know yet if i am going for SFP or more Ethernet rj45.

I need to calculate how much BW 4 lines can give. And investigate if there are network card that can take workload so CPU don't need to work all the time.



Skickat från min SM-G955F via Tapatalk


User avatar
Mullcom
Posts: 94
Joined: Sun Jun 30, 2019 1:41 am
languages_spoken: english
Has thanked: 53 times
Been thanked: 6 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by Mullcom » Mon Jul 08, 2019 5:39 pm

brad wrote:I would like to test out the functionality for M.2 to PCIex4 as well and waiting for an adaptor I ordered to test it out. Here are my notes so far...

PLANNED INITIAL SETUP

- M.2 to PCIe x 2 adaptor (M Key type)
I ordered an ATD link adaptor - http://www.adt.link/product/R42.html (I ordered R42SL but I think it should have been R42SR to make it best fit)

- Radeon RX 470 Graphics Card
I have one of these already for testing which is used in another machine and try to turn this H2 into a mini portable gaming machine.

- External Power via PC PSU for initial testing
I think I will power the PCIE socket with HDD power source on the H2, this will allow the H2 to turn off the PCIe port (and disconnect the cards external power source on shutdown). External power to to the GPU's 6 pins power will be supplied initially via PC ATX power source for testing

If the PCIE slot works as expected I have a few cards to try. I expect to hit bandwidth limitations with the GPU as pcie x 4 2.0 but will be interesting to see how well it performs if it works.

- GPU listed above Radeon RX 470 Graphics Card
- Gigabit network interface
- PCIE firewire card (for interfacing to an older Audio interface I have - make it into a DSP machine with realtime linux kernel)

If all goes well then I need to make a new case for the H2 with a PCIE slot and then find a way to supply a adequate level of power (for GPU) using a small form factor 12v power supply inside the case as well. It will have a slot for at least 1 SSD as well.

Hopefully I don't set fire to anything with my experiment :) I plan to test some gaming performance and compute power.
Hello. I look forward to your project. We are out in the same thing.

First I find the card that didn't have extended cabel. But these would be complicated in an installation. This going to take up to much space because os how pciE port is pointed wrong way.

https://image.dhgate.com/0x0s/f2-albu-g ... card-m.jpg

My setup going to be to build this into my rack directly and then try to find out if i can deliver power from a din Rail that have power module on it.


I yast get my pi4 and look forward to test that out and see what i cam do with that. ;)

Skickat från min SM-G955F via Tapatalk


RomaT
Posts: 235
Joined: Thu Oct 23, 2014 4:48 pm
languages_spoken: Russian
ODROIDs: -H2 rev.B, -XU3, -XU4, -C1, -C2, -W, -VU, CloudShell
Location: Perm, Russia
Has thanked: 6 times
Been thanked: 42 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by RomaT » Tue Jul 09, 2019 3:16 am

It will look something like this:
.
P7010915s.JPG
P7010915s.JPG (221.54 KiB) Viewed 4651 times
.
P7010908s.JPG
P7010908s.JPG (183.77 KiB) Viewed 4651 times
.
P7010890s.JPG
P7010890s.JPG (194.73 KiB) Viewed 4651 times
.
P7010889s.JPG
P7010889s.JPG (174.67 KiB) Viewed 4651 times
.
P7010892s.JPG
P7010892s.JPG (139.28 KiB) Viewed 4648 times
These users thanked the author RomaT for the post:
rmkimathi (Mon Jul 15, 2019 4:25 am)

User avatar
Mullcom
Posts: 94
Joined: Sun Jun 30, 2019 1:41 am
languages_spoken: english
Has thanked: 53 times
Been thanked: 6 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by Mullcom » Tue Jul 09, 2019 4:18 am

Thx for the pics. Lovely

With that setup make the network ports going on other side then the other on the bord. maybe not the big deal for many but I will try to get them in the same direction then also the pciE card will lie down and not build as much.



Skickat från min SM-G955F via Tapatalk


RomaT
Posts: 235
Joined: Thu Oct 23, 2014 4:48 pm
languages_spoken: Russian
ODROIDs: -H2 rev.B, -XU3, -XU4, -C1, -C2, -W, -VU, CloudShell
Location: Perm, Russia
Has thanked: 6 times
Been thanked: 42 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by RomaT » Tue Jul 09, 2019 1:22 pm

Only it seems to me that in your photo the adapter only has 2 lanes of PCIe,
.
m2-pcie2.jpg
m2-pcie2.jpg (32.4 KiB) Viewed 4596 times
.
and on my photo adapter holds all 4 lanes of PCIe.
.
m2-pcie4.jpg
m2-pcie4.jpg (16 KiB) Viewed 4596 times

.
m2-pcie4-odroidh2.jpg
m2-pcie4-odroidh2.jpg (189.56 KiB) Viewed 4589 times
.
m2-cokolevka.jpg
m2-cokolevka.jpg (68.96 KiB) Viewed 4558 times
pciex4.gif
pciex4.gif (24.58 KiB) Viewed 4557 times
Last edited by RomaT on Tue Jul 09, 2019 3:43 pm, edited 3 times in total.

User avatar
Mullcom
Posts: 94
Joined: Sun Jun 30, 2019 1:41 am
languages_spoken: english
Has thanked: 53 times
Been thanked: 6 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by Mullcom » Tue Jul 09, 2019 1:35 pm

That are not pciE lains. It is power right?

Anyway i am going to buy somting like that i post at the top of this thread.

Skickat från min SM-G955F via Tapatalk


RomaT
Posts: 235
Joined: Thu Oct 23, 2014 4:48 pm
languages_spoken: Russian
ODROIDs: -H2 rev.B, -XU3, -XU4, -C1, -C2, -W, -VU, CloudShell
Location: Perm, Russia
Has thanked: 6 times
Been thanked: 42 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by RomaT » Tue Jul 09, 2019 2:24 pm

power supply +12V to the PCI-E slot should come from a separate power source.
This is to power the devices of the connected PCI-E slot.
On the M.2 connector it is not and will not sustain power PCI-E devices.

brad
Posts: 969
Joined: Tue Mar 29, 2016 1:22 pm
languages_spoken: english
ODROIDs: C2 N1 N2 H2 (64 bit ftw)
Location: Australia
Has thanked: 16 times
Been thanked: 34 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by brad » Tue Jul 09, 2019 6:08 pm

RomaT wrote:
Tue Jul 09, 2019 2:24 pm
power supply +12V to the PCI-E slot should come from a separate power source.
This is to power the devices of the connected PCI-E slot.
On the M.2 connector it is not and will not sustain power PCI-E devices.
Hi RomaT,
Im trying to work out power supplies for GPU whilst I wait for my adaptor to arrive

- My understanding is the 12v supply (SATA power) can supply up to 12v 3A and specs for PCIe x4 on the slot are 2.1A max (when using riser board)
- Controlling riser slot 12v power (drawn from SATA supply) will allow the card to operate (including the fans and turning off / on power on the external 6/8 pin 12v supply)
- External 12v power connected to 6 pin connector on the GPU

What are your thoughts here? It might get tight on the SATA supply if I use HDD but for SSD I think it will be under 3A when combined with GPU (slot only 12v power not external)

Thanks,
Brad.

brad
Posts: 969
Joined: Tue Mar 29, 2016 1:22 pm
languages_spoken: english
ODROIDs: C2 N1 N2 H2 (64 bit ftw)
Location: Australia
Has thanked: 16 times
Been thanked: 34 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by brad » Thu Jul 11, 2019 5:44 pm

Success :)

I received the M.2 to PCIe x4 adaptor (it actually has x16 slot) and hooked it all up with temporary external power (both for the riser board and the external 6 pin 12v supply)

- Windows 10
- Connected Radeon RX 470 Graphics Card and installed drivers
- Needed to disable the UHD 600 device in windows device manager (it was acting as GPU core but strangely using the RX 470's 4Gb RAM dedicated RAM)

- Running World of Warcraft I could turn up graphics all the way and 25FPS at 1280p
- Recommended graphics setting was 7 out of 10 and this produced 40FPS
- Lowest settings run at 60FPS (much better quality than lowest settings with UHD 600 which run at 30FPS)

Overall a fantastic result considering the card is running in 4x PCIe 2.0 mode. I'm going to play Warcraft for a bit now (lets call it an endurance test) and then try PUBG later on. I should have purchased the R42SR adaptor rather than R42SL as the card is facing backwards (I will order another) but the proof concept works.

On the weekend i'm going to look at now to incorporate this into a case, the GPU card is larger than the H2 lol

User avatar
odroid
Site Admin
Posts: 32368
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Has thanked: 147 times
Been thanked: 325 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by odroid » Thu Jul 11, 2019 6:20 pm

Very interesting.
Please show us a picture of your hardware configuration.

brad
Posts: 969
Joined: Tue Mar 29, 2016 1:22 pm
languages_spoken: english
ODROIDs: C2 N1 N2 H2 (64 bit ftw)
Location: Australia
Has thanked: 16 times
Been thanked: 34 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by brad » Thu Jul 11, 2019 6:48 pm

odroid wrote:
Thu Jul 11, 2019 6:20 pm
Very interesting.
Please show us a picture of your hardware configuration.
Its all very temporary at the moment but here are some quick pics.

I had some issues issues with the Radeon wattman driver crashing when card is under load. I also had similar issues on another machine with the card o I will check the problem (I think it has to to with the overlay support for the Radeon)

Also the card is dirty in the photos it needs a clean :o It

All power is supplied from an ATX power supply atm (photos don't show the other 6 pin power connector sorry)
20190711_193348.jpg
20190711_193348.jpg (378.65 KiB) Viewed 4404 times
20190711_193249.jpg
20190711_193249.jpg (433.75 KiB) Viewed 4404 times
20190711_193414.jpg
20190711_193414.jpg (488.62 KiB) Viewed 4404 times

User avatar
odroid
Site Admin
Posts: 32368
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Has thanked: 147 times
Been thanked: 325 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by odroid » Thu Jul 11, 2019 7:07 pm

Thank you for the pictures.
Wow.. really massive and complicated configuration. :o

brad
Posts: 969
Joined: Tue Mar 29, 2016 1:22 pm
languages_spoken: english
ODROIDs: C2 N1 N2 H2 (64 bit ftw)
Location: Australia
Has thanked: 16 times
Been thanked: 34 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by brad » Thu Jul 11, 2019 7:30 pm

odroid wrote:
Thu Jul 11, 2019 7:07 pm
Thank you for the pictures.
Wow.. really massive and complicated configuration. :o
You know me odroid always playing with something a little extreme :lol:

Plan is to make it as small as possible with another power supply inside a case (with a fan for H2 in this instance, gpu has 2)

At least I can have fun playing games instead of my head buried in linux kernel code this time :geek:

RomaT
Posts: 235
Joined: Thu Oct 23, 2014 4:48 pm
languages_spoken: Russian
ODROIDs: -H2 rev.B, -XU3, -XU4, -C1, -C2, -W, -VU, CloudShell
Location: Perm, Russia
Has thanked: 6 times
Been thanked: 42 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by RomaT » Thu Jul 11, 2019 7:37 pm

:) Can use a small sized card, for example Gigabyte GeForce RTX 2070 MINI ITX or MSI GeForce RTX 2070 AERO ITX
.
rtx2070s.jpg
rtx2070s.jpg (215.28 KiB) Viewed 4374 times
Last edited by RomaT on Thu Jul 11, 2019 7:42 pm, edited 1 time in total.

User avatar
odroid
Site Admin
Posts: 32368
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Has thanked: 147 times
Been thanked: 325 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by odroid » Thu Jul 11, 2019 7:39 pm

I have to agree Windows is a painless OS to play modern games for refreshing our brain. ;)

brad
Posts: 969
Joined: Tue Mar 29, 2016 1:22 pm
languages_spoken: english
ODROIDs: C2 N1 N2 H2 (64 bit ftw)
Location: Australia
Has thanked: 16 times
Been thanked: 34 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by brad » Thu Jul 11, 2019 8:09 pm

Changing to DX11 fixed my stability problems for Warcraft so don't think the hardware had any issues. I think a smaller GPU as per @RomaT is ideal as the Rx470 runs only at around 30% capacity max and smaller GPU would fit much nicer into a case.

Edit: Yes DirectX 11 graphics turned all the way up at constant 40FPS is stable! (well 30FPS in background as per image) Radeon sits at 20% GPU mostly now. here is a pic

Screenshot (2).png
Screenshot (2).png (2.52 MiB) Viewed 4353 times

brad
Posts: 969
Joined: Tue Mar 29, 2016 1:22 pm
languages_spoken: english
ODROIDs: C2 N1 N2 H2 (64 bit ftw)
Location: Australia
Has thanked: 16 times
Been thanked: 34 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by brad » Thu Jul 11, 2019 9:13 pm

experienced some less frequent stability problems even with DX11, seems fixed with windows default drivers for rx470 (no fancy Radeon wattman or game overlay performance monitoring tools)

As a bonus between 40 - 50 FPS at full graphics :) another win card running at 30% power now.

PUBG runs well too :) Now installing GTA5.

As a side note one the the realtek PHY was dropping out downloading - event viewer reported not responding (35Mb/s then starting dropping out after 100Gb download) plugged into the other port and back up and running.
The network interface "Realtek PCIe GbE Family Controller" has begun resetting. There will be a momentary disruption in network connectivity while the hardware resets. Reason: The network driver detected that its hardware has stopped responding to commands. This network interface has reset 11 time(s) since it was last initialized.

User avatar
odroid
Site Admin
Posts: 32368
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Has thanked: 147 times
Been thanked: 325 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by odroid » Fri Jul 12, 2019 8:06 am

40~50FPS :o Looks beautiful!

BTW, was the Ethernet issue appearing while you playing game?

brad
Posts: 969
Joined: Tue Mar 29, 2016 1:22 pm
languages_spoken: english
ODROIDs: C2 N1 N2 H2 (64 bit ftw)
Location: Australia
Has thanked: 16 times
Been thanked: 34 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by brad » Fri Jul 12, 2019 11:15 am

odroid wrote:
Fri Jul 12, 2019 8:06 am
40~50FPS :o Looks beautiful!

BTW, was the Ethernet issue appearing while you playing game?
The Ethernet problem only occurred during heavy download (60Mb/s) ~ 80Gb not during normal gameplay, not sure if it was a windows driver problem or something else at this stage. I will keep an eye on this.

User avatar
mad_ady
Posts: 6681
Joined: Wed Jul 15, 2015 5:00 pm
languages_spoken: english
ODROIDs: XU4, C1+, C2, N1, H2, N2
Location: Bucharest, Romania
Has thanked: 194 times
Been thanked: 148 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by mad_ady » Fri Jul 12, 2019 12:35 pm

I haven't noticed ethernet outages in the brief time I had windows on the H2. I transferred over 100G over lan, at gigabit speeds (but only on port 1)

User avatar
Mullcom
Posts: 94
Joined: Sun Jun 30, 2019 1:41 am
languages_spoken: english
Has thanked: 53 times
Been thanked: 6 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by Mullcom » Fri Jul 12, 2019 3:01 pm

mad_ady wrote:I haven't noticed ethernet outages in the brief time I had windows on the H2. I transferred over 100G over lan, at gigabit speeds (but only on port 1)
Hello. This might be a problem for me because i am going to use this bord as router.

I can try to benchmark Ethernet ports in freebsd. And see if this doing the same thing.



Skickat från min SM-G955F via Tapatalk


User avatar
Mullcom
Posts: 94
Joined: Sun Jun 30, 2019 1:41 am
languages_spoken: english
Has thanked: 53 times
Been thanked: 6 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by Mullcom » Fri Jul 12, 2019 3:07 pm

brad wrote:
RomaT wrote:
Tue Jul 09, 2019 2:24 pm
power supply +12V to the PCI-E slot should come from a separate power source.
This is to power the devices of the connected PCI-E slot.
On the M.2 connector it is not and will not sustain power PCI-E devices.
Hi RomaT,
Im trying to work out power supplies for GPU whilst I wait for my adaptor to arrive

- My understanding is the 12v supply (SATA power) can supply up to 12v 3A and specs for PCIe x4 on the slot are 2.1A max (when using riser board)
- Controlling riser slot 12v power (drawn from SATA supply) will allow the card to operate (including the fans and turning off / on power on the external 6/8 pin 12v supply)
- External 12v power connected to 6 pin connector on the GPU

What are your thoughts here? It might get tight on the SATA supply if I use HDD but for SSD I think it will be under 3A when combined with GPU (slot only 12v power not external)

Thanks,
Brad.
Hej Brad.

How about adding a 3Am battery to the GPU?

This should take care of the high amount of power when it start up. And battery can make some stability of power consumption.

This perhaps can limit out the big PWS.?

Skickat från min SM-G955F via Tapatalk


domih
Posts: 137
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, H2.
Has thanked: 42 times
Been thanked: 35 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by domih » Sun Jul 14, 2019 4:12 pm

odroid wrote:
Mon Jul 08, 2019 10:49 am
One Korean user reported this adapter worked with a P400 video card.
https://www.aliexpress.com/item/32838873569.html

BTW, what do you want to make with 3~4 network ports?
I wonder how the user connects it to the H2. The URL you provide leads to a CHIPAL Mini PCI-E to PCI-E 16X Riser Card. Mini PCIe does not fit into an M.2 connector.

Are you sure this is the right URL?

domih
Posts: 137
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, H2.
Has thanked: 42 times
Been thanked: 35 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by domih » Sun Jul 14, 2019 4:18 pm

I believe this is the right URL: https://www.aliexpress.com/item/32826512820.html (CHIPAL NGFF M.2 M Key to USB 3.0 PCI-E Riser Card M2 to USB3.0 PCIE 16X)

And hopefully, it does carry the 4 lanes. Apparently it does, a Russian customer says he uses it with a graphical card.

RomaT
Posts: 235
Joined: Thu Oct 23, 2014 4:48 pm
languages_spoken: Russian
ODROIDs: -H2 rev.B, -XU3, -XU4, -C1, -C2, -W, -VU, CloudShell
Location: Perm, Russia
Has thanked: 6 times
Been thanked: 42 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by RomaT » Sun Jul 14, 2019 4:27 pm

domih wrote:
Sun Jul 14, 2019 4:18 pm
a Russian customer says he uses it with a graphical card.
therein the message says
odroid wrote:
Mon Jul 08, 2019 10:49 am
One Korean user reported this adapter worked with a P400 video card.
https://www.aliexpress.com/item/32838873569.html
This is an obvious mistake, apparently meant something from this:
https://www.aliexpress.com/store/group/ ... 67462.html
and that dubious adapters for PCI-E, moreover, only one lane PCIe ...
(one USB connector, four pins, can only hold one PCIe lane, for 4 lanes PCIe you need to be 4 USB connectors)
I would prefer a normal adapter with four lanes PCIe - R42SL: https://www.aliexpress.com/item/32833359557.html
or with 4 lanes with x16 slot - R43SL: https://www.aliexpress.com/item/32830809871.html
I currently have adapter with four lanes PCIe: https://www.aliexpress.com/item/32826500318.html
in my photo other computer, in the format of miniITX - Motherboard Asus ROG STRIX Z390-I GAMING with graphical card Gigabyte GeForce RTX 2070 MINI ITX
It shows simply that it is possible to use small-sized graphical card ...
Last edited by RomaT on Sun Jul 14, 2019 7:29 pm, edited 1 time in total.
These users thanked the author RomaT for the post (total 2):
domih (Mon Jul 15, 2019 10:11 am) • Mullcom (Mon Jul 15, 2019 5:10 pm)

brad
Posts: 969
Joined: Tue Mar 29, 2016 1:22 pm
languages_spoken: english
ODROIDs: C2 N1 N2 H2 (64 bit ftw)
Location: Australia
Has thanked: 16 times
Been thanked: 34 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by brad » Sun Jul 14, 2019 7:19 pm

brad wrote:
Fri Jul 12, 2019 11:15 am
The Ethernet problem only occurred during heavy download (60Mb/s) ~ 80Gb not during normal gameplay, not sure if it was a windows driver problem or something else at this stage. I will keep an eye on this.
This happened a few more times (has occurred on both ethernet ports) these times whilst watching netflix. I've updated to the latest drivers from https://www.realtek.com/en/downloads and will see if it happens again.
These users thanked the author brad for the post:
Mullcom (Mon Jul 15, 2019 5:11 pm)

domih
Posts: 137
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, H2.
Has thanked: 42 times
Been thanked: 35 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by domih » Mon Jul 15, 2019 10:13 am

RomaT wrote:
Sun Jul 14, 2019 4:27 pm
I would prefer a normal adapter with four lanes PCIe - R42SL: https://www.aliexpress.com/item/32833359557.html
or with 4 lanes with x16 slot - R43SL: https://www.aliexpress.com/item/32830809871.html
I currently have adapter with four lanes PCIe: https://www.aliexpress.com/item/32826500318.html
Thanks! I ordered them.

domih
Posts: 137
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, H2.
Has thanked: 42 times
Been thanked: 35 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by domih » Mon Jul 15, 2019 10:33 am

domih wrote:
Mon Jul 15, 2019 10:13 am
RomaT wrote:
Sun Jul 14, 2019 4:27 pm
I would prefer a normal adapter with four lanes PCIe - R42SL: https://www.aliexpress.com/item/32833359557.html
or with 4 lanes with x16 slot - R43SL: https://www.aliexpress.com/item/32830809871.html
I currently have adapter with four lanes PCIe: https://www.aliexpress.com/item/32826500318.html
Thanks! I ordered them.
1) Regarding the power, I'm using the 15V/4A US Power Supply from AmeriDroid (https://ameridroid.com/products/15v-4a-power-supply). According to my humble knowledge that 60W. I'm going to try using a PCIe network card that is said to suck 11.5W. If we add the power consumption of the CPU, memory, disk,... even if the total reaches 30/40W the 15V/4A US Power Supply should be able to take it, mm?

2) Will the PCIe 4x connector carry the 12v or do I need to also power the R24xx adapter? If so, is that the purpose of the white 4-pin thingy?

RomaT
Posts: 235
Joined: Thu Oct 23, 2014 4:48 pm
languages_spoken: Russian
ODROIDs: -H2 rev.B, -XU3, -XU4, -C1, -C2, -W, -VU, CloudShell
Location: Perm, Russia
Has thanked: 6 times
Been thanked: 42 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by RomaT » Mon Jul 15, 2019 12:34 pm

Yes, you need to apply +12V to the M.2 to PCI-E slot adapter, to the "Floppy" connector, As shown in the photo brad.
in the M.2 connector there is no power +12V, respectively, the network card is not on, so you need to submit separately.
.
m2-cokolevka.jpg
m2-cokolevka.jpg (68.96 KiB) Viewed 3917 times
.
if the network card consumes up to 12W, respectively, the current consumption will be less than 1A.
What is acceptable for the SATA power connector on H2, to take from it the supply voltage of +12V.
the adapter M.2 to PCIe itself does not consume energy, he simply spends contacts PCI-E slot.
pciex4.gif
pciex4.gif (24.58 KiB) Viewed 3918 times
These users thanked the author RomaT for the post:
domih (Mon Jul 15, 2019 11:28 pm)

RomaT
Posts: 235
Joined: Thu Oct 23, 2014 4:48 pm
languages_spoken: Russian
ODROIDs: -H2 rev.B, -XU3, -XU4, -C1, -C2, -W, -VU, CloudShell
Location: Perm, Russia
Has thanked: 6 times
Been thanked: 42 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by RomaT » Mon Jul 15, 2019 2:49 pm

domih wrote:
Mon Jul 15, 2019 10:13 am
Thanks! I ordered them.
Happy to help.
I also ordered a slot adapter M.2 M to PCI-E x4 - R42SL, but I plan a network card easier https://www.aliexpress.com/item/33044523279.html
Although it may be enough to combine on board network cards in BOND, getting a speed of 2GbE with a regular 1Gb/s switch.
and I plan to connect hard drives to the expander https://wiki.odroid.com/odroid-h2/appli ... ata_drives
ordered here https://www.aliexpress.com/item/32899742104.html
to create NAS-server viewtopic.php?f=172&t=35309&p=262087#p262087
These users thanked the author RomaT for the post:
domih (Mon Jul 15, 2019 11:32 pm)

domih
Posts: 137
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, H2.
Has thanked: 42 times
Been thanked: 35 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by domih » Mon Jul 15, 2019 11:40 pm

RomaT wrote:
Mon Jul 15, 2019 2:49 pm
Although it may be enough to combine on board network cards in BOND, getting a speed of 2GbE with a regular 1Gb/s switch.
So I guess we are now both waiting for Aliexpress deliveries... :-)

Regarding bonding the two onboard 1GbE NICs, it provides you with "overall" 2GbE potential bandwitdh, meaning you could have two clients talking at 1GbE simultaneously. On the other hand it does not provide you with a unique session at 2GbE. Right?

RomaT
Posts: 235
Joined: Thu Oct 23, 2014 4:48 pm
languages_spoken: Russian
ODROIDs: -H2 rev.B, -XU3, -XU4, -C1, -C2, -W, -VU, CloudShell
Location: Perm, Russia
Has thanked: 6 times
Been thanked: 42 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by RomaT » Mon Jul 15, 2019 11:46 pm

It is true, until you see the second dual-interface ;)

brad
Posts: 969
Joined: Tue Mar 29, 2016 1:22 pm
languages_spoken: english
ODROIDs: C2 N1 N2 H2 (64 bit ftw)
Location: Australia
Has thanked: 16 times
Been thanked: 34 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by brad » Tue Jul 16, 2019 6:08 pm

brad wrote:
Sun Jul 14, 2019 7:19 pm
brad wrote:
Fri Jul 12, 2019 11:15 am
The Ethernet problem only occurred during heavy download (60Mb/s) ~ 80Gb not during normal gameplay, not sure if it was a windows driver problem or something else at this stage. I will keep an eye on this.
This happened a few more times (has occurred on both ethernet ports) these times whilst watching netflix. I've updated to the latest drivers from https://www.realtek.com/en/downloads and will see if it happens again.
OK so far no more problems with the updated realtek drivers (from realtek site not standard windows installed drivers - 3 -4 years in difference in the version)

I will make a new thread (should have done this initially) to report the success / solution or the remaining issue in a weeks time once I have tested more.

User avatar
odroid
Site Admin
Posts: 32368
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Has thanked: 147 times
Been thanked: 325 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by odroid » Wed Jul 17, 2019 10:11 am

@brad,
Please consider writing an article about the PCIe video card adventure on the H2 for our Magazine. ;)

brad
Posts: 969
Joined: Tue Mar 29, 2016 1:22 pm
languages_spoken: english
ODROIDs: C2 N1 N2 H2 (64 bit ftw)
Location: Australia
Has thanked: 16 times
Been thanked: 34 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by brad » Thu Jul 18, 2019 8:03 pm

odroid wrote:
Wed Jul 17, 2019 10:11 am
@brad,
Please consider writing an article about the PCIe video card adventure on the H2 for our Magazine. ;)
It would be my pleasure @odroid, I have been using the H2 as my main machine for entertainment, games and work for the past few weeks. The old windows PC has been retired for the moment :) (powered off)

RomaT
Posts: 235
Joined: Thu Oct 23, 2014 4:48 pm
languages_spoken: Russian
ODROIDs: -H2 rev.B, -XU3, -XU4, -C1, -C2, -W, -VU, CloudShell
Location: Perm, Russia
Has thanked: 6 times
Been thanked: 42 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by RomaT » Fri Jul 19, 2019 1:41 am

You turned "DISABLED" in the BIOS setting "PCI-E Clock Gating"? To work graphic card?

brad
Posts: 969
Joined: Tue Mar 29, 2016 1:22 pm
languages_spoken: english
ODROIDs: C2 N1 N2 H2 (64 bit ftw)
Location: Australia
Has thanked: 16 times
Been thanked: 34 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by brad » Fri Jul 19, 2019 4:07 pm

RomaT wrote:
Fri Jul 19, 2019 1:41 am
You turned "DISABLED" in the BIOS setting "PCI-E Clock Gating"? To work graphic card?
It was actually still set to enabled, did not appear to make any difference when I tried just now to set it disabled

domih
Posts: 137
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, H2.
Has thanked: 42 times
Been thanked: 35 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by domih » Wed Jul 24, 2019 10:32 pm

I received the ADT-Link M.2 to PCIe x4. So far, no go. I tried two cards: a 4-port SATA Marvell and a Mellanox network card. The thing is simple: I see nothing, peanuts, nada, "rien du tout". No show in lspci, dmidecode or dmesg. For the latter I compared (diff) dmesg | grep pci when the adapter (and a card) is plugged-in and when it is not: there are the same, no error raised. I tried getting the power from one of the SATA power port and then from a separate PSU, in both cases I checked that the yellow wire showed 12+v and the red one 5+v at the floppy-like connector. Fine. I tried On/Off on the top BIOS options for PCIe. Obviously if I power down, remove the adapter, plug-in an NVMe back the NVMe shows up OK on next boot at 00:01.0. So beside regrouping and thinking about the next actions (right now I draw a blank) the first attempt was a big non-event. Running Ubuntu 19.04, kernel 5.0.0-20. See attached picture. Any help will be rewarded with a warm bear hug :D
Attachments
Screenshot at 2019-07-24 06-28-18.png
Screenshot at 2019-07-24 06-28-18.png (2.67 MiB) Viewed 3261 times

RomaT
Posts: 235
Joined: Thu Oct 23, 2014 4:48 pm
languages_spoken: Russian
ODROIDs: -H2 rev.B, -XU3, -XU4, -C1, -C2, -W, -VU, CloudShell
Location: Perm, Russia
Has thanked: 6 times
Been thanked: 42 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by RomaT » Wed Jul 24, 2019 10:50 pm

I think the contact break in the wire, because 4-port SATA Marvell exactly works in M.2
.
h2-sata.png
h2-sata.png (74.34 KiB) Viewed 3249 times

domih
Posts: 137
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, H2.
Has thanked: 42 times
Been thanked: 35 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by domih » Thu Jul 25, 2019 3:13 am

RomaT wrote:
Wed Jul 24, 2019 10:50 pm
I think the contact break in the wire, because 4-port SATA Marvell exactly works in M.2
I also ordered the other one with the PCIe slot directly on top (the other URL you posted earlier). Not received yet. If it works with that one, I'll return the ADT-Link for replacement. If not, that will be the start of a long path to find out what the hell is going on.

domih
Posts: 137
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, H2.
Has thanked: 42 times
Been thanked: 35 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by domih » Thu Jul 25, 2019 3:27 am

And...
Attachments
bear-hug.jpg
bear-hug.jpg (37.95 KiB) Viewed 3208 times

domih
Posts: 137
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, H2.
Has thanked: 42 times
Been thanked: 35 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by domih » Fri Jul 26, 2019 1:34 pm

Success. I dropped Ubuntu 19.04 and installed Ubuntu 18.04. Why? Because the Ubuntu 19.04 installer could not boot on my new AMD 3900x while 18.04 installed and is up and running fine (I just had to install the Intel ax backport driver to get the wireless working).

So, why not try the same maneuver on my H2 to solve the PCIe conundrum :D

The other reason I did that is also because I received the M.2 to PCIe 1x(*) which I tried unsuccessully too. So one bad connection on one product, maybe, two bad connections on two products from different vendors at the same time, nah.

(*) Yeah that stupid Bitcoin miner thingy which I ordered before seeing RomaT posts. At least it was useful in pointing the way...

It did not work right away but after multiple trials, yes I had to disable the PCIe Clock Gating to finally see the 4-port SATA Marvell in lspci:

Code: Select all

domih@h2a:~$ lspci
.../... 
01:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9230 PCIe SATA 6Gb/s Controller (rev 11)
.../...
domih@h2a:~$ sudo lspci -vvv -s 01:00.0
01:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9230 PCIe SATA 6Gb/s Controller (rev 11) (prog-if 01 [AHCI 1.0])
	Subsystem: Marvell Technology Group Ltd. 88SE9230 PCIe SATA 6Gb/s Controller
.../...
		LnkCap:	Port #0, Speed 5GT/s, Width x2, ASPM L0s L1, Exit Latency L0s <512ns, L1 <64us
.../...
		LnkSta:	Speed 5GT/s, Width x2, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
.../...
I played with it a little bit connecting 3 hard disks which I was able to mount. I did not try much and the disks (WD Red 10 and 4 TB) were spinning down quickly and would not spin back up when I try to access them. I'm sure there is some magical configuration incantation to address this.

For those interested it is this card: https://www.aliexpress.com/item/32959939140.html
For more information, see https://www.marvell.com/storage/system- ... -brief.pdf
The 88SE9230 includes HyperDuo which should be interesting for Windows 10 users. For Linux users, LVM2 tiering will do the same thing for any SATA including the 2 built-in of the H2. For HyperDuo see the brief at: https://www.marvell.com/storage/system- ... /hyperduo/

So I dropped the Marvell SATA card and plugged-in a Mellanox ConnectX-3. No, niet! Never saw it.

So I dropped the Mellanox ConnectX-3 and plugged-in a Mellanox ConnectX IB (an antique from 2009 but still provides up to 40Gbps IB). Yes, da!

Code: Select all

domih@h2a:~$ lspci
.../...
01:00.0 InfiniBand: Mellanox Technologies MT25408A0-FCC-QI ConnectX, Dual Port 40Gb/s InfiniBand / 10GigE Adapter IC with PCIe 2.0 x8 5.0GT/s In... (rev a0)
.../...
domih@h2a:~$ sudo lspci -vvv -s 01:00.0
01:00.0 InfiniBand: Mellanox Technologies MT25408A0-FCC-QI ConnectX, Dual Port 40Gb/s InfiniBand / 10GigE Adapter IC with PCIe 2.0 x8 5.0GT/s In... (rev a0)
.../...
		LnkCap:	Port #8, Speed 5GT/s, Width x8, ASPM L0s, Exit Latency L0s unlimited, L1 unlimited
.../...
		LnkSta:	Speed 5GT/s, Width x4, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
.../...
I then Installed the Mellanox OFED software (takes 10 minutes to build the DKMS) and rebooted. I then configured the IB card, the network and modprobe ib_ipoib for IP over InfiniBand.

Let's see what we have on the IB network:

Code: Select all

root@h2a:~# iblinkinfo
CA: v16 HCA-1:
      0xf45214030087c6f1      6    1[  ] ==( 4X          10.0 Gbps Active/  LinkUp)==>       2    3[  ] "Infiniscale-IV Mellanox Technologies" ( )
CA: i5-a HCA-1:
      0x0002c90300426771      3    1[  ] ==( 4X          10.0 Gbps Active/  LinkUp)==>       2    2[  ] "Infiniscale-IV Mellanox Technologies" ( )
CA: MAXIMUS:
      0x0010e00001675f69      4    1[  ] ==( 4X          10.0 Gbps Active/  LinkUp)==>       2    1[  ] "Infiniscale-IV Mellanox Technologies" ( )
Switch: 0x0002c902004a3e78 Infiniscale-IV Mellanox Technologies:
           2    1[  ] ==( 4X          10.0 Gbps Active/  LinkUp)==>       4    1[  ] "MAXIMUS" ( )
           2    2[  ] ==( 4X          10.0 Gbps Active/  LinkUp)==>       3    1[  ] "i5-a HCA-1" ( )
           2    3[  ] ==( 4X          10.0 Gbps Active/  LinkUp)==>       6    1[  ] "v16 HCA-1" ( )
           2    4[  ] ==( 4X          10.0 Gbps Active/  LinkUp)==>       7    1[  ] "h2a HCA-1" ( )
           2    5[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2    6[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2    7[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2    8[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2    9[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2   10[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2   11[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2   12[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2   13[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2   14[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2   15[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2   16[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2   17[  ] ==(                Down/ Polling)==>             [  ] "" ( )
           2   18[  ] ==(                Down/ Polling)==>             [  ] "" ( )
CA: h2a HCA-1:
      0x0002c903000545cd      7    1[  ] ==( 4X          10.0 Gbps Active/  LinkUp)==>       2    4[  ] "Infiniscale-IV Mellanox Technologies" ( )
Looks good.

Let's test with the i5-a PC (runs an i5-9600K). Note: "h2a" as the name suggests is the Odroid H2. See attached picture with the ADT-Link cable, the ConnectX IB card plugged in, with the PCI bus powered by an external PSU (the latter is the SF450 showing up in the picture background).

Note: in the output of iblinkinfo shown above you can see the i5-a LID is 3 and the h2a LID is 7. These numbers are the way you address IB machines on the IB subnet.

IB pinging works:

Code: Select all

root@h2a:~# ibping 3
Pong from i5-a.(none) (Lid 3): time 0.388 ms
Pong from i5-a.(none) (Lid 3): time 0.417 ms
Pong from i5-a.(none) (Lid 3): time 0.407 ms
Pong from i5-a.(none) (Lid 3): time 0.445 ms
Pong from i5-a.(none) (Lid 3): time 0.411 ms
Pong from i5-a.(none) (Lid 3): time 0.397 ms
Pong from i5-a.(none) (Lid 3): time 0.443 ms
Pong from i5-a.(none) (Lid 3): time 0.406 ms
Pong from i5-a.(none) (Lid 3): time 0.412 ms
Pong from i5-a.(none) (Lid 3): time 0.410 ms
Let's do some iperf3 over the regular Gigabit:

Code: Select all

root@h2a:~# iperf3 -c 192.168.1.20 --bind 192.168.1.178
Connecting to host 192.168.1.20, port 5201
[  4] local 192.168.1.178 port 36125 connected to 192.168.1.20 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec   114 MBytes   955 Mbits/sec    0    281 KBytes       
[  4]   1.00-2.00   sec   112 MBytes   941 Mbits/sec    0    281 KBytes       
[  4]   2.00-3.00   sec   112 MBytes   943 Mbits/sec    0    327 KBytes       
[  4]   3.00-4.00   sec   112 MBytes   941 Mbits/sec    0    327 KBytes       
[  4]   4.00-5.00   sec   112 MBytes   941 Mbits/sec    0    327 KBytes       
[  4]   5.00-6.00   sec   112 MBytes   943 Mbits/sec    0    342 KBytes       
[  4]   6.00-7.00   sec   112 MBytes   941 Mbits/sec    0    342 KBytes       
[  4]   7.00-8.00   sec   112 MBytes   941 Mbits/sec    0    342 KBytes       
[  4]   8.00-9.00   sec   112 MBytes   936 Mbits/sec    0    342 KBytes       
[  4]   9.00-10.00  sec   112 MBytes   941 Mbits/sec    0    342 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  1.10 GBytes   942 Mbits/sec    0             sender
[  4]   0.00-10.00  sec  1.10 GBytes   941 Mbits/sec                  receiver
Let's do some iperf3 with IP over InfiniBand. First with the H2 (10.10.10.70) as client and the i5-9600K (10.10.10.20) as server:

Code: Select all

root@h2a:~# iperf3 -c 10.10.10.20 --bind 10.10.10.70
Connecting to host 10.10.10.20, port 5201
[  4] local 10.10.10.70 port 37533 connected to 10.10.10.20 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  1.29 GBytes  11.0 Gbits/sec    0   3.25 MBytes       
[  4]   1.00-2.00   sec  1.28 GBytes  11.0 Gbits/sec    0   3.25 MBytes       
[  4]   2.00-3.00   sec  1.28 GBytes  11.0 Gbits/sec    0   3.25 MBytes       
[  4]   3.00-4.00   sec  1.28 GBytes  11.0 Gbits/sec    0   3.25 MBytes       
[  4]   4.00-5.00   sec  1.28 GBytes  11.0 Gbits/sec    0   3.25 MBytes       
[  4]   5.00-6.00   sec  1.28 GBytes  11.0 Gbits/sec    0   3.25 MBytes       
[  4]   6.00-7.00   sec  1.28 GBytes  11.0 Gbits/sec    0   3.25 MBytes       
[  4]   7.00-8.00   sec  1.28 GBytes  11.0 Gbits/sec    0   3.25 MBytes       
[  4]   8.00-9.00   sec  1.28 GBytes  11.0 Gbits/sec    0   3.25 MBytes       
[  4]   9.00-10.00  sec  1.28 GBytes  11.0 Gbits/sec    0   3.25 MBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  12.8 GBytes  11.0 Gbits/sec    0             sender
[  4]   0.00-10.00  sec  12.8 GBytes  11.0 Gbits/sec                  receiver
Not bad and in fact good given that the PCIe 2 x8 card runs in a PCIe 2 x4 slot with a low-life Celeron running the IP stack.

Now, let's do the reverse with the i5-9600K (10.10.10.20) as client and the H2 (10.10.10.70) as server:

Code: Select all

root@i5-a:~# iperf3 -c 10.10.10.70 --bind 10.10.10.20
Connecting to host 10.10.10.70, port 5201
[  4] local 10.10.10.20 port 49885 connected to 10.10.10.70 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  1.63 GBytes  14.0 Gbits/sec    0   2.68 MBytes       
[  4]   1.00-2.00   sec  1.62 GBytes  13.9 Gbits/sec    0   2.68 MBytes       
[  4]   2.00-3.00   sec  1.63 GBytes  14.0 Gbits/sec    0   2.68 MBytes       
[  4]   3.00-4.00   sec  1.63 GBytes  14.0 Gbits/sec    0   2.68 MBytes       
[  4]   4.00-5.00   sec  1.62 GBytes  14.0 Gbits/sec    0   2.68 MBytes       
[  4]   5.00-6.00   sec  1.62 GBytes  14.0 Gbits/sec    0   2.68 MBytes       
[  4]   6.00-7.00   sec  1.62 GBytes  13.9 Gbits/sec    0   2.68 MBytes       
[  4]   7.00-8.00   sec  1.62 GBytes  13.9 Gbits/sec    0   2.68 MBytes       
[  4]   8.00-9.00   sec  1.62 GBytes  13.9 Gbits/sec    0   2.68 MBytes       
[  4]   9.00-10.00  sec  1.62 GBytes  13.9 Gbits/sec    0   2.68 MBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  16.2 GBytes  13.9 Gbits/sec    0             sender
[  4]   0.00-10.00  sec  16.2 GBytes  13.9 Gbits/sec                  receiver
Oh my, that's even better than the tests I made on old PCs in the past (see mention in the "Review of the H2 based on FACTS and sparing no one" thread).

Note: I witnessed 14.4 Gbits/sec as top speed.

With modern PCs, I get 30+ Gbe and it translates into 2GB/s transfers via Samba (when copying big multi-GB files). By simple arithmetic rule I therefore expect around 800 MB/s with the H2 in the same situation, unless the disk I/O kills the speed. I'll try it over the upcoming week-end. I'll retry another ConnectX-3 too (not hoping much though and my skills in PCIe tracing and understanding are basically nil). I'll also perform some power consumption measurements.
Attachments
Screenshot at 2019-07-25 20-25-19.png
Screenshot at 2019-07-25 20-25-19.png (2.61 MiB) Viewed 3084 times
Last edited by domih on Sun Jul 28, 2019 3:02 pm, edited 1 time in total.
These users thanked the author domih for the post:
brad (Fri Jul 26, 2019 3:47 pm)

User avatar
odroid
Site Admin
Posts: 32368
Joined: Fri Feb 22, 2013 11:14 pm
languages_spoken: English
ODROIDs: ODROID
Has thanked: 147 times
Been thanked: 325 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by odroid » Fri Jul 26, 2019 1:42 pm

Wow~~ This is my first time to see a 10000Mbps Ethernet connection in the real world. :o

RomaT
Posts: 235
Joined: Thu Oct 23, 2014 4:48 pm
languages_spoken: Russian
ODROIDs: -H2 rev.B, -XU3, -XU4, -C1, -C2, -W, -VU, CloudShell
Location: Perm, Russia
Has thanked: 6 times
Been thanked: 42 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by RomaT » Fri Jul 26, 2019 1:54 pm

I think this is normal, it’s high time for everyone to move to 10GBe and more ...
IMHO, H2 needed to be done with two PCIe slots (m.2), one for 4 lanes, the second for two lanes,
or two PCIe lanes for integrated controller 4-port SATA, instead of two 1GBE,
it seems to me a mistake to use 2 lanes PCIe for the two 1GbE,
if anyone needs 1GBE, they can use USB adapters 1GBE ...
In addition, the processor has 8 ports USB, they could bring at least a GPIO Slot.

User avatar
Mullcom
Posts: 94
Joined: Sun Jun 30, 2019 1:41 am
languages_spoken: english
Has thanked: 53 times
Been thanked: 6 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by Mullcom » Fri Jul 26, 2019 6:07 pm

Domih this is great stuff! Keep up the good work.


Kan you specify a list of the card you tested and what's working and what's is not.

I can add this to the main post so it be easier for new user to finding right cards for H2.

I going to try to link also to you review post. Thx

Skickat från min SM-G955F via Tapatalk


domih
Posts: 137
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, H2.
Has thanked: 42 times
Been thanked: 35 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by domih » Sun Jul 28, 2019 12:47 pm

Here is the first wave of power consumption numbers.

Setting description
- Both the PC PSU and the H2 power brick are now on the power meter so that I can measure the actual full energy being consumed.
- Added the fan to the network card(*). The ADT-Link PCIe bus, the network card and its fan are powered by the PC PSU.
- Added the SSD and 10TB to the H2 SATA ports, powered by the H2.
- Odroid 300Mbps Wifi still connected to USB-3
- Logitech keyboard and ANKER vertical mouse on USB-3.

Power Measurements
Every thing connected but off: 1W
PC PSU turned on: 14.4W
PC PSU + H2 turned on: boost at 53W then 35 <-> 45W during the various phases of booting
Idle in Ubuntu Mate Desktop: 36.3 <-> 36.7W
Idle in console mode (no X running): 36.2 <-> 36.5W
Idle in Ubuntu Mate Desktop + IB network card link up: 39.9 <-> 40.3W
CPU temperature when idle: 37C.
Iperf3 running for 10 min over regular Gigabit Ethernet: 42 <-> 42.5
Iperf3 running for 10 min over IPoIB: 49.5 <-> 51.5W
Repeat last after disconnecting the Wifi card: 48 <-> 48.7W
Amount of data that went over the wires so far: 841.2 GB + 972.8 GB = 1.8 TB
CPU fan was not enabled(**): in the middle of iperf3 the CPU temp was 63C ~ 64C
Repeated tests with CPU fan enabled(**) (it basically ran the whole time)(***): CPU temp was 48C ~ 49C
---
Running ifperf3 over IPoIB for 30 minutes: 48 <-> 48.7W (same) CPU at 48 <-> 49C
Zero RDMA retry,
Sustained bandwith was 1.3GB/s with the H2 as client (which means the H2 is sending data to the i5 PC, the latter acknowledging)
Sustained bandwith was 1.6GB/s with the H2 as server (which means the i5 PC is sending data to the H2, the latter acknowledging)
During these tests 3.2 TB + 1.4 TB = 4.6 TB went over the wire.
Other observations:
- During the tests, one of 4 CPU cores was running the show in a round-bobin manner using and switching between the 4 cores. At the beginning the switch between cores was frequent after some time the I/O stayed on the same core for 1 or 2 minutes before switching.
- With the H2 as client (constant throughput at 1.3GB/s) the main acting core was running at 80%
- With the H2 as server (constant throughput at 1.6GB/s) the main acting core was running at 100%

(*) A small 40x10mm 12v slow speed silent Noctua running full speed all the time.
(**) Using the 92x25mm fan sold by Hard Kernel/Ameridroid blowing air off the H2.
(***) The PSU fan was just running very slow from time to time, mostly off the rest of the time.

Note: Disks and memory were not involved in these tests. I'll do the Samba testing later

CONCLUSIONS
- The Odroid Wifi 300Mbps while idle consumes ~1.5W
- The CPU fan brings down the CPU temperature by 15C. So use the goddamned fan if you wanna use your Celeron J4105 for the next 20 years.
- Acting as a Samba server, the H2 will theoritically go as far as 1.6GB/s when you write files, 1.3GB/s when you read files. Obviously, we won't reach these speeds during real testing. I'll consider myself lucky if I get half or above of it.
- If we add the Wifi 300Mbps module, the illuminated Power Button, the LCD 20x4, plus the disks being involved doing writes and reads, we are uncomfortably close to the 60W max limit of the Hard Kernel/Ameridroid 15v 4a power brick. Let's divert the powering of the network card, its fan and the disks to the external PC PSU. See also discussion in the thread "Regular PC PSU to H2 jack cable adapter" to also power the H2 board with the PC PSU via a 12v -> 19v stepper. Still TBD though.
Attachments
20190726_193928.jpg
20190726_193928.jpg (284.79 KiB) Viewed 2895 times
Last edited by domih on Sun Jul 28, 2019 2:57 pm, edited 2 times in total.

domih
Posts: 137
Joined: Mon Feb 11, 2019 4:48 pm
languages_spoken: English, French
ODROIDs: UX4, HC2, N2, H2.
Has thanked: 42 times
Been thanked: 35 times
Contact:

Re: Add-on to H2 - M2 to pciE slot

Unread post by domih » Sun Jul 28, 2019 1:06 pm

Mullcom wrote:
Fri Jul 26, 2019 6:07 pm
Domih this is great stuff! Keep up the good work.


Kan you specify a list of the card you tested and what's working and what's is not.

I can add this to the main post so it be easier for new user to finding right cards for H2.

I going to try to link also to you review post. Thx

Skickat från min SM-G955F via Tapatalk
Identifying the Mellanox Card is pretty easy. However, it's a card from 2009 not longer on sales. The only way to get it is via eBay or equivalent. The problem is that the vendors on eBay rarely give a full and valid description of these cards, so I need to do some more research to find the right "methodology" to identify theses cards on eBay. What I can say right now is:
- Mellanox ConnectX-3 do not show up on the H2 (reason unknown, to be explored further),
- Mellanox ConnectX IB (model Mellanox MT25408) do work AOK on the H2 (no major issue detected so far, shutdown intermittent issue to be explored further)
- The Mellanox MT25408 is probably the ConnectX®-2 IB/VPI 40Gbps although I do not guaranty it at the moment (need to do more research). The MT25408 has several sub-models including the EN ones which are just 10Gbe Ethernet, and this is not the ones you want to use if you want to break the 10Gbe barrier.
- In any case, these MT25408 cards go for about $50 on eBay, you just need to know you're buying the right model.
- Finally the MT25408 is longer supported by Mellanox, so if you buy one, you're on your own.

I'll post more once I find out.

For the 4-port SATA Marvell, I posted all I know in the previous posts. I'm not planning to do more tests with it (simply not interested at this point). You may want to ask RomaT or Brad for the SATA cards, they are both working with them (different models though.) On my side, I'll keep using the NVMe -> PCIe x4 for the Mellanox network card and use the H2 two SATA ports for a 10TB and 1 TB SSD for caching. If I were to need more SATA ports, I would add a SATA multiplexer as discussed in various threads and by Odroid on the wiki.

HTH.

Dominique.
Last edited by domih on Sun Jul 28, 2019 2:53 pm, edited 1 time in total.

Post Reply

Return to “Hardware and peripherals”

Who is online

Users browsing this forum: joshua.yang and 0 guests