View unanswered posts | View active topics It is currently Fri Apr 28, 2017 1:57 pm



Reply to topic  [ 37 posts ]  Go to page 1, 2, 3, 4  Next
 GA-890FXA-UD5 issues 
Author Message

Joined: Tue Oct 19, 2010 2:31 pm
Posts: 12
Reply with quote
Post GA-890FXA-UD5 issues
Hi folks,

my first post, but long time reader :)

So I've got this new Gigabyte board today - GA-890FXA-UD5 which I have had gigabyte generous technical support confirm it did support IOMMU.. after updating bios to F5 (latest) I can see the IOMMU switch - thats pretty good.

The problems I have so far encountered:

1) it would not boot from a USB stick - have no clue why, but booted up from a CD and installed on an internal 500GB disk.

2) it gets stuck on "loading module usb" and then "hid" a significant amount of time every time I boot it up - it did that when installing also...

Edit - turned out that disabling CE1 Support in bios sorted that out - source http://communities.vmware.com/message/1612048#1612048

I am going to test this board some more and update on compatibility, but so far I can see that both onboard SATA controllers are being discovered by ESXi installer - ie. the blue port one (6GB/s) as well as the white one.

Obviously on-board NIC doesn't work, but have had a spare Intel e1000g card, so no worries here.

cheers


Tue Oct 19, 2010 2:39 pm
Profile
Site Admin

Joined: Mon Mar 16, 2009 10:13 pm
Posts: 3880
Reply with quote
Post Re: GA-890FXA-UD5 issues
You might want to try this for the USB issue, but it sounds like GB MBs might be past that issue.

http://doomdogus.wordpress.com/2009/10/ ... herboards/

_________________
Dave Mishchenko
VMware vExpert 2009-2013
Image
Now available - VMware ESXi: Planning, Implementation, and Security
Also available - vSphere Quick Start Guide


Tue Oct 19, 2010 8:11 pm
Profile

Joined: Tue Oct 19, 2010 2:31 pm
Posts: 12
Reply with quote
Post Re: GA-890FXA-UD5 issues
nice one Dave... will give it a go later.

I have also noticed that the on-board RAID (GIGABYTE SATA2 Chip) does not work - so after creating a RAID volume out of 2 disks, it ESXi still sees them as separate devices ( see the pic below, look for datastore 1, 2 )

I am aiming for the following setup:

have the ESXi install partition and VM root (aprox 20GB each) and swap (vmdk, vswp) on the same datastore, mirrored for redundancy, and the rest of the disks would be used as RDM for those VMs that need more disk space.

From what I gather ESXi does not support software RAID, so is getting an additional h/w RAID card my only option?

cheers

As to the original question, the motherboard appears to work: http://img.skitch.com/20101020-t38hs9cxuaym4rn53thus1ej6q.jpg.

I have no way of testing eSATA ports but the rest, obviously except the on-board NICs appears to work, out of the box with F5 bios using ESXi 4.1.

Will test IOMMU as well and report back.


Wed Oct 20, 2010 12:27 am
Profile
Site Admin

Joined: Mon Mar 16, 2009 10:13 pm
Posts: 3880
Reply with quote
Post Re: GA-890FXA-UD5 issues
If you want RAID look at something like at something like a Dell Perc 5 /6. They are LSI based so you'll get hardware health on the Configuration > Health Status screen.

_________________
Dave Mishchenko
VMware vExpert 2009-2013
Image
Now available - VMware ESXi: Planning, Implementation, and Security
Also available - vSphere Quick Start Guide


Wed Oct 20, 2010 12:31 am
Profile

Joined: Tue Oct 19, 2010 2:31 pm
Posts: 12
Reply with quote
Post Re: GA-890FXA-UD5 issues
In fact I've got a spare LSI 3081E-R RAID PCI-E card, and just tried that now. It has all been detected automagically... it also appears in Health Status.

Guess I will stick with it for a moment.

Any chances you could be updating the HCL to include this mobo or do you need any additional info from me?

cheers

UPDATE:

does not look like VMDirectPath is supported or I am missing something important
http://img.skitch.com/20101020-nbkyg71hq2tp8jr3nk8yrr451y.jpg

When I try to load the AMDIommu driver manually I get this in the log:


Code:
Oct 20 14:41:21 shell[11702]: ./vmkload_mod AMDIommu
Oct 20 14:41:21 Hostd: [2010-10-20 14:41:21.427 61591B90 info 'ha-eventmgr'] Event 58 : Issue detected on esx1 in ha-datacenter: Mod: 4145: Initialization of module AMDIommu failed
Oct 20 14:41:21 vmkernel: 0:07:00:31.328 cpu0:49502)Loading module AMDIommu ...
Oct 20 14:41:21 vmkernel: 0:07:00:31.328 cpu0:49502)Elf: 2187: <AMDIommu> provides name-space <esx:nover>
Oct 20 14:41:21 vmkernel: 0:07:00:31.329 cpu0:49502)AMDIOMMU: 428: Loading AMD IOMMU driver...
Oct 20 14:41:21 vmkernel: 0:07:00:31.329 cpu0:49502)AMDIOMMU: 438: AMD IOMMU driver version 1.26, built on: May 18 2010
Oct 20 14:41:21 vmkernel: 0:07:00:31.329 cpu0:49502)WARNING: AMDIOMMU: 1261: failed to find IVRS in ACPI table!
Oct 20 14:41:21 vmkernel: 0:07:00:31.329 cpu0:49502)WARNING: AMDIOMMU: 472: failed to detect any AMD IOMMU device!
Oct 20 14:41:21 vmkernel: 0:07:00:31.329 cpu0:49502)ALERT: Mod: 4145: Initialization of module AMDIommu failed
Oct 20 14:41:21 vmkernel: 0:07:00:31.329 cpu0:49502)Mod: 4147: Initialization of AMDIommu failed with status 195887105
Oct 20 14:41:21 vmkernel: 0:07:00:31.329 cpu0:49502)AMDIommu failed to load.
Oct 20 14:41:21 vmkernel: 0:07:00:31.329 cpu0:49502)WARNING: Elf: 3064: Kernel based module load of AMDIommu failed: Failure <Mod_LoadDone failed>


Last edited by mikey on Wed Oct 20, 2010 6:44 am, edited 1 time in total.



Wed Oct 20, 2010 1:32 am
Profile

Joined: Tue Oct 19, 2010 2:31 pm
Posts: 12
Reply with quote
Post Re: GA-890FXA-UD5 issues
oh and lspci output that may come in handy for some of yous - remember that this is vanilla ESXi 4.1 without any customisations to oem.tgz

The bits in RED are either PCI or PCI-E extension cards such as graphics, RAID and NIC.

# lspci -v
000:000:00.0 Host bridge Bridge: ATI Technologies Inc RD890 Northbridge only single slot PCI-e GFX Hydra part
Class 0600: 1002:5a11

000:000:00.2 : ATI Technologies Inc
Class 0806: 1002:5a23

000:000:02.0 PCI bridge Bridge: ATI Technologies Inc RD890 PCI to PCI bridge (PCI express gpp port B) [PCIe RP[000:000:02.0]]
Class 0604: 1002:5a16

000:000:04.0 PCI bridge Bridge: ATI Technologies Inc RD890 PCI to PCI bridge (PCI express gpp port D) [PCIe RP[000:000:04.0]]
Class 0604: 1002:5a18

000:000:05.0 PCI bridge Bridge: ATI Technologies Inc RD890 PCI to PCI bridge (PCI express gpp port E) [PCIe RP[000:000:05.0]]
Class 0604: 1002:5a19

000:000:06.0 PCI bridge Bridge: ATI Technologies Inc RD890 PCI to PCI bridge (PCI express gpp port F) [PCIe RP[000:000:06.0]]
Class 0604: 1002:5a1a

000:000:11.0 PCI bridge Bridge: ATI Technologies Inc RD890 PCI to PCI bridge (NB-SB link) [PCIe RP[000:000:11.0]]
Class 0604: 1002:5a1f

000:000:17.0 SATA controller Mass storage controller: ATI Technologies Inc SB700 SATA Controller [AHCI Mode] [vmhba0]
Class 0106: 1002:4391

000:000:18.0 USB Controller Serial bus controller: ATI Technologies Inc SB700/SB800 USB OHCI0 Controller
Class 0c03: 1002:4397

000:000:18.2 USB Controller Serial bus controller: ATI Technologies Inc SB700/SB800 USB EHCI Controller
Class 0c03: 1002:4396

000:000:19.0 USB Controller Serial bus controller: ATI Technologies Inc SB700/SB800 USB OHCI0 Controller
Class 0c03: 1002:4397

000:000:19.2 USB Controller Serial bus controller: ATI Technologies Inc SB700/SB800 USB EHCI Controller
Class 0c03: 1002:4396

000:000:20.0 SMBus Serial bus controller: ATI Technologies Inc SBx00 SMBus Controller
Class 0c05: 1002:4385

000:000:20.2 Audio device Multimedia controller: ATI Technologies Inc SBx00 Azalia (Intel HDA)
Class 0403: 1002:4383

000:000:20.3 ISA bridge Bridge: ATI Technologies Inc SB700/SB800 LPC host controller
Class 0601: 1002:439d

000:000:20.4 PCI bridge Bridge: ATI Technologies Inc SBx00 PCI to PCI Bridge
Class 0604: 1002:4384

000:000:20.5 USB Controller Serial bus controller: ATI Technologies Inc SB700/SB800 USB OHCI2 Controller
Class 0c03: 1002:4399

000:000:21.0 PCI bridge Bridge: ATI Technologies Inc [PCIe RP[000:000:21.0]]
Class 0604: 1002:43a0

000:000:22.0 USB Controller Serial bus controller: ATI Technologies Inc SB700/SB800 USB OHCI0 Controller
Class 0c03: 1002:4397

000:000:22.2 USB Controller Serial bus controller: ATI Technologies Inc SB700/SB800 USB EHCI Controller
Class 0c03: 1002:4396

000:000:24.0 Host bridge Bridge: AMD Inc K10 [Opteron, Athlon64, Sempron] HyperTransport Configuration
Class 0600: 1022:1200

000:000:24.1 Host bridge Bridge: AMD Inc K10 [Opteron, Athlon64, Sempron] Address Map
Class 0600: 1022:1201

000:000:24.2 Host bridge Bridge: AMD Inc K10 [Opteron, Athlon64, Sempron] DRAM Controller
Class 0600: 1022:1202

000:000:24.3 Host bridge Bridge: AMD Inc K10 [Opteron, Athlon64, Sempron] Miscellaneous Control
Class 0600: 1022:1203

000:000:24.4 Host bridge Bridge: AMD Inc K10 [Opteron, Athlon64, Sempron] Link Control
Class 0600: 1022:1204

000:001:00.0 VGA compatible controller Display controller: ATI Technologies Inc RV710 [Radeon HD 4350]
Class 0300: 1002:954f


000:001:00.1 Audio device Multimedia controller: ATI Technologies Inc RV710/730
Class 0403: 1002:aa38

000:002:00.0 USB Controller Serial bus controller: NEC Corporation
Class 0c03: 1033:0194

000:005:00.0 SCSI storage controller Mass storage controller: LSI Logic / Symbios Logic LSI1068E [vmhba1]
Class 0100: 1000:0058


000:006:06.0 Ethernet controller Network controller: Intel Corporation 82541PI Gigabit Ethernet Controller [vmnic0]
Class 0200: 8086:107c


000:006:14.0 FireWire (IEEE 1394) Serial bus controller: Texas Instruments GA-EP45-DS5 Motherboard
Class 0c00: 104c:8024

000:007:00.0 SATA controller Mass storage controller: JMicron Technology Corp. GA-EP45-DS5 Motherboard [vmhba37]
Class 0106: 197b:2363

000:007:00.1 IDE interface Mass storage controller: JMicron Technology Corp. GA-EP45-DS5 Motherboard
Class 0101: 197b:2363


Wed Oct 20, 2010 6:21 am
Profile

Joined: Tue Oct 19, 2010 2:31 pm
Posts: 12
Reply with quote
Post Re: GA-890FXA-UD5 issues
ok... I have read there http://forums.tweaktown.com/gigabyte/39801-ga-890fxa-ud5-iommu-bios-switch-17.html, that people have had luck with F4 bios and IOMMU support, so I flashed with F4 and no change at all.. I think I am seriously missing something from the picture.

Meantime I've approached another challenge, and created an ISO image that contains RTL81111 drivers for this board, driver taken from http://www.vm-help.com/forum/viewtopic.php?p=7412#p7412 and it works just fine - both NICs seen, so I've removed this E1000 PCI network card that I've borrowed from another system. This leaves me room for some cheap PCI graphics card to replace this ATI RADEON monster that I've also borrowed from other box. Think I've seen some cheap s3 trio on ebay.

So IOMMU and RAID are still on my todo list. Firstly I am going to give RAID a go later tonight.

EDIT:

Raid sorted using LSI card... see http://img.skitch.com/20101020-k7em7siy7xjd4c1mrkcngmwx1q.jpg


Wed Oct 20, 2010 1:01 pm
Profile
Site Admin

Joined: Mon Mar 16, 2009 10:13 pm
Posts: 3880
Reply with quote
Post Re: GA-890FXA-UD5 issues
Does anyone on the thread confirm that any hypervisor can use IOMMU with the MB? I only look at page 17 and 18 of the thead you mentioned and one of the people asks this -

Quote:
Does ANYBODY have working IOMMU with Linux and KVM?

I'm planning on buying a GA-890FX-UD5 today for this very reason and all I'm seeing is that with IOMMU switched on you can't even boot!?

And another guy saying he's given up with KVM and is using PV over XEN.
Last edited by RoboJ1M; 10-02-2010 at 06:34 PM.

_________________
Dave Mishchenko
VMware vExpert 2009-2013
Image
Now available - VMware ESXi: Planning, Implementation, and Security
Also available - vSphere Quick Start Guide


Wed Oct 20, 2010 4:47 pm
Profile

Joined: Tue Oct 19, 2010 2:31 pm
Posts: 12
Reply with quote
Post Re: GA-890FXA-UD5 issues
Well, there are confusing opinion about it Dave

http://forums.tweaktown.com/gigabyte/39801-ga-890fxa-ud5-iommu-bios-switch-16.html#post371304 - this post let me to believe that it was possible.

On the other fronts I've PM'ed a few folks who've tried this board on your forums here, and they have not had any luck with it.

I think I will be returning it and replacing with ASUS CROSSHAIR FORMULA IV based on what I am seeing at http://wiki.xensource.com/xenwiki/VTdHowTo and http://blog.laspina.ca/ubiquitous/encapsulating-vt-d-accelerated-zfs-storage-within-esxi

The only problem is that it has 6 7 SATA ports as opposed to 8 (on the current board), but guess I can survive with it and some Marvell NIC that I cant find community drivers for ESXi, so would need to stick to PCI NIC.


Last edited by mikey on Mon Oct 25, 2010 10:53 am, edited 1 time in total.



Thu Oct 21, 2010 11:41 pm
Profile

Joined: Tue Oct 19, 2010 2:31 pm
Posts: 12
Reply with quote
Post Replaced with ASUS Crosshair Formula IV and...
ok... so I've tried booting that board off a Xen Live CD and no IOMMU was found... so I ended up swapping it for Asus Crosshair Formula IV ... which seems to be supporting IOMMU indeed...
see: http://img.skitch.com/20101025-xr2xu2bwh1d4fmx597t8487hs1.jpg

Oh and both controllers were found out of the box - I just set the SB700 to AHCI mode in BIOS

000:009:00.0 Mass storage controller: JMicron Technology Corp. P5B [JMB363] [vmhba37]
000:000:17.0 Mass storage controller: ATI Technologies Inc SB700 SATA Controller [AHCI Mode] [vmhba0]

as for the NIC the on-board Marvel was not detected out of the box:

000:007:00.0 Network controller: Marvell Technologies, Inc.

but I've inherited a nice quad port Intel 1000 PT (I think) that works out of the box


000:004:00.0 Network controller: Intel Corporation x4 PCI-Express Quad Gigabit Ethernet UTP Low Profile Adapter [vmnic2]
000:004:00.1 Network controller: Intel Corporation x4 PCI-Express Quad Gigabit Ethernet UTP Low Profile Adapter [vmnic3]
000:005:00.0 Network controller: Intel Corporation x4 PCI-Express Quad Gigabit Ethernet UTP Low Profile Adapter [vmnic0]
000:005:00.1 Network controller: Intel Corporation x4 PCI-Express Quad Gigabit Ethernet UTP Low Profile Adapter [vmnic4]

I am going to update BIOS because the current (stock if you like) is sort of old.

Actually I looked at the wrong number, and the board has been shipped to me with the most recent bios (1102) by the looks of it.

HTH


Mon Oct 25, 2010 9:33 am
Profile
Display posts from previous:  Sort by  
Reply to topic   [ 37 posts ]  Go to page 1, 2, 3, 4  Next

Who is online

Users browsing this forum: No registered users and 1 guest


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group.
Designed by STSoftware for PTF.