Thomas Burgess
2010-May-11 12:29 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
I was looking at building a new ZFS based server for my media files and i was wondering if this cpu was supported...i googled and i coudlnt'' find much info about it. I''m specificially looking at this motherboard: http://www.newegg.com/Product/Product.aspx?Item=N82E16813182230 I''d hate to buy it and find out it doesn''t work. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100511/5596053b/attachment.html>
Roy Sigurd Karlsbakk
2010-May-11 13:07 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
----- "Thomas Burgess" <wonslung at gmail.com> skrev: I was looking at building a new ZFS based server for my media files and i was wondering if this cpu was supported...i googled and i coudlnt'' find much info about it. I''m specificially looking at this motherboard: http://www.newegg.com/Product/Product.aspx?Item=N82E16813182230 I''d hate to buy it and find out it doesn''t work. AFAIK this is just yet another Opteron, only with a bunch more of cores ... roy -- Roy Sigurd Karlsbakk (+47) 97542685 roy at karlsbakk.net http://blogg.karlsbakk.net/ -- I all pedagogikk er det essensielt at pensum presenteres intelligibelt. Det er et element?rt imperativ for alle pedagoger ? unng? eksessiv anvendelse av idiomer med fremmed opprinnelse. I de fleste tilfeller eksisterer adekvate og relevante synonymer p? norsk. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100511/c14acc29/attachment.html>
Brandon High
2010-May-11 22:29 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Tue, May 11, 2010 at 5:29 AM, Thomas Burgess <wonslung at gmail.com> wrote:> I''m specificially looking at this motherboard: > http://www.newegg.com/Product/Product.aspx?Item=N82E16813182230I''d be more concerned that the motherboard and it''s attached peripherals are unsupported than the processor. Solaris can handle 12 cores with no problems. -B -- Brandon High : bhigh at freaks.com
Michael DeMan
2010-May-12 00:32 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
I agree on the motherboard and peripheral chipset issue. This, and the last generation AMD quad/six core motherboards all seem to use the AMD SP56x0/SP5100 chipset, which I can''t find much information about support on for either OpenSolaris or FreeBSD. Another issue is the LSI SAS2008 chipset for SAS controller which is frequently offered as an onboard option for many motherboards as well and still seems to be somewhat of a work in progress in regards to being ''production ready''. On May 11, 2010, at 3:29 PM, Brandon High wrote:> On Tue, May 11, 2010 at 5:29 AM, Thomas Burgess <wonslung at gmail.com> wrote: >> I''m specificially looking at this motherboard: >> http://www.newegg.com/Product/Product.aspx?Item=N82E16813182230 > > I''d be more concerned that the motherboard and it''s attached > peripherals are unsupported than the processor. Solaris can handle 12 > cores with no problems. > > -B > > -- > Brandon High : bhigh at freaks.com > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss
James C. McPherson
2010-May-12 00:40 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 12/05/10 10:32 AM, Michael DeMan wrote:> I agree on the motherboard and peripheral chipset issue. > > This, and the last generation AMD quad/six core motherboards> all seem to use the AMD SP56x0/SP5100 chipset, which I can''t > find much information about support on for either OpenSolaris or FreeBSD. If you can get the device driver detection utility to run on it, that will give you a reasonable idea.> Another issue is the LSI SAS2008 chipset for SAS controller> which is frequently offered as an onboard option for many motherboards > as well and still seems to be somewhat of a work in progress in > regards to being ''production ready''. What metric are you using for "production ready" ? Are there features missing which you expect to see in the driver, or is it just "oh noes, I haven''t seen enough big customers with it" ? James C. McPherson -- Senior Software Engineer, Solaris Oracle http://www.jmcp.homeunix.com/blog
Thomas Burgess
2010-May-12 01:02 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
the onboard sata is a secondary issue. If i need to, i''ll boot from the oboard usb slots. I have 2 LSI 1068e based sas controllers which i will be using. On Tue, May 11, 2010 at 8:40 PM, James C. McPherson <jmcp at opensolaris.org>wrote:> On 12/05/10 10:32 AM, Michael DeMan wrote: > >> I agree on the motherboard and peripheral chipset issue. >> >> This, and the last generation AMD quad/six core motherboards >> > > all seem to use the AMD SP56x0/SP5100 chipset, which I can''t > > find much information about support on for either OpenSolaris or FreeBSD. > > If you can get the device driver detection utility to run > on it, that will give you a reasonable idea. > > > Another issue is the LSI SAS2008 chipset for SAS controller >> > > which is frequently offered as an onboard option for many motherboards > > as well and still seems to be somewhat of a work in progress in > > regards to being ''production ready''. > > What metric are you using for "production ready" ? > Are there features missing which you expect to see > in the driver, or is it just "oh noes, I haven''t > seen enough big customers with it" ? > > > James C. McPherson > -- > Senior Software Engineer, Solaris > Oracle > http://www.jmcp.homeunix.com/blog > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100511/2af0ca2a/attachment.html>
Thomas Burgess
2010-May-12 02:46 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
Well i went ahead and ordered the board. I will report back soon with the results..i''m pretty excited. These CPU''s seem great on paper. On Tue, May 11, 2010 at 9:02 PM, Thomas Burgess <wonslung at gmail.com> wrote:> the onboard sata is a secondary issue. If i need to, i''ll boot from the > oboard usb slots. I have 2 LSI 1068e based sas controllers which i will be > using. > > > On Tue, May 11, 2010 at 8:40 PM, James C. McPherson <jmcp at opensolaris.org>wrote: > >> On 12/05/10 10:32 AM, Michael DeMan wrote: >> >>> I agree on the motherboard and peripheral chipset issue. >>> >>> This, and the last generation AMD quad/six core motherboards >>> >> > all seem to use the AMD SP56x0/SP5100 chipset, which I can''t >> > find much information about support on for either OpenSolaris or >> FreeBSD. >> >> If you can get the device driver detection utility to run >> on it, that will give you a reasonable idea. >> >> >> Another issue is the LSI SAS2008 chipset for SAS controller >>> >> > which is frequently offered as an onboard option for many motherboards >> > as well and still seems to be somewhat of a work in progress in >> > regards to being ''production ready''. >> >> What metric are you using for "production ready" ? >> Are there features missing which you expect to see >> in the driver, or is it just "oh noes, I haven''t >> seen enough big customers with it" ? >> >> >> James C. McPherson >> -- >> Senior Software Engineer, Solaris >> Oracle >> http://www.jmcp.homeunix.com/blog >> >> _______________________________________________ >> zfs-discuss mailing list >> zfs-discuss at opensolaris.org >> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >> > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100511/5918010d/attachment.html>
Geoff Nordli
2010-May-12 05:18 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Behalf Of James C. McPherson>Sent: Tuesday, May 11, 2010 5:41 PM > >On 12/05/10 10:32 AM, Michael DeMan wrote: >> I agree on the motherboard and peripheral chipset issue. >> >> This, and the last generation AMD quad/six core motherboards > > all seem to use the AMD SP56x0/SP5100 chipset, which I can''t > findmuch>information about support on for either OpenSolaris or FreeBSD. > >If you can get the device driver detection utility to run on it, that willgive you a>reasonable idea. > >> Another issue is the LSI SAS2008 chipset for SAS controller > > which is frequently offered as an onboard option for many motherboards > as >well and still seems to be somewhat of a work in progress in > regards tobeing>''production ready''. > >What metric are you using for "production ready" ? >Are there features missing which you expect to see in the driver, or is itjust "oh>noes, I haven''t seen enough big customers with it" ? > >I have been wondering what the compatibility is like on OpenSolaris. My perception is basic network driver support is decent, but storage controllers are more difficult for driver support. My perception is if you are using external cards which you know work for networking and storage, then you should be alright. Am I out in left-field on this? Thanks, Geoff
James C. McPherson
2010-May-12 09:28 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 12/05/10 03:18 PM, Geoff Nordli wrote: ....> I have been wondering what the compatibility is like on OpenSolaris. My > perception is basic network driver support is decent, but storage > controllers are more difficult for driver support.Now wait just a minute. You''re casting aspersions on stuff here without saying what you''re talking about, still less where you''re getting your info from. Be specific - put up, or shut up.> My perception is if you are using external cards which you know work for > networking and storage, then you should be alright. > Am I out in left-field on this?I believe you are talking through your hat. James C. McPherson -- Senior Software Engineer, Solaris Oracle http://www.jmcp.homeunix.com/blog
Thomas Burgess
2010-May-12 11:13 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
This is how i understand it. I know the network cards are well supported and i know my storage cards are supported....the onboard sata may work and it may not. If it does, great, i''ll use it for booting, if not, this board has 2 onboard bootable USB sticks....luckily usb seems to work regardless On Wed, May 12, 2010 at 1:18 AM, Geoff Nordli <geoffn at gnaa.net> wrote:> > > On Behalf Of James C. McPherson > >Sent: Tuesday, May 11, 2010 5:41 PM > > > >On 12/05/10 10:32 AM, Michael DeMan wrote: > >> I agree on the motherboard and peripheral chipset issue. > >> > >> This, and the last generation AMD quad/six core motherboards > > > all seem to use the AMD SP56x0/SP5100 chipset, which I can''t > find > much > >information about support on for either OpenSolaris or FreeBSD. > > > >If you can get the device driver detection utility to run on it, that will > give you a > >reasonable idea. > > > >> Another issue is the LSI SAS2008 chipset for SAS controller > > > which is frequently offered as an onboard option for many motherboards > > as > >well and still seems to be somewhat of a work in progress in > regards to > being > >''production ready''. > > > >What metric are you using for "production ready" ? > >Are there features missing which you expect to see in the driver, or is it > just "oh > >noes, I haven''t seen enough big customers with it" ? > > > > > > I have been wondering what the compatibility is like on OpenSolaris. My > perception is basic network driver support is decent, but storage > controllers are more difficult for driver support. > > My perception is if you are using external cards which you know work for > networking and storage, then you should be alright. > > Am I out in left-field on this? > > Thanks, > > Geoff > > > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100512/ddd2c25c/attachment.html>
Thomas Burgess
2010-May-12 13:21 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
> > >> > Now wait just a minute. You''re casting aspersions on > stuff here without saying what you''re talking about, > still less where you''re getting your info from. > > Be specific - put up, or shut up. > >I think he was just trying to tell me that my cpu should be fine, that the only thing which i might have to worry about is network and disk drivers. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100512/d9caa049/attachment.html>
The problem is the Solaris team and lsi have put a lot of work into the new 2008 cards. Claiming there are issues without listing specific bugs they can address is, I''m sure, frustrating to say the least. On May 12, 2010 8:22 AM, "Thomas Burgess" <wonslung at gmail.com> wrote:>> > > Now wait just a minute. You''re casting aspersions on > stuff here without saying what you''re ...I think he was just trying to tell me that my cpu should be fine, that the only thing which i might have to worry about is network and disk drivers. _______________________________________________ zfs-discuss mailing list zfs-discuss at opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100512/893b36db/attachment.html>
Geoff Nordli
2010-May-12 16:16 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
>From: James C. McPherson [mailto:James.McPherson at oracle.com] >Sent: Wednesday, May 12, 2010 2:28 AM > >On 12/05/10 03:18 PM, Geoff Nordli wrote: >.... >> I have been wondering what the compatibility is like on OpenSolaris. >> My perception is basic network driver support is decent, but storage >> controllers are more difficult for driver support. > >Now wait just a minute. You''re casting aspersions on stuff here without saying >what you''re talking about, still less where you''re getting your info from. > >Be specific - put up, or shut up. > >> My perception is if you are using external cards which you know work >> for networking and storage, then you should be alright. >> Am I out in left-field on this? > >I believe you are talking through your hat. >James, it is not my intention to cast an "aspersion" in this thread. I should have worded my reply differently instead of posting my perception, but I really didn''t think I would get piled on for it. This subject interests me because we are going to have customers deploy OpenSolaris on their own equipment and I have been concerned about compatibility. Is the MOBO/Chipset/CPU actually something to be worried about with OpenSolaris compatibility? I know this is not an all-encompassing list, but I got my hardware info from the Nexenta site (http://www.nexenta.com/corp/supported-hardware/hardware-supported-list) because that is the distro I started with. Have a great day! Geoff
Miles Nordin
2010-May-12 20:28 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
>>>>> "jcm" == James C McPherson <James.McPherson at oracle.com> writes:>> storage controllers are more difficult for driver support. jcm> Be specific - put up, or shut up. marvell controller hangs machine when a drive is unplugged marvell controller does not support NCQ marvell driver is closed-source blob sil3124 driver has lost interrupt problems ATI SB600/SB700 AHCI driver has performance problems mpt driver has disconnect under heavy load problems that may or may not be MSI-related mpt driver is closed source blob mpt driver is not SATA framework and thus does not work with DVD-ROMS or with smartctl XXX -- smartctl does work now, with ''-d sat,12''? or only AHCI works with that? USUAL SUGGESTION: use 1068e non-raid and mpt driver, live with problems USUAL OPTIMISM: lsi2008 / mega_sas, which i THINK are open source but opengrok seems to be down so I did not verify. >> My perception is if you are using external cards which you know >> work for networking and storage, then you should be alright. >> Am I out in left-field on this? jcm> I believe you are talking through your hat. network performance problems with realtek network performance problems with nvidia nforce network working-at-all problems with broadcom bge and bnx because of the ludicrous number of chip steppings and errata closed-source blob drivers with broadcom bnx performance and working-at-all problems for atheros L1 USUAL SUGGESTION: use intel 82540 derivative. which, for an AMD board, will almost always be an external card because AMD boards are usually realtek, broadcom, or marvell for AMD chipsets, and realtek or nforce for nVidia chipsets (if anyone still uses nvidia chipsets). FAIR STATEMENT: Linux shares most of these problems except over there bnx is open source. USUAL OPTIMISM: crossbow-supported cards with L4 classifiers in the MAC other than bnx, such as 10gig ones, may be the future, much more performant, ready for CoS pause frames, and good multicore performance, and having source. god willing their quality might turn out to be more uniform but probably nobody knows yet, and they''re not cheap and ubiquitous onboard yet. I''m hoping infiniband comes back and 10gig goes away, but that''s probably not realistic. WELL POISONING: saying ``if you want open-source drivers go whine at the hardware vendor because they make us sign an NDA, so there''s nothing we can do,'''' is hogwash. (a) Sun''s the one able to realistically bargain with the vendor, not users, because they bring to the table developer hours, OS support, a class of customers, trusting contacts within the vendor, and a hardware manufacturing arm that can make purchasing decisions long-term and at a motherboard component level; no user has anywhere near this insane level of bargaining power; see OpenBSD presentation and ``the OEM problem'''', (b) usually only one chip works anyway, so there is no competition, (c) Linux has open source drivers for all these chips and is an existence proof that yes, you can do something about it, and (d) the competition for users is between Solaris and Linux, not between Marvell and LSI. If we want complete source for the OS we will get it faster and more reliably by going to the OS that offers it, not by whining to chip vendors. This is not flamebait but just obvious reality---so obvious that almost everyone who really cares enough to say it is already gone. HTH, HAND. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 304 bytes Desc: not available URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100512/a1f3494c/attachment.bin>
James C. McPherson
2010-May-12 23:22 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 12/05/10 11:21 PM, Thomas Burgess wrote:> > > Now wait just a minute. You''re casting aspersions on > stuff here without saying what you''re talking about, > still less where you''re getting your info from. > > Be specific - put up, or shut up. > > > I think he was just trying to tell me that my cpu should be fine, that > the only thing which i might have to worry about is network and disk > drivers.If you are worrying about your network and disk controller drivers, then you need to give some information about what you believe any problems are. So far, there''s been a bunch of FUD cast on a driver that I worked on (mpt_sas), and I''m still trying to find out from you and others what you think is a problem with it. James C. McPherson -- Senior Software Engineer, Solaris Oracle http://www.jmcp.homeunix.com/blog
Erik Trimble
2010-May-13 00:46 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
I''ve gotten a couple of the newest prototype AMD systems, with the C34 and G34 sockets. All have run various flavors of OpenSolaris quite well, with the exception of a couple of flaky network problems, which we''ve tracked down to pre-production NIC hardware and early-access drivers. This is a similar problem I see all the time on prototype Intel stuff. The problems go away when we put in production-ready NIC cards (even when such NIC cards have the same actual chip series, the bugs inevitably are nailed to the beta-level original NIC chips). So I would NOT expect any problems if your MB passes the Device Check tool (or whatever we''re calling it nowadays). -- Erik Trimble Java System Support Mailstop: usca22-123 Phone: x17195 Santa Clara, CA Timezone: US/Pacific (GMT-0800)
Ian Collins
2010-May-13 01:25 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 05/13/10 12:46 PM, Erik Trimble wrote:> I''ve gotten a couple of the newest prototype AMD systems, with the C34 > and G34 sockets. All have run various flavors of OpenSolaris quite > well, with the exception of a couple of flaky network problems, which > we''ve tracked down to pre-production NIC hardware and early-access > drivers. This is a similar problem I see all the time on prototype > Intel stuff. The problems go away when we put in production-ready NIC > cards (even when such NIC cards have the same actual chip series, the > bugs inevitably are nailed to the beta-level original NIC chips). > > So I would NOT expect any problems if your MB passes the Device Check > tool (or whatever we''re calling it nowadays). > >Bit of a chicken and egg that, isn''t it? You need to run the tool to see if the board''s worth buying and you need to buy the board to run the tool! -- Ian.
Erik Trimble
2010-May-13 01:34 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Thu, 2010-05-13 at 13:25 +1200, Ian Collins wrote:> On 05/13/10 12:46 PM, Erik Trimble wrote: > > I''ve gotten a couple of the newest prototype AMD systems, with the C34 > > and G34 sockets. All have run various flavors of OpenSolaris quite > > well, with the exception of a couple of flaky network problems, which > > we''ve tracked down to pre-production NIC hardware and early-access > > drivers. This is a similar problem I see all the time on prototype > > Intel stuff. The problems go away when we put in production-ready NIC > > cards (even when such NIC cards have the same actual chip series, the > > bugs inevitably are nailed to the beta-level original NIC chips). > > > > So I would NOT expect any problems if your MB passes the Device Check > > tool (or whatever we''re calling it nowadays). > > > > > Bit of a chicken and egg that, isn''t it? > > You need to run the tool to see if the board''s worth buying and you need > to buy the board to run the tool! >*Somebody* has to be that first early adopter. After that, we all get to ride on their experience. -- Erik Trimble Java System Support Mailstop: usca22-123 Phone: x17195 Santa Clara, CA Timezone: US/Pacific (GMT-0800)
Dennis Clarke
2010-May-13 05:54 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
>> > >> Bit of a chicken and egg that, isn''t it? >> >> You need to run the tool to see if the board''s worth buying and you need >> to buy the board to run the tool! >> > > *Somebody* has to be that first early adopter. After that, we all get > to ride on their experience.I am sure the Tier-1 stuff will work just fine. I have an HP unit on order thus : HP Proliant DL165G7 server, 1U Rack Server, 2 ? AMD Opteron Processor Model 6172 ( 12 core, 2.1 GHz, 12MB Level 3 Cache, 80W), dual socket configuration for 24-cores in total, 16GB (8 x 2GB) Advanced ECC PC3-10600R (RDIMM) memory, Twenty Four DIMM slots, 2 PCI-E Slots ( 1 PCI Express expansion slot 1, low-profile, half-length and PCI Express expansion slot 2 full height full length ?16 75W +EXT 75W with optional PCI-X support ), 2x HP NC362i Integrated Dual Port Gigabit Server Adapter, Storage Controller (1) Smart Array P410i/256MB BBWC, single HP 500W CS HE Power Supply, no internal HDD, slim height 9.5mm DVD included, no OS - no Monitor, 3 year warranty So when it gets in I''ll toss it into a rack, hook up a serial cable and then boot *whatever* as verbosely as possible.[1] If you want you can ssh in to the blastwave server farm and jump on that also ... I''m always game to play with such things. -- Dennis Clarke dclarke at opensolaris.ca <- Email related to the open source Solaris dclarke at blastwave.org <- Email related to open source for Solaris [1] ummm No, I won''t be installing Microsoft Windows 7 64-bit Ultimate Edition. .. or maybe I will :-P
Orvar Korvar
2010-May-13 08:43 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
Great! Please report here so we can read about your impressions. -- This message posted from opensolaris.org
Thomas Burgess
2010-May-13 13:56 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
I ordered it. It should be here monday or tuesday. When i get everything built and installed, i''ll report back. I''m very excited. I am not expecting problems now that i''ve talked to supermicro about it. Solaris 10 runs for them so i would imagine opensolaris should be fine too. On Thu, May 13, 2010 at 4:43 AM, Orvar Korvar < knatte_fnatte_tjatte at yahoo.com> wrote:> Great! Please report here so we can read about your impressions. > -- > This message posted from opensolaris.org > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100513/0f2ed71e/attachment.html>
Thomas Burgess
2010-May-16 00:08 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
Well i just wanted to let everyone know that preliminary results are good. The livecd booted, all important things seem to be recognized. It sees all 16 gb of ram i installed and all 8 cores of my opteron 6128 The only real shocker is how loud the norco RPC-4220 fans are (i have another machine with a norco 4020 case so i assumed the fans would be similar.....this was a BAD assumption) This thing sounds like a hair dryer Anyways, I''m running the install now so we''ll see how that goes. It did take about 10 minutes to "find a disk" durring the installer, but if i remember right, this happened on other machines as well. On Thu, May 13, 2010 at 9:56 AM, Thomas Burgess <wonslung at gmail.com> wrote:> I ordered it. It should be here monday or tuesday. When i get everything > built and installed, i''ll report back. I''m very excited. I am not > expecting problems now that i''ve talked to supermicro about it. Solaris 10 > runs for them so i would imagine opensolaris should be fine too. > > On Thu, May 13, 2010 at 4:43 AM, Orvar Korvar < > knatte_fnatte_tjatte at yahoo.com> wrote: > >> Great! Please report here so we can read about your impressions. >> -- >> This message posted from opensolaris.org >> _______________________________________________ >> zfs-discuss mailing list >> zfs-discuss at opensolaris.org >> http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >> > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100515/ef891339/attachment.html>
Dennis Clarke
2010-May-16 00:35 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
----- Original Message ----- From: Thomas Burgess <wonslung at gmail.com> Date: Saturday, May 15, 2010 8:09 pm Subject: Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris? To: Orvar Korvar <knatte_fnatte_tjatte at yahoo.com> Cc: zfs-discuss at opensolaris.org> Well i just wanted to let everyone know that preliminary results are good. > The livecd booted, all important things seem to be recognized. It > sees all > 16 gb of ram i installed and all 8 cores of my opteron 6128 > > The only real shocker is how loud the norco RPC-4220 fans are (i have > another machine with a norco 4020 case so i assumed the fans would be > similar.....this was a BAD assumption) This thing sounds like a hair > dryer > > Anyways, I''m running the install now so we''ll see how that goes. It > did take > about 10 minutes to "find a disk" durring the installer, but if i remember > right, this happened on other machines as well. >Once you have the install done could you post ( somewhere ) what you see during a single user mode boot with options -srv ? I would like to see all the gory details. Also, could you run "cpustat -h" ? At the bottom, according to usr/src/uts/intel/pcbe/opteron_pcbe.c you shoud see : See "BIOS and Kernel Developer''s Guide (BKDG) For AMD Family 10h Processors" (AMD publication 31116) The following registers should be listed : #define AMD_FAMILY_10h_generic_events \ { "PAPI_tlb_dm", "DC_dtlb_L1_miss_L2_miss", 0x7 }, \ { "PAPI_tlb_im", "IC_itlb_L1_miss_L2_miss", 0x3 }, \ { "PAPI_l3_dcr", "L3_read_req", 0xf1 }, \ { "PAPI_l3_icr", "L3_read_req", 0xf2 }, \ { "PAPI_l3_tcr", "L3_read_req", 0xf7 }, \ { "PAPI_l3_stm", "L3_miss", 0xf4 }, \ { "PAPI_l3_ldm", "L3_miss", 0xf3 }, \ { "PAPI_l3_tcm", "L3_miss", 0xf7 } You should NOT see anything like this : root at aequitas:/root# uname -a SunOS aequitas 5.11 snv_139 i86pc i386 i86pc Solaris root at aequitas:/root# cpustat -h cpustat: cannot access performance counters - Operation not applicable ... as well as psrinfo -pv please ? When I get my HP Proliant with the 6174 procs I''ll be sure to post whatever I see. Dennis
Thomas Burgess
2010-May-17 00:08 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
well, i haven''t had a lot of time to work with this...but i''m having trouble getting the onboard sata to work in anything but NATIVE IDE mode. I''m not sure exactly what the problem is....i''m wondering if i bought the wrong cable (i have a norco 4220 case so the drives connect via a sas sff-8087 on the backpane) I thought this required a "reverse breakout cable" but maybe i was wrong....this is the first time i''ve worked with sas on the otherhand, I was able to flash my intel Intel SASUC8I cards with the LSI SAS3081E IT firmware from the LSI site. These seem to work fine. I think i''m just going to order a 3rd card and put it in the pci-e x4 slot. I don''t want 16 drives running as sata and 4 running in IDE mode. Is there any way i can tell if the drive i installed opensolaris to is in IDE or SATA mode? On Thu, May 13, 2010 at 4:43 AM, Orvar Korvar < knatte_fnatte_tjatte at yahoo.com> wrote:> Great! Please report here so we can read about your impressions. > -- > This message posted from opensolaris.org > _______________________________________________ > zfs-discuss mailing list > zfs-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/zfs-discuss >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100516/b69bb80b/attachment.html>
Ian Collins
2010-May-17 00:18 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 05/17/10 12:08 PM, Thomas Burgess wrote:> well, i haven''t had a lot of time to work with this...but i''m having > trouble getting the onboard sata to work in anything but NATIVE IDE mode. > > > I''m not sure exactly what the problem is....i''m wondering if i bought > the wrong cable (i have a norco 4220 case so the drives connect via a > sas sff-8087 on the backpane) > > I thought this required a "reverse breakout cable" but maybe i was > wrong....this is the first time i''ve worked with sas > > on the otherhand, I was able to flash my intel Intel SASUC8I cards > with the LSI SAS3081E IT firmware from the LSI site. These seem to > work fine. I think i''m just going to order a 3rd card and put it in > the pci-e x4 slot. I don''t want 16 drives running as sata and 4 > running in IDE mode. Is there any way i can tell if the drive i > installed opensolaris to is in IDE or SATA mode? >Does it show up in cfgadm? -- Ian.
Brandon High
2010-May-17 04:38 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Sun, May 16, 2010 at 5:08 PM, Thomas Burgess <wonslung at gmail.com> wrote:> well, i haven''t had a lot of time to work with this...but i''m having trouble > getting the onboard sata to work in anything but NATIVE IDE mode.Have you tried going straight from the motherboard to a drive too? Take as many pieces out of the mix to see what helps. Is the backplane just a backplane, or a SAS expander? Norco has a "Discrete SATA to SFF-8087 Mini SAS Reverse breakout cable" listed on the 4220 page, so you''ve probably got the right thing. -B -- Brandon High : bhigh at freaks.com
Thomas Burgess
2010-May-17 19:32 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
hey, when i do this single user boot, is there anyway to capture what pops on the screen? It''s a LOT of stuff. anyways, it seems to work fine when i do singleuser -srv cpustat -h lists exactly what you said it should plus a lot more (though the "more" is above, so like you said, it shows what it should show at the bottom) I''ll capture all that later and post it. On Sat, May 15, 2010 at 8:35 PM, Dennis Clarke <dclarke at blastwave.org>wrote:> ----- Original Message ----- > From: Thomas Burgess <wonslung at gmail.com> > Date: Saturday, May 15, 2010 8:09 pm > Subject: Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris? > To: Orvar Korvar <knatte_fnatte_tjatte at yahoo.com> > Cc: zfs-discuss at opensolaris.org > > > > Well i just wanted to let everyone know that preliminary results are > good. > > The livecd booted, all important things seem to be recognized. It > > sees all > > 16 gb of ram i installed and all 8 cores of my opteron 6128 > > > > The only real shocker is how loud the norco RPC-4220 fans are (i have > > another machine with a norco 4020 case so i assumed the fans would be > > similar.....this was a BAD assumption) This thing sounds like a hair > > dryer > > > > Anyways, I''m running the install now so we''ll see how that goes. It > > did take > > about 10 minutes to "find a disk" durring the installer, but if i > remember > > right, this happened on other machines as well. > > > > Once you have the install done could you post ( somewhere ) what you see > during a single user mode boot with options -srv ? > > I would like to see all the gory details. > > Also, could you run "cpustat -h" ? > > At the bottom, according to usr/src/uts/intel/pcbe/opteron_pcbe.c you shoud > see : > > See "BIOS and Kernel Developer''s Guide (BKDG) For AMD Family 10h > Processors" (AMD publication 31116) > > The following registers should be listed : > > #define AMD_FAMILY_10h_generic_events > \ > { "PAPI_tlb_dm", "DC_dtlb_L1_miss_L2_miss", 0x7 }, \ > { "PAPI_tlb_im", "IC_itlb_L1_miss_L2_miss", 0x3 }, \ > { "PAPI_l3_dcr", "L3_read_req", 0xf1 }, \ > { "PAPI_l3_icr", "L3_read_req", 0xf2 }, \ > { "PAPI_l3_tcr", "L3_read_req", 0xf7 }, \ > { "PAPI_l3_stm", "L3_miss", 0xf4 }, \ > { "PAPI_l3_ldm", "L3_miss", 0xf3 }, \ > { "PAPI_l3_tcm", "L3_miss", 0xf7 } > > > You should NOT see anything like this : > > root at aequitas:/root# uname -a > SunOS aequitas 5.11 snv_139 i86pc i386 i86pc Solaris > root at aequitas:/root# cpustat -h > cpustat: cannot access performance counters - Operation not applicable > > > ... as well as psrinfo -pv please ? > > > When I get my HP Proliant with the 6174 procs I''ll be sure to post whatever > I see. > > Dennis >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100517/0a9f9d05/attachment.html>
Thomas Burgess
2010-May-17 19:35 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
psrinfo -pv shows: The physical processor has 8 virtual processors (0-7) x86 (AuthenticAMD 100F91 family 16 model 9 step 1 clock 200 MHz) AMD Opteron(tm) Processor 6128 [ Socket: G34 ] On Sat, May 15, 2010 at 8:35 PM, Dennis Clarke <dclarke at blastwave.org>wrote:> ----- Original Message ----- > From: Thomas Burgess <wonslung at gmail.com> > Date: Saturday, May 15, 2010 8:09 pm > Subject: Re: [zfs-discuss] Opteron 6100? Does it work with opensolaris? > To: Orvar Korvar <knatte_fnatte_tjatte at yahoo.com> > Cc: zfs-discuss at opensolaris.org > > > > Well i just wanted to let everyone know that preliminary results are > good. > > The livecd booted, all important things seem to be recognized. It > > sees all > > 16 gb of ram i installed and all 8 cores of my opteron 6128 > > > > The only real shocker is how loud the norco RPC-4220 fans are (i have > > another machine with a norco 4020 case so i assumed the fans would be > > similar.....this was a BAD assumption) This thing sounds like a hair > > dryer > > > > Anyways, I''m running the install now so we''ll see how that goes. It > > did take > > about 10 minutes to "find a disk" durring the installer, but if i > remember > > right, this happened on other machines as well. > > > > Once you have the install done could you post ( somewhere ) what you see > during a single user mode boot with options -srv ? > > I would like to see all the gory details. > > Also, could you run "cpustat -h" ? > > At the bottom, according to usr/src/uts/intel/pcbe/opteron_pcbe.c you shoud > see : > > See "BIOS and Kernel Developer''s Guide (BKDG) For AMD Family 10h > Processors" (AMD publication 31116) > > The following registers should be listed : > > #define AMD_FAMILY_10h_generic_events > \ > { "PAPI_tlb_dm", "DC_dtlb_L1_miss_L2_miss", 0x7 }, \ > { "PAPI_tlb_im", "IC_itlb_L1_miss_L2_miss", 0x3 }, \ > { "PAPI_l3_dcr", "L3_read_req", 0xf1 }, \ > { "PAPI_l3_icr", "L3_read_req", 0xf2 }, \ > { "PAPI_l3_tcr", "L3_read_req", 0xf7 }, \ > { "PAPI_l3_stm", "L3_miss", 0xf4 }, \ > { "PAPI_l3_ldm", "L3_miss", 0xf3 }, \ > { "PAPI_l3_tcm", "L3_miss", 0xf7 } > > > You should NOT see anything like this : > > root at aequitas:/root# uname -a > SunOS aequitas 5.11 snv_139 i86pc i386 i86pc Solaris > root at aequitas:/root# cpustat -h > cpustat: cannot access performance counters - Operation not applicable > > > ... as well as psrinfo -pv please ? > > > When I get my HP Proliant with the 6174 procs I''ll be sure to post whatever > I see. > > Dennis >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100517/74ed1be7/attachment.html>
Thomas Burgess
2010-May-17 19:51 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
no.....it doesn''t. The only sata ports that show up are the ones connected to the backpane via the reverse breakout sas cable....and they show as empty....so i''m thinking that opensolaris isn''t working with the chipset sata..... In the bios i can select from: Native IDE AMD_AHCI RAID Legacy IDE I have it set to AMD_AHCI....but my board also has an IDE slot which i was using for the CDROM drive (this is what i used to load opensolaris in the first place....) I also have an option called "Sate IDE combined mode" I think this may be my problem...i had this enabled, because i thought i needed it in order to use both sata and ide....i think now it''s something else. I''m going to try to boot without it on, if it doesn''t work, i''ll try to reinstall with it disabled. On Sun, May 16, 2010 at 8:18 PM, Ian Collins <ian at ianshome.com> wrote:> On 05/17/10 12:08 PM, Thomas Burgess wrote: > >> well, i haven''t had a lot of time to work with this...but i''m having >> trouble getting the onboard sata to work in anything but NATIVE IDE mode. >> >> >> I''m not sure exactly what the problem is....i''m wondering if i bought the >> wrong cable (i have a norco 4220 case so the drives connect via a sas >> sff-8087 on the backpane) >> >> I thought this required a "reverse breakout cable" but maybe i was >> wrong....this is the first time i''ve worked with sas >> >> on the otherhand, I was able to flash my intel Intel SASUC8I cards with >> the LSI SAS3081E IT firmware from the LSI site. These seem to work fine. I >> think i''m just going to order a 3rd card and put it in the pci-e x4 slot. I >> don''t want 16 drives running as sata and 4 running in IDE mode. Is there >> any way i can tell if the drive i installed opensolaris to is in IDE or SATA >> mode? >> >> Does it show up in cfgadm? > > -- > Ian. > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100517/094ccb59/attachment.html>
Brandon High
2010-May-17 20:04 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Mon, May 17, 2010 at 12:51 PM, Thomas Burgess <wonslung at gmail.com> wrote:> In the bios i can select from: > Native IDE > AMD_AHCIThis is probably what you want. AHCI is supposed to be chipset agnostic.> I also have an option called ?"Sate IDE combined mode"See if there''s anything in the docs about what this actually does. You might need it to use the PATA port, but it could be what''s messing things up. If you can''t use the cdrom, maybe install from a thumb drive or usb crdrom. (My ASUS M2N-LR board refuses to boot from a thumb drive. Likewise with a friend''s Supermicro Intel board. Both work fine from a usb cdrom.)> I think this may be my problem...i had this enabled, because i thought i > needed it in order to use both sata and ide....i think now it''s something > else.I think so. It makes the first 4 ports look like IDE drives (two channels, two drives per channel) and the remaining BIOS RAID or AHCI. -B -- Brandon High : bhigh at freaks.com
Thomas Burgess
2010-May-17 20:32 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
ok, well this was part of the problem. I disabled the Sata IDE combined mode and reinstalled opensolaris (i tried to just disable it but osol wouldn''t boot) now the drive connected to the SSD DOES show up in cfgadm so it seems to be in sata mode...but the drives connected to the reverse breakout cable still don''t show up. On the bright side, the drives connected to my SAS cards (through the same backpane, with a standard sff-8087 to sff-8087 cable) DO show up. SOOOO, now i just need to figure out why these 4 drives aren''t showing up. (my case is the norco RPC-4220, i thought i''d be ok with 2 SAS cards (8 sata ports each) and then 4 of the onboard ports using the reverse breakout cable.....something must be wrong with the cable....i''ll test the 2 drives connected directly in a bit....i have to take everything appart to do that) On Mon, May 17, 2010 at 4:04 PM, Brandon High <bhigh at freaks.com> wrote:> On Mon, May 17, 2010 at 12:51 PM, Thomas Burgess <wonslung at gmail.com> > wrote: > > In the bios i can select from: > > Native IDE > > AMD_AHCI > > This is probably what you want. AHCI is supposed to be chipset agnostic. > > > I also have an option called "Sate IDE combined mode" > > See if there''s anything in the docs about what this actually does. You > might need it to use the PATA port, but it could be what''s messing > things up. If you can''t use the cdrom, maybe install from a thumb > drive or usb crdrom. (My ASUS M2N-LR board refuses to boot from a > thumb drive. Likewise with a friend''s Supermicro Intel board. Both > work fine from a usb cdrom.) > > > I think this may be my problem...i had this enabled, because i thought i > > needed it in order to use both sata and ide....i think now it''s something > > else. > > I think so. It makes the first 4 ports look like IDE drives (two > channels, two drives per channel) and the remaining BIOS RAID or AHCI. > > -B > > -- > Brandon High : bhigh at freaks.com >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100517/acb947d8/attachment.html>
Dennis Clarke
2010-May-17 21:55 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
>On 05-17-10, Thomas Burgess <wonslung at gmail.com> wrote:? >psrinfo -pv shows: > >The physical processor has 8 virtual processors (0-7) >?? ?x86 ?(AuthenticAMD 100F91 family 16 model 9 step 1 clock 200 MHz) >?? ? ? ? ? ? ? AMD Opteron(tm) Processor 6128 ? [ ?Socket: G34 ] >That''s odd. Please try this : # kstat -m cpu_info -c misc module: cpu_info instance: 0 name: cpu_info0 class: misc brand VIA Esther processor 1200MHz cache_id 0 chip_id 0 clock_MHz 1200 clog_id 0 core_id 0 cpu_type i386 crtime 3288.24125364 current_clock_Hz 1199974847 current_cstate 0 family 6 fpu_type i387 compatible implementation x86 (CentaurHauls 6A9 family 6 model 10 step 9 clock 1200 MHz) model 10 ncore_per_chip 1 ncpu_per_chip 1 pg_id -1 pkg_core_id 0 snaptime 1526742.97169617 socket_type Unknown state on-line state_begin 1272610247 stepping 9 supported_frequencies_Hz 1199974847 supported_max_cstates 0 vendor_id CentaurHauls You should get a LOT more data. Dennis
Thomas Burgess
2010-May-22 00:46 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
here ya go (sorry for the late reply) wonslung at wonslung-raidz2:~$ kstat -m cpu_info -c misc module: cpu_info instance: 0 name: cpu_info0 class: misc brand AMD Opteron(tm) Processor 6128 cache_id 0 chip_id 0 clock_MHz 2000 clog_id 0 core_id 0 cpu_type i386 crtime 9168.3602694 current_clock_Hz 2000000000 current_cstate 1 family 16 fpu_type i387 compatible implementation x86 (chipid 0x0 AuthenticAMD 100F91 family 16 model 9 step 1 clock 2000 MHz) model 9 ncore_per_chip 8 ncpu_per_chip 8 pg_id 3 pkg_core_id 0 snaptime 113230.733339067 socket_type G34 state on-line state_begin 1274377642 stepping 1 supported_frequencies_Hz 800000000:1000000000:1200000000:1500000000:2000000000 supported_max_cstates 0 vendor_id AuthenticAMD module: cpu_info instance: 1 name: cpu_info1 class: misc brand AMD Opteron(tm) Processor 6128 cache_id 1 chip_id 0 clock_MHz 2000 clog_id 1 core_id 1 cpu_type i386 crtime 9171.356087394 current_clock_Hz 2000000000 current_cstate 1 family 16 fpu_type i387 compatible implementation x86 (chipid 0x0 AuthenticAMD 100F91 family 16 model 9 step 1 clock 2000 MHz) model 9 ncore_per_chip 8 ncpu_per_chip 8 pg_id 4 pkg_core_id 1 snaptime 113230.734042092 socket_type G34 state on-line state_begin 1274377645 stepping 1 supported_frequencies_Hz 800000000:1000000000:1200000000:1500000000:2000000000 supported_max_cstates 0 vendor_id AuthenticAMD module: cpu_info instance: 2 name: cpu_info2 class: misc brand AMD Opteron(tm) Processor 6128 cache_id 2 chip_id 0 clock_MHz 2000 clog_id 2 core_id 2 cpu_type i386 crtime 9171.410218363 current_clock_Hz 800000000 current_cstate 0 family 16 fpu_type i387 compatible implementation x86 (chipid 0x0 AuthenticAMD 100F91 family 16 model 9 step 1 clock 2000 MHz) model 9 ncore_per_chip 8 ncpu_per_chip 8 pg_id 5 pkg_core_id 2 snaptime 113230.734600041 socket_type G34 state on-line state_begin 1274377645 stepping 1 supported_frequencies_Hz 800000000:1000000000:1200000000:1500000000:2000000000 supported_max_cstates 0 vendor_id AuthenticAMD module: cpu_info instance: 3 name: cpu_info3 class: misc brand AMD Opteron(tm) Processor 6128 cache_id 3 chip_id 0 clock_MHz 2000 clog_id 3 core_id 3 cpu_type i386 crtime 9171.440232239 current_clock_Hz 2000000000 current_cstate 0 family 16 fpu_type i387 compatible implementation x86 (chipid 0x0 AuthenticAMD 100F91 family 16 model 9 step 1 clock 2000 MHz) model 9 ncore_per_chip 8 ncpu_per_chip 8 pg_id 6 pkg_core_id 3 snaptime 113230.735141762 socket_type G34 state on-line state_begin 1274377645 stepping 1 supported_frequencies_Hz 800000000:1000000000:1200000000:1500000000:2000000000 supported_max_cstates 0 vendor_id AuthenticAMD module: cpu_info instance: 4 name: cpu_info4 class: misc brand AMD Opteron(tm) Processor 6128 cache_id 4 chip_id 0 clock_MHz 2000 clog_id 4 core_id 4 cpu_type i386 crtime 9171.47024948 current_clock_Hz 2000000000 current_cstate 0 family 16 fpu_type i387 compatible implementation x86 (chipid 0x0 AuthenticAMD 100F91 family 16 model 9 step 1 clock 2000 MHz) model 9 ncore_per_chip 8 ncpu_per_chip 8 pg_id 8 pkg_core_id 4 snaptime 113230.735706509 socket_type G34 state on-line state_begin 1274377645 stepping 1 supported_frequencies_Hz 800000000:1000000000:1200000000:1500000000:2000000000 supported_max_cstates 0 vendor_id AuthenticAMD module: cpu_info instance: 5 name: cpu_info5 class: misc brand AMD Opteron(tm) Processor 6128 cache_id 5 chip_id 0 clock_MHz 2000 clog_id 5 core_id 5 cpu_type i386 crtime 9171.500239535 current_clock_Hz 800000000 current_cstate 1 family 16 fpu_type i387 compatible implementation x86 (chipid 0x0 AuthenticAMD 100F91 family 16 model 9 step 1 clock 2000 MHz) model 9 ncore_per_chip 8 ncpu_per_chip 8 pg_id 9 pkg_core_id 5 snaptime 113230.736246782 socket_type G34 state on-line state_begin 1274377645 stepping 1 supported_frequencies_Hz 800000000:1000000000:1200000000:1500000000:2000000000 supported_max_cstates 0 vendor_id AuthenticAMD module: cpu_info instance: 6 name: cpu_info6 class: misc brand AMD Opteron(tm) Processor 6128 cache_id 6 chip_id 0 clock_MHz 2000 clog_id 6 core_id 6 cpu_type i386 crtime 9171.530270099 current_clock_Hz 800000000 current_cstate 1 family 16 fpu_type i387 compatible implementation x86 (chipid 0x0 AuthenticAMD 100F91 family 16 model 9 step 1 clock 2000 MHz) model 9 ncore_per_chip 8 ncpu_per_chip 8 pg_id 10 pkg_core_id 6 snaptime 113230.736783618 socket_type G34 state on-line state_begin 1274377645 stepping 1 supported_frequencies_Hz 800000000:1000000000:1200000000:1500000000:2000000000 supported_max_cstates 0 vendor_id AuthenticAMD module: cpu_info instance: 7 name: cpu_info7 class: misc brand AMD Opteron(tm) Processor 6128 cache_id 7 chip_id 0 clock_MHz 2000 clog_id 7 core_id 7 cpu_type i386 crtime 9171.560266487 current_clock_Hz 2000000000 current_cstate 0 family 16 fpu_type i387 compatible implementation x86 (chipid 0x0 AuthenticAMD 100F91 family 16 model 9 step 1 clock 2000 MHz) model 9 ncore_per_chip 8 ncpu_per_chip 8 pg_id 11 pkg_core_id 7 snaptime 113230.737322698 socket_type G34 state on-line state_begin 1274377645 stepping 1 supported_frequencies_Hz 800000000:1000000000:1200000000:1500000000:2000000000 supported_max_cstates 0 vendor_id AuthenticAMD On Mon, May 17, 2010 at 5:55 PM, Dennis Clarke <dclarke at blastwave.org>wrote:> > >On 05-17-10, Thomas Burgess <wonslung at gmail.com> wrote: > >psrinfo -pv shows: > > > >The physical processor has 8 virtual processors (0-7) > > x86 (AuthenticAMD 100F91 family 16 model 9 step 1 clock 200 MHz) > > AMD Opteron(tm) Processor 6128 [ Socket: G34 ] > > > > That''s odd. > > Please try this : > > # kstat -m cpu_info -c misc > module: cpu_info instance: 0 > name: cpu_info0 class: misc > brand VIA Esther processor 1200MHz > cache_id 0 > chip_id 0 > clock_MHz 1200 > clog_id 0 > core_id 0 > cpu_type i386 > crtime 3288.24125364 > current_clock_Hz 1199974847 > current_cstate 0 > family 6 > fpu_type i387 compatible > implementation x86 (CentaurHauls 6A9 family 6 model > 10 step 9 clock 1200 MHz) > model 10 > ncore_per_chip 1 > ncpu_per_chip 1 > pg_id -1 > pkg_core_id 0 > snaptime 1526742.97169617 > socket_type Unknown > state on-line > state_begin 1272610247 > stepping 9 > supported_frequencies_Hz 1199974847 > supported_max_cstates 0 > vendor_id CentaurHauls > > You should get a LOT more data. > > Dennis > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100521/195df2b9/attachment.html>
Thomas Burgess
2010-May-22 00:54 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
Something i''ve been meaning to ask.... I''m transfering some data from my older server to my newer one. the older server has a socket 775 intel Q9550 8 gb ddr2 800 20 1TB drives in raidz2 (3 vdevs, 2 with 7 drives one with 6) connected to 3 AOC-SAT2-MV8 cards spread as evenly across them as i could The new server is socket g34 based with the opteron 6128 8 core cpu with 16 gb ddr3 1333 ECC ram with 10 2TB drives (so far) in a single raidz2 vdev connected to 3 LSI SAS3081E-R cards (flashed with IT firmware) I''m sure this is due to something i don''t understand, but durring zfs send/recv from the old server to the new server (3 send/recv streams) I''m noticing the loadavg on the old server is muuuuuch less than the new one.... this is form top on the old server: load averages: 1.58, 1.57, 1.37; up 5+05:13:17 04:52:42 and this is the newer server load averages: 6.20, 5.98, 5.30; up 1+05:03:02 18:49:57 shouldn''t the newer server have LESS load? Please forgive my ubernoobness. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100521/6b7419df/attachment.html>
Ian Collins
2010-May-22 01:14 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 05/22/10 12:54 PM, Thomas Burgess wrote:> Something i''ve been meaning to ask.... > > I''m transfering some data from my older server to my newer one. the > older server has a socket 775 intel Q9550 8 gb ddr2 800 20 1TB drives > in raidz2 (3 vdevs, 2 with 7 drives one with 6) connected to 3 > AOC-SAT2-MV8 cards spread as evenly across them as i could > > The new server is socket g34 based with the opteron 6128 8 core cpu > with 16 gb ddr3 1333 ECC ram with 10 2TB drives (so far) in a single > raidz2 vdev connected to 3 LSI SAS3081E-R cards (flashed with IT > firmware) > > I''m sure this is due to something i don''t understand, but durring zfs > send/recv from the old server to the new server (3 send/recv streams) > I''m noticing the loadavg on the old server is muuuuuch less than the > new one.... > > this is form top on the old server: > > load averages: 1.58, 1.57, 1.37; up 5+05:13:17 > 04:52:42 > > > and this is the newer server > > load averages: 6.20, 5.98, 5.30; up 1+05:03:02 > 18:49:57 > > shouldn''t the newer server have LESS load? >Do you have compression on? Compressing is more CPU intensive than uncompressing. -- Ian.
Brandon High
2010-May-22 02:03 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Fri, May 21, 2010 at 5:54 PM, Thomas Burgess <wonslung at gmail.com> wrote:> shouldn''t the newer server have LESS load? > Please forgive my ubernoobness.Depends on what it''s doing! Load average is really how many process are waiting to run, so it''s not always a useful metric. If there are processes waiting on disk, you can have high load with almost no cpu use. Check the iowait with iostat or top. You''ve got a pretty wide stripe, which isn''t going to give the best performance, especially for random write workloads. Your old 3 vdev config will have better random write performance. Check to see what''s using the CPU with top or prstat. prstat gives better info for threads, imo. -B -- Brandon High : bhigh at freaks.com
Thomas Burgess
2010-May-22 02:57 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
is 3 zfs recv''s random? On Fri, May 21, 2010 at 10:03 PM, Brandon High <bhigh at freaks.com> wrote:> On Fri, May 21, 2010 at 5:54 PM, Thomas Burgess <wonslung at gmail.com> > wrote: > > shouldn''t the newer server have LESS load? > > Please forgive my ubernoobness. > > Depends on what it''s doing! > > Load average is really how many process are waiting to run, so it''s > not always a useful metric. If there are processes waiting on disk, > you can have high load with almost no cpu use. Check the iowait with > iostat or top. > > You''ve got a pretty wide stripe, which isn''t going to give the best > performance, especially for random write workloads. Your old 3 vdev > config will have better random write performance. > > Check to see what''s using the CPU with top or prstat. prstat gives > better info for threads, imo. > > -B > > -- > Brandon High : bhigh at freaks.com >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100521/44cf476d/attachment.html>
Thomas Burgess
2010-May-22 03:09 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
yeah, i''m aware of the performance aspects. I use these servers as mostly hd video servers for my house...they don''t need to perform amazingly. I originally went with the setup on the old server because of everything i had read about performance with wide stripes...in all honesty it performed amazingly well, much more than i truly need...i plan to have 2 raidz2 stripes of 10 drives in this server (new one). At most it will be serving 4-5 HD streams (mostly 720p mkv files, with some 1080p as well) The older server can EASILY max out 2 Gb/s links..i imagine the new server will be able to do this as well...i think a scrub of the old server takes 4-5 hours.....i''m not sure what this equates to in MB/s but its WAY more than i ever really need. This is what led me to use wider stripes in the new server, and i''m honestly considering redoing the old server as well, if i switched to 2 wider stripes instead of 3 i''d gain another TB or two....for my use i don''t think that would be a horrible thing. On Fri, May 21, 2010 at 10:03 PM, Brandon High <bhigh at freaks.com> wrote:> On Fri, May 21, 2010 at 5:54 PM, Thomas Burgess <wonslung at gmail.com> > wrote: > > shouldn''t the newer server have LESS load? > > Please forgive my ubernoobness. > > Depends on what it''s doing! > > Load average is really how many process are waiting to run, so it''s > not always a useful metric. If there are processes waiting on disk, > you can have high load with almost no cpu use. Check the iowait with > iostat or top. > > You''ve got a pretty wide stripe, which isn''t going to give the best > performance, especially for random write workloads. Your old 3 vdev > config will have better random write performance. > > Check to see what''s using the CPU with top or prstat. prstat gives > better info for threads, imo. > > -B > > -- > Brandon High : bhigh at freaks.com >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100521/c1d4e8b4/attachment.html>
Brandon High
2010-May-22 04:26 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Fri, May 21, 2010 at 7:57 PM, Thomas Burgess <wonslung at gmail.com> wrote:> is 3 zfs recv''s random?It might be. What do a few reports of ''iostat -xcn 30'' look like? -B -- Brandon High : bhigh at freaks.com
Thomas Burgess
2010-May-22 04:44 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
I can''t tell you for sure.... For some reason the server lost power and it''s taking forever to come back up. (i''m really not sure what happened....) anyways, this leads me to my next couple questions: Is there any way to "resume" a zfs send/recv Why is it taking so long for the server to come up? it''s stuck on "Reading ZFS config" and there is a FLURRY of hard drive lights blinking (all 10 in sync ) On Sat, May 22, 2010 at 12:26 AM, Brandon High <bhigh at freaks.com> wrote:> On Fri, May 21, 2010 at 7:57 PM, Thomas Burgess <wonslung at gmail.com> > wrote: > > is 3 zfs recv''s random? > > It might be. What do a few reports of ''iostat -xcn 30'' look like? > > -B > > -- > Brandon High : bhigh at freaks.com >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100522/3f31ca3a/attachment.html>
Ian Collins
2010-May-22 05:07 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 05/22/10 04:44 PM, Thomas Burgess wrote:> I can''t tell you for sure.... > > For some reason the server lost power and it''s taking forever to come > back up. > > (i''m really not sure what happened....) > > anyways, this leads me to my next couple questions: > > > Is there any way to "resume" a zfs send/recv >Nope.> Why is it taking so long for the server to come up? > it''s stuck on "Reading ZFS config" > > and there is a FLURRY of hard drive lights blinking (all 10 in sync ) >It''s cleaning up the mess. If you had a lot of data copied over, it''ll take a while deleting it! -- Ian.
Thomas Burgess
2010-May-22 05:22 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
yah, it seems that rsync is faster for what i need anyways....at least right now... On Sat, May 22, 2010 at 1:07 AM, Ian Collins <ian at ianshome.com> wrote:> On 05/22/10 04:44 PM, Thomas Burgess wrote: > >> I can''t tell you for sure.... >> >> For some reason the server lost power and it''s taking forever to come back >> up. >> >> (i''m really not sure what happened....) >> >> anyways, this leads me to my next couple questions: >> >> >> Is there any way to "resume" a zfs send/recv >> >> Nope. > > > Why is it taking so long for the server to come up? >> it''s stuck on "Reading ZFS config" >> >> and there is a FLURRY of hard drive lights blinking (all 10 in sync ) >> >> It''s cleaning up the mess. If you had a lot of data copied over, it''ll > take a while deleting it! > > -- > Ian. > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100522/7a1570f1/attachment.html>
Thomas Burgess
2010-May-22 05:35 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
extended device statistics r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.0 0.0 0.0 0.0 0.0 0.0 0.0 983.9 0 0 fd0 3.0 5.5 152.2 67.8 0.0 0.0 5.0 1.2 1 1 c8t1d0 41.3 3.4 1288.3 69.1 0.1 0.1 2.7 3.3 3 8 c5t0d0 41.4 3.6 1288.0 69.0 0.1 0.2 2.0 3.4 3 7 c4t0d0 41.4 3.5 1287.4 69.1 0.1 0.1 2.6 3.3 3 8 c4t1d0 41.3 3.5 1289.1 69.1 0.1 0.2 2.1 3.6 3 7 c5t1d0 40.9 3.6 1267.8 66.6 0.1 0.1 2.2 3.0 3 7 c4t2d0 40.7 3.5 1269.1 66.6 0.1 0.1 2.4 3.2 3 7 c5t2d0 40.9 3.6 1267.9 66.6 0.1 0.1 2.4 3.1 3 7 c4t3d0 41.3 3.5 1288.6 69.0 0.1 0.2 2.1 3.5 3 7 c5t3d0 28.0 3.3 1060.1 60.3 0.0 0.1 1.2 2.4 1 4 c4t5d0 27.8 3.2 1053.8 60.3 0.0 0.1 1.2 2.5 1 4 c5t4d0 40.8 3.5 1268.8 66.6 0.1 0.1 2.3 3.1 3 7 c5t5d0 28.1 3.1 1067.1 60.3 0.0 0.1 1.3 2.5 1 4 c5t6d0 28.2 3.1 1072.2 60.3 0.0 0.1 1.2 2.5 1 4 c5t7d0 40.7 3.6 1268.3 66.6 0.1 0.1 2.0 3.3 3 7 c6t0d0 41.3 3.5 1288.6 69.1 0.1 0.1 2.6 3.3 3 8 c6t1d0 40.7 3.5 1269.2 66.6 0.1 0.1 2.5 3.2 3 8 c6t2d0 41.3 3.6 1288.7 69.0 0.1 0.2 2.1 3.5 3 7 c6t3d0 40.8 3.5 1268.8 66.6 0.1 0.1 2.4 3.1 3 7 c6t4d0 29.0 3.2 1111.5 60.3 0.0 0.1 1.3 2.5 1 4 c6t5d0 28.9 3.2 1112.6 60.3 0.0 0.1 1.3 2.6 1 4 c6t6d0 2.4 15.8 57.0 1962.8 0.2 0.0 10.0 1.8 3 3 c8t5d0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.2 0 0 c4t7d0 cpu us sy wt id 40 32 0 28 extended device statistics r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 fd0 1.8 2.3 13.7 34.7 0.0 0.0 3.0 0.9 0 0 c8t1d0 106.1 2.4 5636.1 101.4 0.5 0.2 4.3 1.5 13 16 c5t0d0 107.0 2.5 5607.5 101.4 0.3 0.2 2.5 2.0 8 14 c4t0d0 109.6 2.4 5625.9 101.3 0.4 0.1 3.4 1.3 11 14 c4t1d0 103.9 2.4 5665.5 101.3 0.3 0.3 2.9 2.4 9 15 c5t1d0 111.0 2.8 5646.9 100.7 0.4 0.1 3.3 1.3 11 15 c4t2d0 105.0 2.9 5700.7 100.7 0.5 0.2 5.0 1.6 14 17 c5t2d0 109.2 2.8 5635.1 100.6 0.4 0.1 3.6 1.3 12 15 c4t3d0 104.6 2.4 5676.6 101.4 0.3 0.3 2.9 2.4 8 15 c5t3d0 51.9 2.3 3622.1 90.0 0.1 0.2 1.5 3.4 3 8 c4t5d0 54.3 2.0 3696.0 90.0 0.3 0.1 4.4 1.5 7 8 c5t4d0 106.6 2.8 5679.7 100.6 0.3 0.3 2.8 2.8 8 16 c5t5d0 93.3 2.1 6861.6 89.7 0.5 0.1 4.9 1.6 12 15 c5t6d0 85.3 2.1 6186.8 89.9 0.3 0.2 3.4 2.8 7 14 c5t7d0 106.2 2.6 5678.9 100.6 0.3 0.3 2.8 2.4 8 14 c6t0d0 104.2 2.2 5674.1 101.3 0.3 0.3 3.1 2.9 9 16 c6t1d0 104.6 2.9 5655.1 100.7 0.3 0.3 3.2 2.8 9 16 c6t2d0 104.7 2.4 5660.9 101.4 0.3 0.3 3.0 2.4 9 15 c6t3d0 106.2 2.8 5691.6 100.7 0.5 0.2 4.1 1.4 12 16 c6t4d0 60.0 2.1 3987.1 89.9 0.2 0.1 3.9 1.4 7 9 c6t5d0 64.9 2.2 4581.7 89.9 0.0 0.3 0.6 4.8 2 10 c6t6d0 1.5 177.6 38.3 22270.8 2.6 0.4 14.5 2.2 36 39 c8t5d0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c4t7d0 cpu us sy wt id 41 33 0 26 extended device statistics r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 fd0 1.5 4.2 10.2 65.9 0.0 0.0 4.7 1.1 1 1 c8t1d0 108.2 2.3 5851.0 104.4 0.5 0.2 4.6 1.6 14 18 c5t0d0 110.5 2.4 5851.0 104.4 0.0 0.5 0.0 4.7 0 15 c4t0d0 114.5 2.3 5828.3 104.4 0.4 0.2 3.7 1.4 12 16 c4t1d0 106.1 2.5 5874.3 104.5 0.0 0.6 0.0 5.4 0 16 c5t1d0 111.9 2.6 5937.4 101.9 0.4 0.2 3.7 1.4 12 16 c4t2d0 107.0 2.7 5958.2 101.8 0.5 0.2 4.6 1.6 14 18 c5t2d0 112.4 2.9 5960.2 102.0 0.4 0.2 3.7 1.4 11 16 c4t3d0 105.0 2.4 5890.0 104.4 0.0 0.6 0.0 5.5 0 17 c5t3d0 64.2 2.1 4534.2 91.2 0.1 0.2 1.8 3.6 4 10 c4t5d0 42.4 2.2 2964.4 91.2 0.2 0.1 4.0 3.3 4 8 c5t4d0 107.3 2.7 5937.3 102.0 0.2 0.4 2.0 3.9 6 17 c5t5d0 88.3 2.0 6630.2 91.1 0.5 0.2 5.5 1.7 12 15 c5t6d0 82.5 1.9 6108.0 90.9 0.0 0.5 0.0 6.3 0 13 c5t7d0 106.2 2.6 5965.5 101.8 0.0 0.6 0.0 5.5 0 16 c6t0d0 108.4 2.4 5891.2 104.5 0.0 0.7 0.0 6.5 0 19 c6t1d0 107.3 2.7 5977.0 102.0 0.2 0.5 1.9 4.2 6 18 c6t2d0 105.6 2.5 5879.0 104.4 0.0 0.6 0.0 5.7 0 17 c6t3d0 107.8 2.5 5949.5 101.9 0.5 0.2 4.2 1.5 13 17 c6t4d0 55.7 2.0 3821.3 91.1 0.3 0.2 4.7 3.0 6 10 c6t5d0 81.2 2.0 5866.7 91.2 0.2 0.4 1.9 5.2 5 14 c6t6d0 0.9 227.2 23.4 28545.1 4.7 0.6 20.4 2.8 63 64 c8t5d0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c4t7d0 cpu us sy wt id 39 32 0 29 extended device statistics r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 fd0 1.5 2.4 35.4 33.6 0.0 0.0 3.6 1.0 0 0 c8t1d0 105.8 1.9 5560.1 95.5 0.3 0.3 2.7 2.9 8 16 c5t0d0 109.6 2.5 5546.4 95.6 0.0 0.5 0.0 4.3 0 13 c4t0d0 110.8 2.6 5504.7 95.4 0.3 0.3 2.2 2.6 7 15 c4t1d0 104.6 2.4 5596.9 95.5 0.0 0.6 0.0 5.4 0 15 c5t1d0 109.9 2.2 5522.1 86.1 0.2 0.3 2.0 2.5 7 14 c4t2d0 104.6 1.9 5533.6 86.2 0.3 0.3 2.5 3.1 7 16 c5t2d0 109.2 2.7 5498.4 86.1 0.2 0.3 2.1 2.4 7 14 c4t3d0 105.3 2.9 5593.8 95.5 0.0 0.6 0.0 5.1 0 15 c5t3d0 57.8 1.9 3938.4 90.7 0.2 0.1 3.5 1.5 6 9 c4t5d0 50.8 2.3 3298.6 90.8 0.0 0.3 0.0 5.2 0 8 c5t4d0 105.0 2.6 5541.2 86.1 0.4 0.2 3.7 1.4 11 15 c5t5d0 90.8 2.3 6376.7 90.7 0.2 0.3 2.4 3.1 6 13 c5t6d0 87.4 1.8 6085.2 90.6 0.0 0.5 0.0 5.4 0 13 c5t7d0 104.2 2.4 5550.8 86.1 0.0 0.5 0.0 5.0 0 14 c6t0d0 106.8 2.4 5543.6 95.5 0.0 0.6 0.0 5.5 0 16 c6t1d0 105.4 2.5 5517.5 86.1 0.4 0.2 3.8 1.4 12 16 c6t2d0 106.6 2.4 5569.1 95.6 0.0 0.5 0.0 5.0 0 15 c6t3d0 107.2 2.2 5536.4 86.1 0.2 0.3 2.1 2.8 7 15 c6t4d0 61.2 2.4 4085.2 90.7 0.0 0.3 0.0 5.4 0 10 c6t5d0 70.3 1.8 5018.2 90.7 0.3 0.1 4.7 1.7 9 12 c6t6d0 0.8 203.3 12.3 25514.5 3.9 0.6 19.2 2.7 54 55 c8t5d0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c4t7d0 cpu us sy wt id 38 30 0 32 extended device statistics r/s w/s kr/s kw/s wait actv wsvc_t asvc_t %w %b device 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 fd0 2.2 2.5 64.2 35.2 0.0 0.0 3.3 0.9 0 0 c8t1d0 98.6 3.1 5441.3 110.3 0.0 0.6 0.0 5.9 0 16 c5t0d0 102.1 3.7 5392.7 110.2 0.0 0.5 0.0 4.3 0 13 c4t0d0 104.1 3.3 5390.7 110.4 0.0 0.5 0.0 5.0 0 15 c4t1d0 98.2 3.0 5437.3 110.2 0.0 0.5 0.0 5.1 0 14 c5t1d0 104.7 3.8 5437.3 104.5 0.0 0.5 0.0 4.8 0 15 c4t2d0 97.7 3.4 5481.1 104.6 0.0 0.6 0.0 6.0 0 16 c5t2d0 103.1 3.4 5468.4 104.6 0.0 0.6 0.0 5.2 0 15 c4t3d0 98.7 3.0 5415.2 110.3 0.0 0.5 0.0 5.1 0 14 c5t3d0 55.7 3.1 3883.4 93.7 0.1 0.1 2.0 2.5 4 8 c4t5d0 44.5 2.9 3141.2 93.6 0.0 0.3 0.0 5.5 0 7 c5t4d0 99.2 3.3 5464.0 104.5 0.4 0.2 4.2 1.5 12 15 c5t5d0 82.3 2.8 6119.3 93.4 0.0 0.5 0.0 6.4 0 14 c5t6d0 75.2 2.7 5601.1 93.4 0.1 0.4 1.7 4.8 3 13 c5t7d0 97.8 3.1 5458.8 104.5 0.0 0.5 0.0 5.2 0 14 c6t0d0 99.2 3.2 5441.5 110.2 0.0 0.6 0.0 5.8 0 16 c6t1d0 98.4 3.0 5475.7 104.6 0.3 0.4 3.0 3.5 8 17 c6t2d0 99.8 3.0 5434.4 110.1 0.0 0.5 0.0 5.1 0 14 c6t3d0 100.6 3.2 5453.9 104.6 0.0 0.6 0.0 5.5 0 15 c6t4d0 54.9 3.0 3878.1 93.5 0.1 0.2 1.5 4.2 3 9 c6t5d0 68.4 2.9 5128.3 93.5 0.2 0.3 3.1 4.2 6 13 c6t6d0 0.9 201.9 34.2 25338.0 3.8 0.5 18.9 2.6 51 52 c8t5d0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0 0 c4t7d0 On Sat, May 22, 2010 at 12:26 AM, Brandon High <bhigh at freaks.com> wrote:> On Fri, May 21, 2010 at 7:57 PM, Thomas Burgess <wonslung at gmail.com> > wrote: > > is 3 zfs recv''s random? > > It might be. What do a few reports of ''iostat -xcn 30'' look like? > > -B > > -- > Brandon High : bhigh at freaks.com >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100522/03f0d14a/attachment.html>
Ian Collins
2010-May-22 05:45 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On 05/22/10 05:22 PM, Thomas Burgess wrote:> yah, it seems that rsync is faster for what i need anyways....at least > right now... >ZFS send/receive should run at wire speed for a Gig-E link. Ian.
Thomas Burgess
2010-May-22 05:50 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
well it wasn''t. it was running pretty slow. i had one "really big" filesystem....with rsync i''m able to do multiple streams and it''s moving much faster On Sat, May 22, 2010 at 1:45 AM, Ian Collins <ian at ianshome.com> wrote:> On 05/22/10 05:22 PM, Thomas Burgess wrote: > >> yah, it seems that rsync is faster for what i need anyways....at least >> right now... >> >> ZFS send/receive should run at wire speed for a Gig-E link. > > Ian. > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100522/fe4fe579/attachment.html>
Brandon High
2010-May-22 06:34 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
You can "resume" a send if the destination has a snapshot in common with the source. If you don''t, there''s nothing you can do. It probably taking a while to restart because the sends that were interrupted need to be rolled back. Sent from my Nexus One. On May 21, 2010 9:44 PM, "Thomas Burgess" <wonslung at gmail.com> wrote: I can''t tell you for sure.... For some reason the server lost power and it''s taking forever to come back up. (i''m really not sure what happened....) anyways, this leads me to my next couple questions: Is there any way to "resume" a zfs send/recv Why is it taking so long for the server to come up? it''s stuck on "Reading ZFS config" and there is a FLURRY of hard drive lights blinking (all 10 in sync ) On Sat, May 22, 2010 at 12:26 AM, Brandon High <bhigh at freaks.com> wrote:> > On Fri, May 21, 201...-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100521/db11f1a2/attachment.html>
Thomas Burgess
2010-May-22 07:06 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
yah, unfortunately this is the first send. i''m trying to send 9 TB of data. It really sucks because i was at 6 TB when it lost power.... On Sat, May 22, 2010 at 2:34 AM, Brandon High <bhigh at freaks.com> wrote:> You can "resume" a send if the destination has a snapshot in common with > the source. If you don''t, there''s nothing you can do. > > It probably taking a while to restart because the sends that were > interrupted need to be rolled back. > > Sent from my Nexus One. > > On May 21, 2010 9:44 PM, "Thomas Burgess" <wonslung at gmail.com> wrote: > > I can''t tell you for sure.... > > For some reason the server lost power and it''s taking forever to come back > up. > > (i''m really not sure what happened....) > > anyways, this leads me to my next couple questions: > > > Is there any way to "resume" a zfs send/recv > > Why is it taking so long for the server to come up? > it''s stuck on "Reading ZFS config" > > and there is a FLURRY of hard drive lights blinking (all 10 in sync ) > > > > > > On Sat, May 22, 2010 at 12:26 AM, Brandon High <bhigh at freaks.com> wrote: > > > > On Fri, May 21, 201... > >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100522/bda7e851/attachment.html>
Brandon High
2010-May-22 07:43 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On Fri, May 21, 2010 at 10:22 PM, Thomas Burgess <wonslung at gmail.com> wrote:> yah, it seems that rsync is faster for what i need anyways....at least right > now...If you don''t have snapshots you want to keep in the new copy, then probably... -B -- Brandon High : bhigh at freaks.com
Thomas Burgess
2010-May-22 08:05 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
i only care about the most recent snapshot, as this is a growing video collection. i do have snapshots, but i only keep them for when/if i accidently delete something, or rename something wrong. On Sat, May 22, 2010 at 3:43 AM, Brandon High <bhigh at freaks.com> wrote:> On Fri, May 21, 2010 at 10:22 PM, Thomas Burgess <wonslung at gmail.com> > wrote: > > yah, it seems that rsync is faster for what i need anyways....at least > right > > now... > > If you don''t have snapshots you want to keep in the new copy, then > probably... > > -B > > -- > Brandon High : bhigh at freaks.com >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://mail.opensolaris.org/pipermail/zfs-discuss/attachments/20100522/e03fe5a8/attachment.html>
Richard Elling
2010-May-23 04:42 UTC
[zfs-discuss] Opteron 6100? Does it work with opensolaris?
On May 21, 2010, at 7:03 PM, Brandon High wrote:> On Fri, May 21, 2010 at 5:54 PM, Thomas Burgess <wonslung at gmail.com> wrote: >> shouldn''t the newer server have LESS load? >> Please forgive my ubernoobness. > > Depends on what it''s doing! > > Load average is really how many process are waiting to run, so it''s > not always a useful metric. If there are processes waiting on disk, > you can have high load with almost no cpu use. Check the iowait with > iostat or top.iowait is defined to be 0. It is a useless metric anyway. -- richard -- ZFS and NexentaStor training, Rotterdam, July 13-15, 2010 http://nexenta-rotterdam.eventbrite.com/