Hi-- Chris Samuel wrote:> > I''m trying to set up a combined MDS/OST which has dual interfaces, both using > a nettype of tcp (one over ethernet, one over myrinet).You''re the second person to ask for that lately, and I''ll have to apologetically say the same thing: what you want to do is totally possible, but I don''t have any documentation for you yet. Someone is on the hook for that, and I made him aware of my very urgent desire for these docs, so I really hope to have something by the end of the week. I''ll email the list when it''s available. Thanks-- -Phil
Maybe of notable mention:
During my initial Lustre stress tests with running the basic configuration
(1/OSS per OST node), there''s >50% utilization on those systems
under heavy
I/O loads, so I''m quite certain that running 2/OSSs on a single OST
node
would not scale like 2 dedicated OSTs, and adding an addt''l work for
MDS on
that node would further increase utilization on that node.
...but still worth investigating if some performance gain can be onbtained
without adding add''l hardware.
Regards,
Donny
---
-----------------------------------
Donny Cooper
NEC Solutions (America), Inc.
Advanced Technical Computing Center
Tel: 281.465.1506
Donny.Cooper@NECsam.com
-----------------------------------
-----Original Message-----
From: lustre-discuss-admin@lists.clusterfs.com
[mailto:lustre-discuss-admin@lists.clusterfs.com] On Behalf Of Phil Schwan
Sent: Monday, April 05, 2004 10:46 PM
To: Chris Samuel
Cc: lustre-discuss@lists.clusterfs.com
Subject: Re: [Lustre-discuss] Lustre OST with dual interfaces
Hi--
Chris Samuel wrote:>
> I''m trying to set up a combined MDS/OST which has dual interfaces,
> both using a nettype of tcp (one over ethernet, one over myrinet).
You''re the second person to ask for that lately, and I''ll have
to
apologetically say the same thing: what you want to do is totally possible,
but I don''t have any documentation for you yet.
Someone is on the hook for that, and I made him aware of my very urgent
desire for these docs, so I really hope to have something by the end of the
week. I''ll email the list when it''s available.
Thanks--
-Phil
_______________________________________________
Lustre-discuss mailing list
Lustre-discuss@lists.clusterfs.com
https://lists.clusterfs.com/mailman/listinfo/lustre-discuss
=2D----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi folks, I''m trying to set up a combined MDS/OST which has dual interfaces, both using a nettype of tcp (one over ethernet, one over myrinet). The Myrinet works fine, but I cannot mount from another system over ethernet. All it logs are messages saying: LustreError: 18504:(socknal_cb.c:2119:ksocknal_hello()) Connected to nid 0xac280102 0:172.40.1.2, but expecting 0x83aab82c 0:172.40.1.2 LustreError: 18504:(socknal_cb.c:2436:ksocknal_autoconnect()) Deleting packet type 1 len 168 (0x83aab828 0:131.170.184.40->0x83aab82c 0:131.170.184.40) I''m setting the node up with: lmc -o config.xml --add net --node stgnode2 --nid stgnode2-m --nettype tcp lmc -m config.xml --add net --node stgnode2 --nid brecca-s2.vpac.org --port 989 --nettype tcp where stgnode2-m is 172.40.1.2 and brecca-s2.vpac.org is 131.170.184.44, the client system is 131.170.184.40. I''ve had to specify a different port number as otherwise lconf complains about "duplicate port numbers" when I''m trying to format the OST''s & MDS. :-( I''ve tried the following in my /etc/fstab, all of which fail in the same way. brecca-s2:/mds1/client /home/lustre lustre noauto,nettype=3Dtcp 0 0 brecca-s2:/brecca-s2/client /home/lustre lustre noauto,nettype=3Dtcp 0 0 brecca-s2:/NET_stgnode2_tcp_2/client /home/lustre lustre noauto,nettype=3Dtcp 0 0 Any clues ? cheers! Chris =2D --=20 Christopher Samuel - (03)9925 4751 - VPAC Systems & Network Admin Victorian Partnership for Advanced Computing http://www.vpac.org/ Bldg 91, 110 Victoria Street, Carlton South, VIC 3053, Australia =2D----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.2 (GNU/Linux) iD8DBQFAbR6AO2KABBYQAh8RAn46AJ4/SkJJu45JRA1ScKZcVS0BBdfJmQCeJpna yCDaHWnPQaio1I+FSuA99PA=3D =3Dm9RC =2D----END PGP SIGNATURE-----