Brock Palen
2011-Jan-03 15:24 UTC
[Lustre-discuss] lustre routing between two IP networks (public private)
Is it possible to use a lustre router to route a lustre file system that is on a different network (ip based) to our private (10.x) network? Can this be done with a normal NAT? We have another campuses lustre filesystem we would like to mount on our compute nodes, but the nodes are on a 10.x network, Thanks! Brock Palen www.umich.edu/~brockp Center for Advanced Computing brockp at umich.edu (734)936-1985
DEGREMONT Aurelien
2011-Jan-04 14:48 UTC
[Lustre-discuss] lustre routing between two IP networks (public private)
Hello I''m not sure at all that IP-based routing will behave correctly with Lustre. What I would advice instead is to used LNET router instead, between your 10.x network and the other one. This will work for sure. Aur?lien Brock Palen a ?crit :> Is it possible to use a lustre router to route a lustre file system that is on a different network (ip based) to our private (10.x) network? > > Can this be done with a normal NAT? > > We have another campuses lustre filesystem we would like to mount on our compute nodes, but the nodes are on a 10.x network, > > Thanks! > >
Bob Ball
2011-Jan-04 15:00 UTC
[Lustre-discuss] lustre routing between two IP networks (public private)
We have 3 machines that live on both the private network where the bulk of the lustre clients and all the servers are located, and several clients on the second network of the 3 machines that also need to access the lustre file system. We do this via lnet routing. From the modprobe.conf on each machine: Typical clients on the "primary" network: options lnet networks=tcp0(eth0) The 3 router machines: options lnet networks=tcp0(eth0),tcp2(eth1.562) forwarding="enabled" The remote clients: options lnet networks="tcp2(eth0)" routes="tcp0 141.211.101.[9,11,97]@tcp2" check_routers_before_use=1 auto_down=1 dead_router_check_interval=50 live_router_check_interval=100 On the OSS machines: options lnet networks=tcp0(bond0.4010) routes="tcp2 10.10.1.[50-52]@tcp0" bob On 1/4/2011 9:48 AM, DEGREMONT Aurelien wrote:> Hello > > I''m not sure at all that IP-based routing will behave correctly with Lustre. > What I would advice instead is to used LNET router instead, between your > 10.x network and the other one. This will work for sure. > > > Aur?lien > > Brock Palen a ?crit : >> Is it possible to use a lustre router to route a lustre file system that is on a different network (ip based) to our private (10.x) network? >> >> Can this be done with a normal NAT? >> >> We have another campuses lustre filesystem we would like to mount on our compute nodes, but the nodes are on a 10.x network, >> >> Thanks! >> >> > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss > >
Bob Ball
2011-Jan-04 15:05 UTC
[Lustre-discuss] lustre routing between two IP networks (public private)
I forgot to mention, the mgs also has addresses on both networks. options lnet networks="tcp0(eth0),tcp2(eth2)" The MDT does NOT have addresses on both networks. bob On 1/4/2011 10:00 AM, Bob Ball wrote:> We have 3 machines that live on both the private network where the bulk > of the lustre clients and all the servers are located, and several > clients on the second network of the 3 machines that also need to access > the lustre file system. We do this via lnet routing. From the > modprobe.conf on each machine: > > Typical clients on the "primary" network: > options lnet networks=tcp0(eth0) > > The 3 router machines: > options lnet networks=tcp0(eth0),tcp2(eth1.562) forwarding="enabled" > > The remote clients: > options lnet networks="tcp2(eth0)" routes="tcp0 > 141.211.101.[9,11,97]@tcp2" check_routers_before_use=1 auto_down=1 > dead_router_check_interval=50 live_router_check_interval=100 > > On the OSS machines: > options lnet networks=tcp0(bond0.4010) routes="tcp2 10.10.1.[50-52]@tcp0" > > bob > > On 1/4/2011 9:48 AM, DEGREMONT Aurelien wrote: >> Hello >> >> I''m not sure at all that IP-based routing will behave correctly with Lustre. >> What I would advice instead is to used LNET router instead, between your >> 10.x network and the other one. This will work for sure. >> >> >> Aur?lien >> >> Brock Palen a ?crit : >>> Is it possible to use a lustre router to route a lustre file system that is on a different network (ip based) to our private (10.x) network? >>> >>> Can this be done with a normal NAT? >>> >>> We have another campuses lustre filesystem we would like to mount on our compute nodes, but the nodes are on a 10.x network, >>> >>> Thanks! >>> >>> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> http://lists.lustre.org/mailman/listinfo/lustre-discuss >> >> > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss > >
Eudes PHILIPPE
2011-Jan-04 15:08 UTC
[Lustre-discuss] lustre routing between two IP networks (public private)
Make an alias with an address on other network? -----Message d''origine----- De?: lustre-discuss-bounces at lists.lustre.org [mailto:lustre-discuss-bounces at lists.lustre.org] De la part de Bob Ball Envoy??: mardi 4 janvier 2011 16:06 ??: lustre-discuss at lists.lustre.org Objet?: Re: [Lustre-discuss] lustre routing between two IP networks (public private) I forgot to mention, the mgs also has addresses on both networks. options lnet networks="tcp0(eth0),tcp2(eth2)" The MDT does NOT have addresses on both networks. bob On 1/4/2011 10:00 AM, Bob Ball wrote:> We have 3 machines that live on both the private network where the > bulk of the lustre clients and all the servers are located, and > several clients on the second network of the 3 machines that also need > to access the lustre file system. We do this via lnet routing. From > the modprobe.conf on each machine: > > Typical clients on the "primary" network: > options lnet networks=tcp0(eth0) > > The 3 router machines: > options lnet networks=tcp0(eth0),tcp2(eth1.562) forwarding="enabled" > > The remote clients: > options lnet networks="tcp2(eth0)" routes="tcp0 > 141.211.101.[9,11,97]@tcp2" check_routers_before_use=1 auto_down=1 > dead_router_check_interval=50 live_router_check_interval=100 > > On the OSS machines: > options lnet networks=tcp0(bond0.4010) routes="tcp2 10.10.1.[50-52]@tcp0" > > bob > > On 1/4/2011 9:48 AM, DEGREMONT Aurelien wrote: >> Hello >> >> I''m not sure at all that IP-based routing will behave correctly withLustre.>> What I would advice instead is to used LNET router instead, between >> your 10.x network and the other one. This will work for sure. >> >> >> Aur?lien >> >> Brock Palen a ?crit : >>> Is it possible to use a lustre router to route a lustre file system thatis on a different network (ip based) to our private (10.x) network?>>> >>> Can this be done with a normal NAT? >>> >>> We have another campuses lustre filesystem we would like to mount on >>> our compute nodes, but the nodes are on a 10.x network, >>> >>> Thanks! >>> >>> >> _______________________________________________ >> Lustre-discuss mailing list >> Lustre-discuss at lists.lustre.org >> http://lists.lustre.org/mailman/listinfo/lustre-discuss >> >> > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss > >_______________________________________________ Lustre-discuss mailing list Lustre-discuss at lists.lustre.org http://lists.lustre.org/mailman/listinfo/lustre-discuss