Do, Jong-Gwan
2006-Aug-09 01:19 UTC
[Lustre-discuss] Serving to different client via GigE and Infiniband
Hello, Is it possible single Lustre filesystem to serve to both side with GigE and Infiniband? There will be no Lustre client which will mount using both GigE and Infiniband. Some client will mount via GigE and another will mount via Infiniband. Thanks.
Pauln
2006-Aug-09 07:35 UTC
[Lustre-discuss] Serving to different client via GigE and Infiniband
Jong-Wan,
I use the ip2nets module parameter to do this. The preferred network,
openib
in thise case, is specified first. The rest of this stuff is taken from an
oss node which is on ib and gige because its ip addresses (eth2, ib0)
fall into
ip2nets ranges for both networks.
paul
/etc/modprobe.conf:
options lnet ip2nets="openib0 10.10.101.[0-255]; tcp0(eth0)
192.168.112.[0-255]" \
routes="tcp [3,7]@ptl0; ptl 192.168.112.[58,59]@tcp0"
(root@oss03p:~)$ lctl list_nids
oss03p-ib@openib
oss03p@tcp
eth2 Link encap:Ethernet HWaddr 00:04:23:BD:CE:42
inet addr:192.168.112.113 Bcast:192.168.127.255
Mask:255.255.240.0
UP BROADCAST RUNNING MULTICAST MTU:9000 Metric:1
RX packets:6277668 errors:0 dropped:0 overruns:0 frame:0
TX packets:5945352 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:35990881635 (33.5 GiB) TX bytes:34809121540 (32.4 GiB)
Base address:0x2000 Memory:d0140000-d0160000
ib0 Link encap:UNSPEC HWaddr
00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00
inet addr:10.10.101.33 Bcast:10.255.255.255 Mask:255.0.0.0
UP BROADCAST RUNNING MULTICAST MTU:2044 Metric:1
RX packets:38 errors:0 dropped:0 overruns:0 frame:0
TX packets:27 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:2048
RX bytes:2316 (2.2 KiB) TX bytes:1856 (1.8 KiB)
Do, Jong-Gwan wrote:> Hello,
>
> Is it possible single Lustre filesystem to serve to both side with
> GigE and Infiniband?
> There will be no Lustre client which will mount using both GigE and
> Infiniband.
> Some client will mount via GigE and another will mount via Infiniband.
>
> Thanks.
>
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss@clusterfs.com
> https://mail.clusterfs.com/mailman/listinfo/lustre-discuss
Peter Braam
2006-Aug-09 11:04 UTC
[Lustre-discuss] Serving to different client via GigE and Infiniband
Yes, this is possible, and version 1.6 (for which there are betas make this quite easy). For documentation see the manual and the wiki page on 1.6: https://mail.clusterfs.com/wikis/lustre/LustreDocumentation https://mail.clusterfs.com/wikis/lustre/MountConf - Peter - Do, Jong-Gwan wrote:> Hello, > > Is it possible single Lustre filesystem to serve to both side with > GigE and Infiniband? > There will be no Lustre client which will mount using both GigE and > Infiniband. > Some client will mount via GigE and another will mount via Infiniband. > > Thanks. > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss@clusterfs.com > https://mail.clusterfs.com/mailman/listinfo/lustre-discuss