sending to lustre-devel@ as well Hello, A new Lustre ADIO driver for MPICH2-1.0.7 is available now, which is co-developed by SUN Lustre group and Oak Ridge National Lab. (The patch is attached.) Any feedback and performance results are welcomed. Thanks, LiuYing -- Best regards, LiuYing System Software Engineer, Lustre Group Sun Microsystems ( China ) Co. Limited -------------- next part -------------- A non-text attachment was scrubbed... Name: adio_driver_mpich2-1.0.7.patch Type: text/x-patch Size: 95750 bytes Desc: not available Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20081105/01440520/attachment-0001.bin
Hi, Here is some description and performance results for the new Lustre ADIO driver. You might be interested. The main purpose of the new lustre adio driver is to collect the small size I/O requests into fewer number of larger ones according to Lustre''s striping feature with low overhead automatically. We also provide some hints for performance tuning. In the following graph, the recent FLASH I/O benchmarking result shows that the new driver performs much better than the old one, especially for a large-scale system. In this test, FLASH I/O blocksize is 4*4*4 that means each 3 clients write 40KB, 40.5KB and 42KB respectively. The I/O operation iteration (nvar) is set to 1024. HTH, LiuYing emoly.liu wrote:> sending to lustre-devel@ as well > > Hello, > > A new Lustre ADIO driver for MPICH2-1.0.7 is available now, which is > co-developed by SUN Lustre group and Oak Ridge National Lab. (The > patch is attached.) > > Any feedback and performance results are welcomed. > > Thanks, > LiuYing > > ------------------------------------------------------------------------ > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss-- Best regards, LiuYing System Software Engineer, Lustre Group Sun Microsystems ( China ) Co. Limited -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20081105/5e7aa2f1/attachment-0001.html -------------- next part -------------- A non-text attachment was scrubbed... Name: flashio_perf.png Type: image/png Size: 26625 bytes Desc: not available Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20081105/5e7aa2f1/attachment-0001.png
Robert Latham
2008-Nov-12 17:35 UTC
[Lustre-discuss] [Lustre-devel] a new Lustre ADIO driver
On Wed, Nov 05, 2008 at 02:46:41PM +0800, emoly.liu wrote:> Hi, > > Here is some description and performance results for the new Lustre ADIO > driver. You might be interested. > > The main purpose of the new lustre adio driver is to collect the small > size I/O requests into fewer number of larger ones according to Lustre''s > striping feature with low overhead automatically. We also provide some > hints for performance tuning. > > In the following graph, the recent FLASH I/O benchmarking result shows > that the new driver performs much better than the old one, especially > for a large-scale system. > In this test, FLASH I/O blocksize is 4*4*4 that means each 3 clients > write 40KB, 40.5KB and 42KB respectively. The I/O operation iteration > (nvar) is set to 1024.Hi LiuYing Since this patch is for ROMIO and not really for Lustre, could you send this to romio-maint at mcs.anl.gov ? It will reach more of the ROMIO developers that way. Thanks ==rob -- Rob Latham Mathematics and Computer Science Division A215 0178 EA2D B059 8CDF Argonne National Lab, IL USA B29D F333 664A 4280 315B
Hi Robert, Robert Latham wrote:> > Hi LiuYing > > Since this patch is for ROMIO and not really for Lustre, could you > send this to romio-maint at mcs.anl.gov ? It will reach more of the > ROMIO developers that way. > > Thanks > ==rob > >Thanks for your advice. I will send it soon. -LiuYing -- Best regards, LiuYing System Software Engineer, Lustre Group Sun Microsystems ( China ) Co. Limited -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20081128/f9097ded/attachment-0001.html