Hi Christophe-- This is listed in the "Known Bugs" section of the 1.0.x download page: http://clusterfs.com/download-public.html This issue is fixed in Lustre 1.2 and newer versions. Thanks-- -Phil On 10/26/2004 7:20, Christophe Nowicki wrote:> Hi all, > > I''ve setup a lustre cluster on two nodes (fallowing the wiki > instructions). One node is a mds and client and > another is an ost. > I''ve mounted the lustre fs on /mnt/lustre : > > # df -h > Filesystem Size Used Avail Use% Mounted on > [...] > config 95M 4.2M 86M 5% /mnt/lustre > > When I try to create a file larger than the current free space : > > # dd if=/dev/zero of=test bs=1M count=100 > 100+0 records in > 100+0 records out > 104857600 bytes transferred in 6.298636 seconds (16647668 bytes/sec) > > It''s working, but the file is truncated : > > # ls -s > total 92580 > 92580 test > > It''s really bad :( I didn''t get a disk full message. Why? > > There is many errors in the kernel logs : > > [...] > LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type => PTL_RPC_MSG_ERR req@c2f4f000 x575/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 > lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 > LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type => PTL_RPC_MSG_ERR req@c2f4fa00 x576/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 > lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 > LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type => PTL_RPC_MSG_ERR req@c2f4fc00 x577/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 > lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 > LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type => PTL_RPC_MSG_ERR req@c3c39400 x578/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 > lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 > LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type => PTL_RPC_MSG_ERR req@c3c39200 x579/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 > lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 > LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type => PTL_RPC_MSG_ERR req@c3c39a00 x581/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 > lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 > LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type => PTL_RPC_MSG_ERR req@c2f4fa00 x582/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 > lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 > [...] > > Best Regards, > > - - - System Infomations - - - > Lustre version : 1.0.4 > Kernel version : vanilla-2.4.22 > Distribution : Debian GNU/Linux "Sarge" > The cluster configuration file : config.xml is attached with this message.
--6cMF9JLEeZkfJjkP Content-Type: multipart/mixed; boundary="4eRLI4hEmsdu6Npr" Content-Disposition: inline --4eRLI4hEmsdu6Npr Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi all, I''ve setup a lustre cluster on two nodes (fallowing the wiki instructions). One node is a mds and client and another is an ost. I''ve mounted the lustre fs on /mnt/lustre : # df -h Filesystem Size Used Avail Use% Mounted on [...] config 95M 4.2M 86M 5% /mnt/lustre When I try to create a file larger than the current free space : # dd if=3D/dev/zero of=3Dtest bs=3D1M count=3D100 100+0 records in 100+0 records out 104857600 bytes transferred in 6.298636 seconds (16647668 bytes/sec) It''s working, but the file is truncated : # ls -s=20 total 92580 92580 test It''s really bad :( I didn''t get a disk full message. Why? There is many errors in the kernel logs :=20 [...] LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type =3D=3D PTL_RPC_MSG_ERR req@c2f4f000 x575/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type =3D=3D PTL_RPC_MSG_ERR req@c2f4fa00 x576/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type =3D=3D PTL_RPC_MSG_ERR req@c2f4fc00 x577/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type =3D=3D PTL_RPC_MSG_ERR req@c3c39400 x578/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type =3D=3D PTL_RPC_MSG_ERR req@c3c39200 x579/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type =3D=3D PTL_RPC_MSG_ERR req@c3c39a00 x581/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 LustreError: 795:(client.c:445:ptlrpc_check_status()) @@@ type =3D=3D PTL_RPC_MSG_ERR req@c2f4fa00 x582/t0 o4->ost1_UUID_2@NID_ost1_UUID:6 lens 288/248 ref 1 fl RPC:RN/0/0 rc 0/-28 [...] Best Regards, - - - System Infomations - - - Lustre version : 1.0.4 Kernel version : vanilla-2.4.22 Distribution : Debian GNU/Linux "Sarge" The cluster configuration file : config.xml is attached with this message. --=20 Nowicki Christophe =20 EPITECH Promo 2006 =20 http://etudiant.epita.fr/~nowick_c/ =20 --4eRLI4hEmsdu6Npr Content-Type: application/xml Content-Disposition: attachment; filename="config.xml" Content-Transfer-Encoding: quoted-printable <?xml version=3D''1.0'' encoding=3D''UTF-8''?>=0A<lustre version=3D''2003070801''>=0A <ldlm name=3D''ldlm'' uuid=3D''ldlm_UUID''/>=0A <node uuid=3D''mds_UUID'' name=3D''mds''>=0A <profile_ref uuidref=3D''PROFILE_mds_UUID''/>=0A <network uuid=3D''NET_mds_tcp_UUID'' nettype=3D''tcp'' name=3D''NET_mds_tcp''>=0A <nid>mds</nid>=0A <clusterid>0</clusterid>=0A <port>988</port>=0A </network>=0A </node>=0A <profile uuid=3D''PROFILE_mds_UUID'' name=3D''PROFILE_mds''>=0A <ldlm_ref uuidref=3D''ldlm_UUID''/>=0A <network_ref uuidref=3D''NET_mds_tcp_UUID''/>=0A <mdsdev_ref uuidref=3D''MDD_mds1_mds_UUID''/>=0A </profile>=0A <node uuid=3D''ost1_UUID'' name=3D''ost1''>=0A <profile_ref uuidref=3D''PROFILE_ost1_UUID''/>=0A <network uuid=3D''NET_ost1_tcp_UUID'' nettype=3D''tcp'' name=3D''NET_ost1_tcp''>=0A <nid>ost1</nid>=0A <clusterid>0</clusterid>=0A <port>988</port>=0A </network>=0A </node>=0A <profile uuid=3D''PROFILE_ost1_UUID'' name=3D''PROFILE_ost1''>=0A <ldlm_ref uuidref=3D''ldlm_UUID''/>=0A <network_ref uuidref=3D''NET_ost1_tcp_UUID''/>=0A <osd_ref uuidref=3D''OSD_ost1_ost1_UUID''/>=0A </profile>=0A <node uuid=3D''client_UUID'' name=3D''client''>=0A <profile_ref uuidref=3D''PROFILE_client_UUID''/>=0A <network uuid=3D''NET_client_tcp_UUID'' nettype=3D''tcp'' name=3D''NET_client_tcp''>=0A <nid>mds</nid>=0A <clusterid>0</clusterid>=0A <port>988</port>=0A </network>=0A </node>=0A <profile uuid=3D''PROFILE_client_UUID'' name=3D''PROFILE_client''>=0A <ldlm_ref uuidref=3D''ldlm_UUID''/>=0A <network_ref uuidref=3D''NET_client_tcp_UUID''/>=0A <mountpoint_ref uuidref=3D''MNT_client_UUID''/>=0A </profile>=0A <mds uuid=3D''mds1_UUID'' name=3D''mds1''>=0A <active_ref uuidref=3D''MDD_mds1_mds_UUID''/>=0A <lovconfig_ref uuidref=3D''LVCFG_lov1_UUID''/>=0A <filesystem_ref uuidref=3D''FS_fsname_UUID''/>=0A </mds>=0A <mdsdev uuid=3D''MDD_mds1_mds_UUID'' name=3D''MDD_mds1_mds''>=0A <fstype>ext3</fstype>=0A <devpath>/tmp/mds1</devpath>=0A <autoformat>no</autoformat>=0A <devsize>50000</devsize>=0A <journalsize>0</journalsize>=0A <inodesize>0</inodesize>=0A <node_ref uuidref=3D''mds_UUID''/>=0A <target_ref uuidref=3D''mds1_UUID''/>=0A </mdsdev>=0A <lov uuid=3D''lov1_UUID'' stripesize=3D''65536'' stripecount=3D''0'' stripepattern=3D''0'' name=3D''lov1''>=0A <mds_ref uuidref=3D''mds1_UUID''/>=0A <obd_ref uuidref=3D''ost1_UUID_2''/>=0A </lov>=0A <lovconfig uuid=3D''LVCFG_lov1_UUID'' name=3D''LVCFG_lov1''>=0A <lov_ref uuidref=3D''lov1_UUID''/>=0A </lovconfig>=0A <ost uuid=3D''ost1_UUID_2'' name=3D''ost1''>=0A <active_ref uuidref=3D''OSD_ost1_ost1_UUID''/>=0A </ost>=0A <osd osdtype=3D''obdfilter'' uuid=3D''OSD_ost1_ost1_UUID'' name=3D''OSD_ost1_ost1''>=0A <target_ref uuidref=3D''ost1_UUID_2''/>=0A <node_ref uuidref=3D''ost1_UUID''/>=0A <fstype>ext3</fstype>=0A <devpath>/tmp/ost1</devpath>=0A <autoformat>no</autoformat>=0A <devsize>100000</devsize>=0A <journalsize>0</journalsize>=0A <inodesize>0</inodesize>=0A </osd>=0A <filesystem uuid=3D''FS_fsname_UUID'' name=3D''FS_fsname''>=0A <mds_ref uuidref=3D''mds1_UUID''/>=0A <obd_ref uuidref=3D''lov1_UUID''/>=0A </filesystem>=0A <mountpoint uuid=3D''MNT_client_UUID'' name=3D''MNT_client''>=0A <filesystem_ref uuidref=3D''FS_fsname_UUID''/>=0A <path>/mnt/lustre</path>=0A </mountpoint>=0A</lustre>=0A --4eRLI4hEmsdu6Npr-- --6cMF9JLEeZkfJjkP Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (GNU/Linux) iD8DBQFBfjL23jtE0lRnlNoRAsCyAKCnGaDT3J2espGkCv5EsRCvhjfrKgCfXjKs 1xC4CYA7VC7XjONTWk1LLJg=AYVA -----END PGP SIGNATURE----- --6cMF9JLEeZkfJjkP--