Chris Gerhard
2006-May-12 21:42 UTC
[zfs-discuss] zfs panic when unpacking open solaris source
When unpacking the solaris source onto a local disk on a system running build 39 I got the following panic: panic[cpu0]/thread=d2c8ade0: really out of space d2c8a7b4 zfs:zio_write_allocate_gang_members+3e6 (e4385ac0) d2c8a7d0 zfs:zio_dva_allocate+81 (e4385ac0) d2c8a7e8 zfs:zio_next_stage+66 (e4385ac0) d2c8a800 zfs:zio_checksum_generate+5e (e4385ac0) d2c8a81c zfs:zio_next_stage+66 (e4385ac0) d2c8a83c zfs:zio_wait_for_children+46 (e4385ac0, 1, e4385c) d2c8a850 zfs:zio_wait_children_ready+18 (e4385ac0) d2c8a864 zfs:zio_next_stage_async+ac (e4385ac0, f8def9d0,) d2c8a874 zfs:zio_nowait+e (e4385ac0) d2c8a8d4 zfs:zio_write_allocate_gang_members+341 (e120e0c0) d2c8a8f0 zfs:zio_dva_allocate+81 (e120e0c0) d2c8a908 zfs:zio_next_stage+66 (e120e0c0) d2c8a920 zfs:zio_checksum_generate+5e (e120e0c0) d2c8a93c zfs:zio_next_stage+66 (e120e0c0) d2c8a95c zfs:zio_wait_for_children+46 (e120e0c0, 1, e120e2) d2c8a970 zfs:zio_wait_children_ready+18 (e120e0c0) d2c8a984 zfs:zio_next_stage_async+ac (e120e0c0, f8def9d0,) d2c8a994 zfs:zio_nowait+e (e120e0c0) d2c8a9f4 zfs:zio_write_allocate_gang_members+341 (e3c0a580) d2c8aa10 zfs:zio_dva_allocate+81 (e3c0a580) d2c8aa28 zfs:zio_next_stage+66 (e3c0a580) d2c8aa40 zfs:zio_checksum_generate+5e (e3c0a580) d2c8aa54 zfs:zio_next_stage+66 (e3c0a580) d2c8aaa0 zfs:zio_write_compress+236 (e3c0a580) d2c8aabc zfs:zio_next_stage+66 (e3c0a580) d2c8aadc zfs:zio_wait_for_children+46 (e3c0a580, 1, e3c0a7) d2c8aaf0 zfs:zio_wait_children_ready+18 (e3c0a580) d2c8ab04 zfs:zio_next_stage_async+ac (e3c0a580, 0, f8dbfe) d2c8ab1c zfs:zio_nowait+e (e3c0a580) d2c8ab3c zfs:arc_write+7b (e44c9780, d895e8c0,) d2c8abec zfs:dbuf_sync+5f3 (dbd6ef00, e44c9780,) d2c8ac4c zfs:dnode_sync+33a (d34fbb30, 1, e44c97) d2c8ac80 zfs:dmu_objset_sync_dnodes+7e (d2380240, d23802fc,) d2c8acd0 zfs:dmu_objset_sync+5d (d2380240, e96f1e80) d2c8ad1c zfs:dsl_pool_sync+121 (d244a180, 15e234, 0) d2c8ad6c zfs:spa_sync+10a (d895e8c0, 15e234, 0) d2c8adc8 zfs:txg_sync_thread+1df (d244a180, 0) d2c8add8 unix:thread_start+8 () I now have a chicken and egg problem, need to unpack the source to work out what is going on but can''t as the system crashes unless I put it on my external USB drive but there are some issues with that! Is this a known issue? Some more data on the file systems: : sigma IA 4 $; zfs list -r home/cjg NAME USED AVAIL REFER MOUNTPOINT home/cjg 7.81G 138M 1.99G /export/home/cjg home/cjg at month_02 1.91M - 1.97G - home/cjg at 2006-02-02-07:53:46 2.38M - 1.97G - home/cjg at minute_43 433K - 1.97G - home/cjg at minute_44 492K - 1.97G - home/cjg at minute_45 409K - 1.97G - home/cjg at minute_46 474K - 1.97G - home/cjg at minute_47 314K - 1.97G - home/cjg at minute_48 314K - 1.97G - home/cjg at minute_49 0 - 1.97G - home/cjg at minute_50 0 - 1.97G - home/cjg at minute_51 0 - 1.97G - home/cjg at minute_52 253K - 1.97G - home/cjg at minute_53 342K - 1.97G - home/cjg at minute_54 624K - 1.98G - home/cjg at minute_55 429K - 1.98G - home/cjg at minute_56 0 - 1.98G - home/cjg at minute_57 0 - 1.98G - home/cjg at minute_58 0 - 1.98G - home/cjg at minute_59 0 - 1.98G - home/cjg at minute_00 146K - 1.98G - home/cjg at minute_01 282K - 1.98G - home/cjg at minute_02 218K - 1.98G - home/cjg at minute_03 300K - 1.98G - home/cjg at minute_04 232K - 1.98G - home/cjg at minute_05 458K - 1.98G - home/cjg at minute_06 462K - 1.98G - home/cjg at minute_07 576K - 1.98G - home/cjg at minute_08 147K - 1.98G - home/cjg at minute_09 147K - 1.98G - home/cjg at minute_10 448K - 1.98G - home/cjg at minute_11 0 - 1.98G - home/cjg at minute_12 0 - 1.98G - home/cjg at minute_13 0 - 1.98G - home/cjg at minute_14 354K - 1.98G - home/cjg at minute_15 258K - 1.98G - home/cjg at minute_16 0 - 1.98G - home/cjg at minute_17 0 - 1.98G - home/cjg at minute_18 0 - 1.98G - home/cjg at minute_19 522K - 1.98G - home/cjg at minute_20 615K - 1.98G - home/cjg at minute_21 766K - 1.98G - home/cjg at minute_22 625K - 1.98G - home/cjg at minute_23 565K - 1.98G - home/cjg at minute_24 470K - 1.98G - home/cjg at minute_25 495K - 1.98G - home/cjg at minute_26 305K - 1.98G - home/cjg at minute_27 314K - 1.98G - home/cjg at minute_28 145K - 1.98G - home/cjg at minute_29 266K - 1.98G - home/cjg at minute_30 438K - 1.98G - home/cjg at minute_31 584K - 1.98G - home/cjg at minute_32 524K - 1.98G - home/cjg at minute_33 538K - 1.98G - home/cjg at minute_34 564K - 1.98G - home/cjg at minute_35 596K - 1.98G - home/cjg at minute_36 638K - 1.98G - home/cjg at minute_37 796K - 1.98G - home/cjg at minute_38 226K - 1.98G - home/cjg at minute_39 210K - 1.98G - home/cjg at minute_40 211K - 1.98G - home/cjg at minute_41 145K - 1.98G - home/cjg at minute_42 198K - 1.98G - home/cjg at 2006-02-03-17:45:30 0 - 1.98G - home/cjg at 2006-02-03-17:45:41 0 - 1.98G - home/cjg at 2006-02-03-17:54:55 97K - 1.98G - home/cjg at 2006-02-04-14:14:03 0 - 1.98G - home/cjg at 2006-02-04-14:14:12 0 - 1.98G - home/cjg at day_05 1.51M - 1.98G - home/cjg at 2006-02-07-18:20:37 7.38M - 1.99G - home/cjg at 2006-02-07-20:04:17 0 - 1.98G - home/cjg at 2006-02-07-20:04:28 0 - 1.98G - home/cjg at 2006-02-10-21:52:02 0 - 1.98G - home/cjg at 2006-02-10-21:52:11 0 - 1.98G - home/cjg at 2006-02-11-09:42:04 0 - 1.98G - home/cjg at 2006-02-11-09:42:15 0 - 1.98G - home/cjg at 2006-02-11-09:42:25 0 - 1.98G - home/cjg at 2006-02-18-17:41:07 0 - 1.98G - home/cjg at 2006-02-18-17:41:18 0 - 1.98G - home/cjg at day_19 13.5M - 1.98G - home/cjg at day_20 871K - 1.98G - home/cjg at 2006-02-20-20:16:33 880K - 1.98G - home/cjg at day_22 1.40M - 1.98G - home/cjg at 2006-02-23-09:27:50 1.41M - 1.94G - home/cjg at 2006-02-24-17:51:24 0 - 1.94G - home/cjg at 2006-02-24-17:51:33 0 - 1.94G - home/cjg at 2006-02-24-17:51:43 0 - 1.94G - home/cjg at 2006-02-25-17:51:34 0 - 1.94G - home/cjg at 2006-02-25-17:51:43 0 - 1.94G - home/cjg at 2006-02-25-17:51:54 0 - 1.94G - home/cjg at 2006-02-25-17:59:37 0 - 1.94G - home/cjg at 2006-02-25-17:59:46 0 - 1.94G - home/cjg at 2006-02-25-17:59:56 0 - 1.94G - home/cjg at 2006-02-25-18:01:25 97K - 1.94G - home/cjg at 2006-02-26-15:03:23 2.25M - 1.94G - home/cjg at 2006-02-28-13:59:40 0 - 1.96G - home/cjg at 2006-02-28-13:59:51 0 - 1.96G - home/cjg at 2006-02-28-14:00:01 0 - 1.96G - home/cjg at day_01 0 - 1.95G - home/cjg at month_03 0 - 1.95G - home/cjg at 2006-03-01-07:11:29 0 - 1.95G - home/cjg at 2006-03-01-07:11:40 0 - 1.95G - home/cjg at 2006-03-04-08:34:10 97K - 1.95G - home/cjg at 2006-03-04-11:47:02 0 - 1.95G - home/cjg at 2006-03-04-11:47:12 0 - 1.95G - home/cjg at 2006-03-04-11:47:23 0 - 1.95G - home/cjg at 2006-03-04-12:08:14 752K - 1.95G - home/cjg at 2006-03-04-15:02:00 0 - 1.95G - home/cjg at 2006-03-04-15:02:09 0 - 1.95G - home/cjg at 2006-03-05-07:58:37 0 - 1.95G - home/cjg at 2006-03-05-07:58:48 0 - 1.95G - home/cjg at 2006-03-05-08:09:43 0 - 1.95G - home/cjg at 2006-03-05-08:09:54 0 - 1.95G - home/cjg at 2006-03-05-13:34:51 0 - 1.94G - home/cjg at 2006-03-05-13:35:13 0 - 1.94G - home/cjg at 2006-03-07-20:55:09 1.50M - 1.94G - home/cjg at day_08 2.76M - 1.95G - home/cjg at 2006-03-10-22:02:09 0 - 1.95G - home/cjg at 2006-03-10-22:02:19 0 - 1.95G - home/cjg at 2006-03-10-22:02:30 0 - 1.95G - home/cjg at day_12 1.36M - 1.96G - home/cjg at 2006-03-12-17:48:46 0 - 1.96G - home/cjg at 2006-03-12-17:48:57 0 - 1.96G - home/cjg at 2006-03-12-17:49:07 0 - 1.96G - home/cjg at 2006-03-14-22:08:59 0 - 1.97G - home/cjg at 2006-03-14-22:09:11 0 - 1.97G - home/cjg at 2006-03-14-22:09:21 0 - 1.97G - home/cjg at 2006-03-15-11:38:28 0 - 1.97G - home/cjg at 2006-03-15-11:38:39 0 - 1.97G - home/cjg at 2006-03-15-18:46:35 723K - 1.97G - home/cjg at 2006-03-15-20:33:11 0 - 1.97G - home/cjg at 2006-03-15-20:33:22 0 - 1.97G - home/cjg at 2006-03-15-20:33:32 0 - 1.97G - home/cjg at 2006-03-15-21:37:33 0 - 1.95G - home/cjg at 2006-03-15-21:37:42 0 - 1.95G - home/cjg at 2006-03-15-21:37:53 0 - 1.95G - home/cjg at 2006-03-16-17:58:31 0 - 1.95G - home/cjg at 2006-03-16-17:58:41 0 - 1.95G - home/cjg at 2006-03-16-21:58:50 0 - 1.95G - home/cjg at 2006-03-16-21:59:00 0 - 1.95G - home/cjg at 2006-03-16-22:05:04 0 - 1.95G - home/cjg at 2006-03-16-22:05:13 0 - 1.95G - home/cjg at 2006-03-16-22:05:25 0 - 1.95G - home/cjg at 2006-03-16-22:13:33 0 - 1.95G - home/cjg at 2006-03-16-22:13:44 0 - 1.95G - home/cjg at 2006-03-16-22:13:54 0 - 1.95G - home/cjg at 2006-03-19-09:03:31 0 - 1.95G - home/cjg at 2006-03-19-09:03:42 0 - 1.95G - home/cjg at 2006-03-19-09:03:52 0 - 1.95G - home/cjg at 2006-03-19-10:06:30 0 - 2.02G - home/cjg at 2006-03-19-10:06:51 0 - 2.02G - home/cjg at 2006-03-20-16:27:53 0 - 2.02G - home/cjg at 2006-03-20-16:28:03 0 - 2.02G - home/cjg at day_21 1.92M - 2.03G - home/cjg at 2006-03-21-11:33:28 0 - 2.03G - home/cjg at 2006-03-21-11:33:38 0 - 2.03G - home/cjg at 2006-03-21-21:05:01 1.30M - 2.03G - home/cjg at 2006-03-21-23:07:23 0 - 2.03G - home/cjg at 2006-03-21-23:07:32 0 - 2.03G - home/cjg at 2006-03-21-23:07:43 0 - 2.03G - home/cjg at 2006-03-21-23:16:43 0 - 2.03G - home/cjg at 2006-03-21-23:16:53 0 - 2.03G - home/cjg at 2006-03-21-23:17:03 0 - 2.03G - home/cjg at 2006-03-22-17:06:52 97K - 2.03G - home/cjg at 2006-03-22-17:12:02 0 - 2.03G - home/cjg at 2006-03-22-17:12:13 0 - 2.03G - home/cjg at 2006-03-22-17:12:25 0 - 2.03G - home/cjg at day_24 1.44M - 2.03G - home/cjg at 2006-03-24-12:06:03 0 - 2.03G - home/cjg at 2006-03-24-12:06:13 0 - 2.03G - home/cjg at 2006-03-25-13:54:01 0 - 2.03G - home/cjg at 2006-03-25-13:54:23 0 - 2.03G - home/cjg at 2006-03-25-17:03:14 0 - 2.03G - home/cjg at 2006-03-25-17:03:24 0 - 2.03G - home/cjg at 2006-03-25-17:03:34 0 - 2.03G - home/cjg at 2006-03-25-17:13:29 712K - 2.03G - home/cjg at 2006-03-26-16:18:34 1.29M - 2.02G - home/cjg at 2006-03-28-17:47:14 0 - 2.02G - home/cjg at 2006-03-28-17:47:24 0 - 2.02G - home/cjg at 2006-03-28-17:47:34 0 - 2.02G - home/cjg at 2006-03-28-18:51:19 0 - 2.02G - home/cjg at 2006-03-28-18:51:29 0 - 2.02G - home/cjg at 2006-03-28-18:51:39 0 - 2.02G - home/cjg at 2006-04-08-08:29:23 0 - 2.04G - home/cjg at 2006-04-08-08:29:32 0 - 2.04G - home/cjg at 2006-04-08-08:29:42 0 - 2.04G - home/cjg at 2006-04-08-09:34:16 0 - 2.04G - home/cjg at 2006-04-08-09:34:27 0 - 2.04G - home/cjg at 2006-04-08-09:34:38 0 - 2.04G - home/cjg at 2006-04-08-19:09:47 1.25M - 2.04G - home/cjg at 2006-04-08-21:39:49 1.56M - 2.04G - home/cjg at 2006-04-12-20:20:32 0 - 2.04G - home/cjg at 2006-04-12-20:20:40 0 - 2.04G - home/cjg at 2006-04-12-20:20:50 0 - 2.04G - home/cjg at 2006-04-12-20:32:44 0 - 2.04G - home/cjg at 2006-04-12-20:32:54 0 - 2.04G - home/cjg at 2006-04-13-06:42:41 1.95M - 2.04G - home/cjg at 2006-04-14-18:10:24 0 - 2.04G - home/cjg at 2006-04-14-18:10:34 0 - 2.04G - home/cjg at 2006-04-14-18:10:45 0 - 2.04G - home/cjg at 2006-04-14-18:15:39 0 - 2.04G - home/cjg at 2006-04-14-18:15:50 0 - 2.04G - home/cjg at 2006-04-16-11:07:22 2.42M - 2.05G - home/cjg at 2006-04-16-21:45:20 0 - 2.05G - home/cjg at 2006-04-16-21:45:41 0 - 2.05G - home/cjg at 2006-04-17-11:59:41 1.63M - 2.05G - home/cjg at 2006-04-18-10:39:33 56K - 2.05G - home/cjg at 2006-04-18-19:42:13 56K - 2.05G - home/cjg at 2006-04-20-09:43:40 220K - 2.04G - home/cjg at 2006-04-20-11:11:18 0 - 2.04G - home/cjg at 2006-04-20-11:11:27 0 - 2.04G - home/cjg at 2006-04-20-13:35:22 0 - 2.04G - home/cjg at 2006-04-20-13:35:32 0 - 2.04G - home/cjg at backup 54K - 2.04G - home/cjg at 2006-04-20-14:44:55 49K - 2.04G - home/cjg at 2006-04-20-15:02:11 0 - 2.04G - home/cjg at 2006-04-20-15:02:32 0 - 2.04G - home/cjg at 2006-04-20-16:42:02 0 - 2.04G - home/cjg at 2006-04-20-16:42:13 0 - 2.04G - home/cjg at 2006-04-22-19:23:56 198K - 2.04G - home/cjg at day_23 150K - 2.04G - home/cjg at 2006-04-23-15:43:28 852K - 2.04G - home/cjg at 2006-04-23-18:12:50 16K - 2.04G - home/cjg at 2006-04-23-18:18:14 16K - 2.04G - home/cjg at 2006-04-25-20:55:29 0 - 2.03G - home/cjg at 2006-04-25-20:55:38 0 - 2.03G - home/cjg at 2006-04-26-20:14:56 0 - 2.03G - home/cjg at 2006-04-26-20:15:06 0 - 2.03G - home/cjg at 2006-04-26-20:15:16 0 - 2.03G - home/cjg at 2006-04-26-20:22:09 16K - 2.03G - home/cjg at 2006-05-01-16:38:41 2.23M - 2.04G - home/cjg at 2006-05-01-23:37:15 120K - 2.05G - home/cjg at day_02 82.5K - 2.05G - home/cjg at 2006-05-02-09:17:53 172K - 1.91G - home/cjg at 2006-05-06-13:34:11 2.15M - 2.29G - home/cjg at 2006-05-06-20:20:44 0 - 2.29G - home/cjg at 2006-05-06-20:20:54 0 - 2.29G - home/cjg at 2006-05-06-20:21:05 0 - 2.29G - home/cjg at 2006-05-06-21:36:16 0 - 2.27G - home/cjg at 2006-05-06-21:36:26 0 - 2.27G - home/cjg at hour_00 78.5K - 2.27G - home/cjg at hour_01 0 - 2.27G - home/cjg at day_07 0 - 2.27G - home/cjg at hour_02 0 - 2.27G - home/cjg at hour_03 0 - 2.27G - home/cjg at hour_04 0 - 2.27G - home/cjg at hour_05 0 - 2.27G - home/cjg at hour_06 0 - 2.27G - home/cjg at 2006-05-09-10:08:17 0 - 2.28G - home/cjg at 2006-05-09-10:08:27 0 - 2.28G - home/cjg at hour_13 17.6M - 2.28G - home/cjg at hour_14 684K - 2.28G - home/cjg at hour_15 4.94M - 2.29G - home/cjg at hour_16 144K - 2.29G - home/cjg at hour_17 144K - 2.29G - home/cjg at hour_18 210K - 2.29G - home/cjg at hour_19 212K - 2.29G - home/cjg at 2006-05-10-21:49:42 0 - 2.29G - home/cjg at 2006-05-10-21:49:52 0 - 2.29G - home/cjg at hour_23 476K - 1.90G - home/cjg at 2006-05-11-06:51:16 0 - 1.91G - home/cjg at 2006-05-11-06:51:26 0 - 1.91G - home/cjg at hour_07 71.5K - 1.91G - home/cjg at hour_08 0 - 1.91G - home/cjg at hour_09 0 - 1.91G - home/cjg at hour_10 0 - 1.91G - home/cjg at hour_11 0 - 1.91G - home/cjg at hour_12 0 - 1.91G - home/cjg at 2006-05-12-19:23:44 0 - 1.91G - home/cjg at 2006-05-12-19:23:54 0 - 1.91G - home/cjg at hour_20 390K - 1.96G - home/cjg at hour_21 332K - 1.96G - home/cjg at hour_22 180K - 1.96G - home/cjg at 2006-05-12-22:10:59 0 - 1.99G - home/cjg at 2006-05-12-22:11:09 0 - 1.99G - home/cjg/pics 4.65G 138M 4.61G /export/home/cjg/pics home/cjg/pics at month_02 0 - 4.52G - home/cjg/pics at 2006-02-02-07:53:46 0 - 4.52G - home/cjg/pics at minute_43 0 - 4.52G - home/cjg/pics at minute_44 0 - 4.52G - home/cjg/pics at minute_45 0 - 4.52G - home/cjg/pics at minute_46 0 - 4.52G - home/cjg/pics at minute_47 0 - 4.52G - home/cjg/pics at minute_48 0 - 4.52G - home/cjg/pics at minute_49 0 - 4.52G - home/cjg/pics at minute_50 0 - 4.52G - home/cjg/pics at minute_51 0 - 4.52G - home/cjg/pics at minute_52 0 - 4.52G - home/cjg/pics at minute_53 0 - 4.52G - home/cjg/pics at minute_54 0 - 4.52G - home/cjg/pics at minute_55 0 - 4.52G - home/cjg/pics at minute_56 0 - 4.52G - home/cjg/pics at minute_57 0 - 4.52G - home/cjg/pics at minute_58 0 - 4.52G - home/cjg/pics at minute_59 0 - 4.52G - home/cjg/pics at minute_00 0 - 4.52G - home/cjg/pics at minute_01 0 - 4.52G - home/cjg/pics at minute_02 0 - 4.52G - home/cjg/pics at minute_03 0 - 4.52G - home/cjg/pics at minute_04 0 - 4.52G - home/cjg/pics at minute_05 0 - 4.52G - home/cjg/pics at minute_06 0 - 4.52G - home/cjg/pics at minute_07 0 - 4.52G - home/cjg/pics at minute_08 0 - 4.52G - home/cjg/pics at minute_09 0 - 4.52G - home/cjg/pics at minute_10 0 - 4.52G - home/cjg/pics at minute_11 0 - 4.52G - home/cjg/pics at minute_12 0 - 4.52G - home/cjg/pics at minute_13 0 - 4.52G - home/cjg/pics at minute_14 0 - 4.52G - home/cjg/pics at minute_15 0 - 4.52G - home/cjg/pics at minute_16 0 - 4.52G - home/cjg/pics at minute_17 0 - 4.52G - home/cjg/pics at minute_18 0 - 4.52G - home/cjg/pics at minute_19 0 - 4.52G - home/cjg/pics at minute_20 0 - 4.52G - home/cjg/pics at minute_21 0 - 4.52G - home/cjg/pics at minute_22 0 - 4.52G - home/cjg/pics at minute_23 0 - 4.52G - home/cjg/pics at minute_24 0 - 4.52G - home/cjg/pics at minute_25 0 - 4.52G - home/cjg/pics at minute_26 0 - 4.52G - home/cjg/pics at minute_27 0 - 4.52G - home/cjg/pics at minute_28 0 - 4.52G - home/cjg/pics at minute_29 0 - 4.52G - home/cjg/pics at minute_30 0 - 4.52G - home/cjg/pics at minute_31 0 - 4.52G - home/cjg/pics at minute_32 0 - 4.52G - home/cjg/pics at minute_33 0 - 4.52G - home/cjg/pics at minute_34 0 - 4.52G - home/cjg/pics at minute_35 0 - 4.52G - home/cjg/pics at minute_36 0 - 4.52G - home/cjg/pics at minute_37 0 - 4.52G - home/cjg/pics at minute_38 0 - 4.52G - home/cjg/pics at minute_39 0 - 4.52G - home/cjg/pics at minute_40 0 - 4.52G - home/cjg/pics at minute_41 0 - 4.52G - home/cjg/pics at minute_42 0 - 4.52G - home/cjg/pics at 2006-02-03-17:45:30 0 - 4.52G - home/cjg/pics at 2006-02-03-17:45:41 0 - 4.52G - home/cjg/pics at 2006-02-03-17:54:55 0 - 4.52G - home/cjg/pics at 2006-02-04-14:14:03 0 - 4.52G - home/cjg/pics at 2006-02-04-14:14:12 0 - 4.52G - home/cjg/pics at day_05 0 - 4.52G - home/cjg/pics at 2006-02-07-18:20:37 0 - 4.52G - home/cjg/pics at 2006-02-07-20:04:17 0 - 4.52G - home/cjg/pics at 2006-02-07-20:04:28 0 - 4.52G - home/cjg/pics at 2006-02-10-21:52:02 0 - 4.52G - home/cjg/pics at 2006-02-10-21:52:11 0 - 4.52G - home/cjg/pics at 2006-02-11-09:42:04 0 - 4.52G - home/cjg/pics at 2006-02-11-09:42:15 0 - 4.52G - home/cjg/pics at 2006-02-11-09:42:25 0 - 4.52G - home/cjg/pics at 2006-02-18-17:41:07 0 - 4.52G - home/cjg/pics at 2006-02-18-17:41:18 0 - 4.52G - home/cjg/pics at day_19 65K - 4.52G - home/cjg/pics at day_20 0 - 4.55G - home/cjg/pics at 2006-02-20-20:16:33 0 - 4.55G - home/cjg/pics at day_22 0 - 4.55G - home/cjg/pics at 2006-02-23-09:27:50 0 - 4.55G - home/cjg/pics at 2006-02-24-17:51:33 0 - 4.55G - home/cjg/pics at 2006-02-24-17:51:43 0 - 4.55G - home/cjg/pics at 2006-02-25-17:51:43 0 - 4.55G - home/cjg/pics at 2006-02-25-17:51:54 0 - 4.55G - home/cjg/pics at 2006-02-25-17:59:46 0 - 4.55G - home/cjg/pics at 2006-02-25-17:59:56 0 - 4.55G - home/cjg/pics at 2006-02-25-18:01:25 0 - 4.55G - home/cjg/pics at 2006-02-26-15:03:23 97K - 4.55G - home/cjg/pics at 2006-02-28-13:59:51 97K - 4.55G - home/cjg/pics at day_01 0 - 4.55G - home/cjg/pics at month_03 0 - 4.55G - home/cjg/pics at 2006-03-01-07:11:40 0 - 4.55G - home/cjg/pics at 2006-03-04-08:34:10 0 - 4.55G - home/cjg/pics at 2006-03-04-11:47:12 97K - 4.55G - home/cjg/pics at 2006-03-04-12:08:14 97K - 4.55G - home/cjg/pics at 2006-03-05-07:58:37 0 - 4.55G - home/cjg/pics at 2006-03-05-07:58:48 0 - 4.55G - home/cjg/pics at 2006-03-05-08:09:43 0 - 4.55G - home/cjg/pics at 2006-03-05-08:09:54 0 - 4.55G - home/cjg/pics at 2006-03-05-13:35:13 97K - 4.55G - home/cjg/pics at day_08 97K - 4.55G - home/cjg/pics at 2006-03-10-22:02:19 0 - 4.55G - home/cjg/pics at 2006-03-10-22:02:30 0 - 4.55G - home/cjg/pics at day_12 0 - 4.55G - home/cjg/pics at 2006-03-12-17:48:57 0 - 4.55G - home/cjg/pics at 2006-03-14-22:09:11 0 - 4.57G - home/cjg/pics at 2006-03-14-22:09:21 0 - 4.57G - home/cjg/pics at 2006-03-15-11:38:39 97K - 4.57G - home/cjg/pics at 2006-03-15-20:33:32 97K - 4.57G - home/cjg/pics at 2006-03-15-21:37:53 97K - 4.57G - home/cjg/pics at 2006-03-16-17:58:31 0 - 4.57G - home/cjg/pics at 2006-03-16-17:58:41 0 - 4.57G - home/cjg/pics at 2006-03-16-21:59:00 0 - 4.57G - home/cjg/pics at 2006-03-16-22:05:13 0 - 4.57G - home/cjg/pics at 2006-03-16-22:05:25 0 - 4.57G - home/cjg/pics at 2006-03-16-22:13:33 0 - 4.57G - home/cjg/pics at 2006-03-16-22:13:44 0 - 4.57G - home/cjg/pics at 2006-03-16-22:13:54 0 - 4.57G - home/cjg/pics at 2006-03-19-09:03:31 0 - 4.57G - home/cjg/pics at 2006-03-19-09:03:52 0 - 4.57G - home/cjg/pics at 2006-03-20-16:28:03 0 - 4.57G - home/cjg/pics at day_21 0 - 4.57G - home/cjg/pics at 2006-03-21-11:33:28 0 - 4.57G - home/cjg/pics at 2006-03-21-11:33:38 0 - 4.57G - home/cjg/pics at 2006-03-21-21:05:01 97K - 4.61G - home/cjg/pics at 2006-03-21-23:07:23 0 - 4.61G - home/cjg/pics at 2006-03-21-23:07:32 0 - 4.61G - home/cjg/pics at 2006-03-21-23:07:43 0 - 4.61G - home/cjg/pics at 2006-03-21-23:16:43 0 - 4.61G - home/cjg/pics at 2006-03-21-23:16:53 0 - 4.61G - home/cjg/pics at 2006-03-21-23:17:03 0 - 4.61G - home/cjg/pics at 2006-03-22-17:12:25 97K - 4.61G - home/cjg/pics at day_24 0 - 4.61G - home/cjg/pics at 2006-03-24-12:06:13 0 - 4.61G - home/cjg/pics at 2006-03-25-13:54:23 0 - 4.61G - home/cjg/pics at 2006-03-25-17:03:24 0 - 4.62G - home/cjg/pics at 2006-03-25-17:03:34 0 - 4.62G - home/cjg/pics at 2006-03-25-17:13:29 97K - 4.62G - home/cjg/pics at 2006-03-26-16:18:34 15.5K - 4.62G - home/cjg/pics at 2006-03-28-17:47:24 0 - 4.62G - home/cjg/pics at 2006-03-28-17:47:34 0 - 4.62G - home/cjg/pics at 2006-03-28-18:51:19 0 - 4.62G - home/cjg/pics at 2006-03-28-18:51:29 0 - 4.62G - home/cjg/pics at 2006-03-28-18:51:39 0 - 4.62G - home/cjg/pics at 2006-04-08-08:29:32 0 - 4.62G - home/cjg/pics at 2006-04-08-08:29:42 0 - 4.62G - home/cjg/pics at 2006-04-08-09:34:27 0 - 4.62G - home/cjg/pics at 2006-04-08-09:34:38 0 - 4.62G - home/cjg/pics at 2006-04-08-19:09:47 15.5K - 4.62G - home/cjg/pics at 2006-04-08-21:39:49 15.5K - 4.62G - home/cjg/pics at 2006-04-12-20:20:40 0 - 4.62G - home/cjg/pics at 2006-04-12-20:20:50 0 - 4.62G - home/cjg/pics at 2006-04-12-20:32:44 0 - 4.62G - home/cjg/pics at 2006-04-12-20:32:54 0 - 4.62G - home/cjg/pics at 2006-04-13-06:42:41 15.5K - 4.62G - home/cjg/pics at 2006-04-14-18:10:34 0 - 4.62G - home/cjg/pics at 2006-04-14-18:10:45 0 - 4.62G - home/cjg/pics at 2006-04-14-18:15:39 0 - 4.62G - home/cjg/pics at 2006-04-14-18:15:50 0 - 4.62G - home/cjg/pics at 2006-04-16-11:07:22 15.5K - 4.62G - home/cjg/pics at 2006-04-16-21:45:20 0 - 4.62G - home/cjg/pics at 2006-04-16-21:45:41 0 - 4.62G - home/cjg/pics at 2006-04-17-11:59:41 15.5K - 4.62G - home/cjg/pics at 2006-04-18-10:39:33 0 - 4.62G - home/cjg/pics at 2006-04-18-19:42:13 0 - 4.62G - home/cjg/pics at 2006-04-20-09:43:40 15.5K - 4.62G - home/cjg/pics at 2006-04-20-11:11:18 0 - 4.62G - home/cjg/pics at 2006-04-20-11:11:27 0 - 4.62G - home/cjg/pics at 2006-04-20-13:35:22 0 - 4.62G - home/cjg/pics at 2006-04-20-13:35:32 0 - 4.62G - home/cjg/pics at backup 0 - 4.62G - home/cjg/pics at 2006-04-20-16:42:13 15.5K - 4.62G - home/cjg/pics at 2006-04-22-19:23:56 15.5K - 4.62G - home/cjg/pics at day_23 0 - 4.62G - home/cjg/pics at 2006-04-23-15:43:28 0 - 4.62G - home/cjg/pics at 2006-04-23-18:12:50 0 - 4.62G - home/cjg/pics at 2006-04-23-18:18:14 0 - 4.62G - home/cjg/pics at 2006-04-25-20:55:29 0 - 4.62G - home/cjg/pics at 2006-04-25-20:55:38 0 - 4.62G - home/cjg/pics at 2006-04-26-20:14:56 0 - 4.62G - home/cjg/pics at 2006-04-26-20:15:06 0 - 4.62G - home/cjg/pics at 2006-04-26-20:15:16 0 - 4.62G - home/cjg/pics at 2006-04-26-20:22:09 0 - 4.62G - home/cjg/pics at 2006-05-01-16:38:41 15.5K - 4.62G - home/cjg/pics at 2006-05-01-23:37:15 0 - 4.62G - home/cjg/pics at day_02 0 - 4.62G - home/cjg/pics at 2006-05-02-09:17:53 15.5K - 4.62G - home/cjg/pics at 2006-05-06-13:34:11 15.5K - 4.62G - home/cjg/pics at 2006-05-06-20:20:54 0 - 4.62G - home/cjg/pics at 2006-05-06-20:21:05 0 - 4.62G - home/cjg/pics at 2006-05-06-21:36:26 0 - 4.62G - home/cjg/pics at hour_00 3.25M - 4.61G - home/cjg/pics at hour_01 0 - 4.61G - home/cjg/pics at day_07 0 - 4.61G - home/cjg/pics at hour_02 0 - 4.61G - home/cjg/pics at hour_03 0 - 4.61G - home/cjg/pics at hour_04 0 - 4.61G - home/cjg/pics at hour_05 0 - 4.61G - home/cjg/pics at hour_06 0 - 4.61G - home/cjg/pics at 2006-05-09-10:08:17 0 - 4.61G - home/cjg/pics at 2006-05-09-10:08:27 0 - 4.61G - home/cjg/pics at hour_13 55K - 4.61G - home/cjg/pics at hour_14 55K - 4.61G - home/cjg/pics at hour_15 1.75M - 4.61G - home/cjg/pics at hour_16 0 - 4.61G - home/cjg/pics at hour_17 0 - 4.61G - home/cjg/pics at hour_18 0 - 4.61G - home/cjg/pics at hour_19 0 - 4.61G - home/cjg/pics at 2006-05-10-21:49:42 0 - 4.61G - home/cjg/pics at 2006-05-10-21:49:52 0 - 4.61G - home/cjg/pics at hour_23 0 - 4.61G - home/cjg/pics at 2006-05-11-06:51:26 0 - 4.61G - home/cjg/pics at hour_07 0 - 4.61G - home/cjg/pics at hour_08 0 - 4.61G - home/cjg/pics at hour_09 0 - 4.61G - home/cjg/pics at hour_10 0 - 4.61G - home/cjg/pics at hour_11 0 - 4.61G - home/cjg/pics at hour_12 0 - 4.61G - home/cjg/pics at 2006-05-12-19:23:44 0 - 4.61G - home/cjg/pics at 2006-05-12-19:23:54 0 - 4.61G - home/cjg/pics at hour_20 0 - 4.61G - home/cjg/pics at hour_21 0 - 4.61G - home/cjg/pics at hour_22 0 - 4.61G - home/cjg/pics at 2006-05-12-22:10:59 0 - 4.61G - home/cjg/pics at 2006-05-12-22:11:09 0 - 4.61G - : sigma IA 5 $; This message posted from opensolaris.org
Jim Walker
2006-May-12 22:15 UTC
[zfs-discuss] Re: zfs panic when unpacking open solaris source
Looks like CR 6411261 busy intent log runs out of space on small pools. I found this one. I just bumped up the priority. Jim> When unpacking the solaris source onto a local disk > on a system running build 39 I got the following > panic: > > > panic[cpu0]/thread=d2c8ade0: > really out of space > > > d2c8a7b4 zfs:zio_write_allocate_gang_members+3e6 > (e4385ac0) > d2c8a7d0 zfs:zio_dva_allocate+81 (e4385ac0) > d2c8a7e8 zfs:zio_next_stage+66 (e4385ac0) > d2c8a800 zfs:zio_checksum_generate+5e (e4385ac0) > d2c8a81c zfs:zio_next_stage+66 (e4385ac0) > d2c8a83c zfs:zio_wait_for_children+46 (e4385ac0, 1, > e4385c) > d2c8a850 zfs:zio_wait_children_ready+18 (e4385ac0) > d2c8a864 zfs:zio_next_stage_async+ac (e4385ac0, > f8def9d0,) > d2c8a874 zfs:zio_nowait+e (e4385ac0) > d2c8a8d4 zfs:zio_write_allocate_gang_members+341 > (e120e0c0) > d2c8a8f0 zfs:zio_dva_allocate+81 (e120e0c0) > d2c8a908 zfs:zio_next_stage+66 (e120e0c0) > d2c8a920 zfs:zio_checksum_generate+5e (e120e0c0) > d2c8a93c zfs:zio_next_stage+66 (e120e0c0) > d2c8a95c zfs:zio_wait_for_children+46 (e120e0c0, 1, > e120e2) > d2c8a970 zfs:zio_wait_children_ready+18 (e120e0c0) > d2c8a984 zfs:zio_next_stage_async+ac (e120e0c0, > f8def9d0,) > d2c8a994 zfs:zio_nowait+e (e120e0c0) > d2c8a9f4 zfs:zio_write_allocate_gang_members+341 > (e3c0a580) > d2c8aa10 zfs:zio_dva_allocate+81 (e3c0a580) > d2c8aa28 zfs:zio_next_stage+66 (e3c0a580) > d2c8aa40 zfs:zio_checksum_generate+5e (e3c0a580) > d2c8aa54 zfs:zio_next_stage+66 (e3c0a580) > d2c8aaa0 zfs:zio_write_compress+236 (e3c0a580) > d2c8aabc zfs:zio_next_stage+66 (e3c0a580) > d2c8aadc zfs:zio_wait_for_children+46 (e3c0a580, 1, > e3c0a7) > d2c8aaf0 zfs:zio_wait_children_ready+18 (e3c0a580) > d2c8ab04 zfs:zio_next_stage_async+ac (e3c0a580, 0, > f8dbfe) > d2c8ab1c zfs:zio_nowait+e (e3c0a580) > d2c8ab3c zfs:arc_write+7b (e44c9780, d895e8c0,) > d2c8abec zfs:dbuf_sync+5f3 (dbd6ef00, e44c9780,) > d2c8ac4c zfs:dnode_sync+33a (d34fbb30, 1, e44c97) > d2c8ac80 zfs:dmu_objset_sync_dnodes+7e (d2380240, > d23802fc,) > d2c8acd0 zfs:dmu_objset_sync+5d (d2380240, e96f1e80) > d2c8ad1c zfs:dsl_pool_sync+121 (d244a180, 15e234, 0) > d2c8ad6c zfs:spa_sync+10a (d895e8c0, 15e234, 0) > d2c8adc8 zfs:txg_sync_thread+1df (d244a180, 0) > d2c8add8 unix:thread_start+8 () > > I now have a chicken and egg problem, need to unpack > the source to work out what is going on but can''t as > the system crashes unless I put it on my external USB > drive but there are some issues with that! > > Is this a known issue? > > Some more data on the file systems: > > : sigma IA 4 $; zfs list -r home/cjg > NAME USED AVAIL REFER > MOUNTPOINT > ome/cjg 7.81G 138M 1.99G > /export/home/cjg > ome/cjg at month_02 1.91M - 1.97G - > home/cjg at 2006-02-02-07:53:46 2.38M - 1.97G - > home/cjg at minute_43 433K - 1.97G - > home/cjg at minute_44 492K - 1.97G - > home/cjg at minute_45 409K - 1.97G - > home/cjg at minute_46 474K - 1.97G - > home/cjg at minute_47 314K - 1.97G - > home/cjg at minute_48 314K - 1.97G - > home/cjg at minute_49 0 - 1.97G - > home/cjg at minute_50 0 - 1.97G - > home/cjg at minute_51 0 - 1.97G - > home/cjg at minute_52 253K - 1.97G - > home/cjg at minute_53 342K - 1.97G - > home/cjg at minute_54 624K - 1.98G - > home/cjg at minute_55 429K - 1.98G - > home/cjg at minute_56 0 - 1.98G - > home/cjg at minute_57 0 - 1.98G - > home/cjg at minute_58 0 - 1.98G - > home/cjg at minute_59 0 - 1.98G - > home/cjg at minute_00 146K - 1.98G - > home/cjg at minute_01 282K - 1.98G - > home/cjg at minute_02 218K - 1.98G - > home/cjg at minute_03 300K - 1.98G - > home/cjg at minute_04 232K - 1.98G - > home/cjg at minute_05 458K - 1.98G - > home/cjg at minute_06 462K - 1.98G - > home/cjg at minute_07 576K - 1.98G - > home/cjg at minute_08 147K - 1.98G - > home/cjg at minute_09 147K - 1.98G - > home/cjg at minute_10 448K - 1.98G - > home/cjg at minute_11 0 - 1.98G - > home/cjg at minute_12 0 - 1.98G - > home/cjg at minute_13 0 - 1.98G - > home/cjg at minute_14 354K - 1.98G - > home/cjg at minute_15 258K - 1.98G - > home/cjg at minute_16 0 - 1.98G - > home/cjg at minute_17 0 - 1.98G - > home/cjg at minute_18 0 - 1.98G - > home/cjg at minute_19 522K - 1.98G - > home/cjg at minute_20 615K - 1.98G - > home/cjg at minute_21 766K - 1.98G - > home/cjg at minute_22 625K - 1.98G - > home/cjg at minute_23 565K - 1.98G - > home/cjg at minute_24 470K - 1.98G - > home/cjg at minute_25 495K - 1.98G - > home/cjg at minute_26 305K - 1.98G - > home/cjg at minute_27 314K - 1.98G - > home/cjg at minute_28 145K - 1.98G - > home/cjg at minute_29 266K - 1.98G - > home/cjg at minute_30 438K - 1.98G - > home/cjg at minute_31 584K - 1.98G - > home/cjg at minute_32 524K - 1.98G - > home/cjg at minute_33 538K - 1.98G - > home/cjg at minute_34 564K - 1.98G - > home/cjg at minute_35 596K - 1.98G - > home/cjg at minute_36 638K - 1.98G - > home/cjg at minute_37 796K - 1.98G - > home/cjg at minute_38 226K - 1.98G - > home/cjg at minute_39 210K - 1.98G - > home/cjg at minute_40 211K - 1.98G - > home/cjg at minute_41 145K - 1.98G - > home/cjg at minute_42 198K - 1.98G - > home/cjg at 2006-02-03-17:45:30 0 - 1.98G - > home/cjg at 2006-02-03-17:45:41 0 - 1.98G - > home/cjg at 2006-02-03-17:54:55 97K - 1.98G - > home/cjg at 2006-02-04-14:14:03 0 - 1.98G - > home/cjg at 2006-02-04-14:14:12 0 - 1.98G - > home/cjg at day_05 1.51M - 1.98G - > home/cjg at 2006-02-07-18:20:37 7.38M - 1.99G - > home/cjg at 2006-02-07-20:04:17 0 - 1.98G - > home/cjg at 2006-02-07-20:04:28 0 - 1.98G - > home/cjg at 2006-02-10-21:52:02 0 - 1.98G - > home/cjg at 2006-02-10-21:52:11 0 - 1.98G - > home/cjg at 2006-02-11-09:42:04 0 - 1.98G - > home/cjg at 2006-02-11-09:42:15 0 - 1.98G - > home/cjg at 2006-02-11-09:42:25 0 - 1.98G - > home/cjg at 2006-02-18-17:41:07 0 - 1.98G - > home/cjg at 2006-02-18-17:41:18 0 - 1.98G - > home/cjg at day_19 13.5M - 1.98G - > home/cjg at day_20 871K - 1.98G - > home/cjg at 2006-02-20-20:16:33 880K - 1.98G - > home/cjg at day_22 1.40M - 1.98G - > home/cjg at 2006-02-23-09:27:50 1.41M - 1.94G - > home/cjg at 2006-02-24-17:51:24 0 - 1.94G - > home/cjg at 2006-02-24-17:51:33 0 - 1.94G - > home/cjg at 2006-02-24-17:51:43 0 - 1.94G - > home/cjg at 2006-02-25-17:51:34 0 - 1.94G - > home/cjg at 2006-02-25-17:51:43 0 - 1.94G - > home/cjg at 2006-02-25-17:51:54 0 - 1.94G - > home/cjg at 2006-02-25-17:59:37 0 - 1.94G - > home/cjg at 2006-02-25-17:59:46 0 - 1.94G - > home/cjg at 2006-02-25-17:59:56 0 - 1.94G - > home/cjg at 2006-02-25-18:01:25 97K - 1.94G - > home/cjg at 2006-02-26-15:03:23 2.25M - 1.94G - > home/cjg at 2006-02-28-13:59:40 0 - 1.96G - > home/cjg at 2006-02-28-13:59:51 0 - 1.96G - > home/cjg at 2006-02-28-14:00:01 0 - 1.96G - > home/cjg at day_01 0 - 1.95G - > home/cjg at month_03 0 - 1.95G - > home/cjg at 2006-03-01-07:11:29 0 - 1.95G - > home/cjg at 2006-03-01-07:11:40 0 - 1.95G - > home/cjg at 2006-03-04-08:34:10 97K - 1.95G - > home/cjg at 2006-03-04-11:47:02 0 - 1.95G - > home/cjg at 2006-03-04-11:47:12 0 - 1.95G - > home/cjg at 2006-03-04-11:47:23 0 - 1.95G - > home/cjg at 2006-03-04-12:08:14 752K - 1.95G - > home/cjg at 2006-03-04-15:02:00 0 - 1.95G - > home/cjg at 2006-03-04-15:02:09 0 - 1.95G - > home/cjg at 2006-03-05-07:58:37 0 - 1.95G - > home/cjg at 2006-03-05-07:58:48 0 - 1.95G - > home/cjg at 2006-03-05-08:09:43 0 - 1.95G - > home/cjg at 2006-03-05-08:09:54 0 - 1.95G - > home/cjg at 2006-03-05-13:34:51 0 - 1.94G - > home/cjg at 2006-03-05-13:35:13 0 - 1.94G - > home/cjg at 2006-03-07-20:55:09 1.50M - 1.94G - > home/cjg at day_08 2.76M - 1.95G - > home/cjg at 2006-03-10-22:02:09 0 - 1.95G - > home/cjg at 2006-03-10-22:02:19 0 - 1.95G - > home/cjg at 2006-03-10-22:02:30 0 - 1.95G - > home/cjg at day_12 1.36M - 1.96G - > home/cjg at 2006-03-12-17:48:46 0 - 1.96G - > home/cjg at 2006-03-12-17:48:57 0 - 1.96G - > home/cjg at 2006-03-12-17:49:07 0 - 1.96G - > home/cjg at 2006-03-14-22:08:59 0 - 1.97G - > home/cjg at 2006-03-14-22:09:11 0 - 1.97G - > home/cjg at 2006-03-14-22:09:21 0 - 1.97G - > home/cjg at 2006-03-15-11:38:28 0 - 1.97G - > home/cjg at 2006-03-15-11:38:39 0 - 1.97G - > home/cjg at 2006-03-15-18:46:35 723K - 1.97G - > home/cjg at 2006-03-15-20:33:11 0 - 1.97G - > home/cjg at 2006-03-15-20:33:22 0 - 1.97G - > home/cjg at 2006-03-15-20:33:32 0 - 1.97G - > home/cjg at 2006-03-15-21:37:33 0 - 1.95G - > home/cjg at 2006-03-15-21:37:42 0 - 1.95G - > home/cjg at 2006-03-15-21:37:53 0 - 1.95G - > home/cjg at 2006-03-16-17:58:31 0 - 1.95G - > home/cjg at 2006-03-16-17:58:41 0 - 1.95G - > home/cjg at 2006-03-16-21:58:50 0 - 1.95G - > home/cjg at 2006-03-16-21:59:00 0 - 1.95G - > home/cjg at 2006-03-16-22:05:04 0 - 1.95G - > home/cjg at 2006-03-16-22:05:13 0 - 1.95G - > home/cjg at 2006-03-16-22:05:25 0 - 1.95G - > home/cjg at 2006-03-16-22:13:33 0 - 1.95G - > home/cjg at 2006-03-16-22:13:44 0 - 1.95G - > home/cjg at 2006-03-16-22:13:54 0 - 1.95G - > home/cjg at 2006-03-19-09:03:31 0 - 1.95G - > home/cjg at 2006-03-19-09:03:42 0 - 1.95G - > home/cjg at 2006-03-19-09:03:52 0 - 1.95G - > home/cjg at 2006-03-19-10:06:30 0 - 2.02G - > home/cjg at 2006-03-19-10:06:51 0 - 2.02G - > home/cjg at 2006-03-20-16:27:53 0 - 2.02G - > home/cjg at 2006-03-20-16:28:03 0 - 2.02G - > home/cjg at day_21 1.92M - 2.03G - > home/cjg at 2006-03-21-11:33:28 0 - 2.03G - > home/cjg at 2006-03-21-11:33:38 0 - 2.03G - > home/cjg at 2006-03-21-21:05:01 1.30M - 2.03G - > home/cjg at 2006-03-21-23:07:23 0 - 2.03G - > home/cjg at 2006-03-21-23:07:32 0 - 2.03G - > home/cjg at 2006-03-21-23:07:43 0 - 2.03G - > home/cjg at 2006-03-21-23:16:43 0 - 2.03G - > home/cjg at 2006-03-21-23:16:53 0 - 2.03G - > home/cjg at 2006-03-21-23:17:03 0 - 2.03G - > home/cjg at 2006-03-22-17:06:52 97K - 2.03G - > home/cjg at 2006-03-22-17:12:02 0 - 2.03G - > home/cjg at 2006-03-22-17:12:13 0 - 2.03G - > home/cjg at 2006-03-22-17:12:25 0 - 2.03G - > home/cjg at day_24 1.44M - 2.03G - > home/cjg at 2006-03-24-12:06:03 0 - 2.03G - > home/cjg at 2006-03-24-12:06:13 0 - 2.03G - > home/cjg at 2006-03-25-13:54:01 0 - 2.03G - > home/cjg at 2006-03-25-13:54:23 0 - 2.03G - > home/cjg at 2006-03-25-17:03:14 0 - 2.03G - > home/cjg at 2006-03-25-17:03:24 0 - 2.03G - > home/cjg at 2006-03-25-17:03:34 0 - 2.03G - > home/cjg at 2006-03-25-17:13:29 712K - 2.03G - > home/cjg at 2006-03-26-16:18:34 1.29M - 2.02G - > home/cjg at 2006-03-28-17:47:14 0 - 2.02G - > home/cjg at 2006-03-28-17:47:24 0 - 2.02G - > home/cjg at 2006-03-28-17:47:34 0 - 2.02G - > home/cjg at 2006-03-28-18:51:19 0 - 2.02G - > home/cjg at 2006-03-28-18:51:29 0 - 2.02G - > home/cjg at 2006-03-28-18:51:39 0 - 2.02G - > home/cjg at 2006-04-08-08:29:23 0 - 2.04G - > home/cjg at 2006-04-08-08:29:32 0 - 2.04G - > home/cjg at 2006-04-08-08:29:42 0 - 2.04G - > home/cjg at 2006-04-08-09:34:16 0 - 2.04G - > home/cjg at 2006-04-08-09:34:27 0 - 2.04G - > home/cjg at 2006-04-08-09:34:38 0 - 2.04G - > home/cjg at 2006-04-08-19:09:47 1.25M - 2.04G - > home/cjg at 2006-04-08-21:39:49 1.56M - 2.04G - > home/cjg at 2006-04-12-20:20:32 0 - 2.04G - > home/cjg at 2006-04-12-20:20:40 0 - 2.04G - > home/cjg at 2006-04-12-20:20:50 0 - 2.04G - > home/cjg at 2006-04-12-20:32:44 0 - 2.04G - > home/cjg at 2006-04-12-20:32:54 0 - 2.04G - > home/cjg at 2006-04-13-06:42:41 1.95M - 2.04G - > home/cjg at 2006-04-14-18:10:24 0 - 2.04G - > home/cjg at 2006-04-14-18:10:34 0 - 2.04G - > home/cjg at 2006-04-14-18:10:45 0 - 2.04G - > home/cjg at 2006-04-14-18:15:39 0 - 2.04G - > home/cjg at 2006-04-14-18:15:50 0 - 2.04G - > home/cjg at 2006-04-16-11:07:22 2.42M - 2.05G - > home/cjg at 2006-04-16-21:45:20 0 - 2.05G - > home/cjg at 2006-04-16-21:45:41 0 - 2.05G - > home/cjg at 2006-04-17-11:59:41 1.63M - 2.05G - > home/cjg at 2006-04-18-10:39:33 56K - 2.05G - > home/cjg at 2006-04-18-19:42:13 56K - 2.05G - > home/cjg at 2006-04-20-09:43:40 220K - 2.04G - > home/cjg at 2006-04-20-11:11:18 0 - 2.04G - > home/cjg at 2006-04-20-11:11:27 0 - 2.04G - > home/cjg at 2006-04-20-13:35:22 0 - 2.04G - > home/cjg at 2006-04-20-13:35:32 0 - 2.04G - > home/cjg at backup 54K - 2.04G - > home/cjg at 2006-04-20-14:44:55 49K - 2.04G - > home/cjg at 2006-04-20-15:02:11 0 - 2.04G - > home/cjg at 2006-04-20-15:02:32 0 - 2.04G - > home/cjg at 2006-04-20-16:42:02 0 - 2.04G - > home/cjg at 2006-04-20-16:42:13 0 - 2.04G - > home/cjg at 2006-04-22-19:23:56 198K - 2.04G - > home/cjg at day_23 150K - 2.04G - > home/cjg at 2006-04-23-15:43:28 852K - 2.04G - > home/cjg at 2006-04-23-18:12:50 16K - 2.04G - > home/cjg at 2006-04-23-18:18:14 16K - 2.04G - > home/cjg at 2006-04-25-20:55:29 0 - 2.03G - > home/cjg at 2006-04-25-20:55:38 0 - 2.03G - > home/cjg at 2006-04-26-20:14:56 0 - 2.03G - > home/cjg at 2006-04-26-20:15:06 0 - 2.03G - > home/cjg at 2006-04-26-20:15:16 0 - 2.03G - > home/cjg at 2006-04-26-20:22:09 16K - 2.03G - > home/cjg at 2006-05-01-16:38:41 2.23M - 2.04G - > home/cjg at 2006-05-01-23:37:15 120K - 2.05G - > home/cjg at day_02 82.5K - 2.05G - > home/cjg at 2006-05-02-09:17:53 172K - 1.91G - > home/cjg at 2006-05-06-13:34:11 2.15M - 2.29G - > home/cjg at 2006-05-06-20:20:44 0 - 2.29G - > home/cjg at 2006-05-06-20:20:54 0 - 2.29G - > home/cjg at 2006-05-06-20:21:05 0 - 2.29G - > home/cjg at 2006-05-06-21:36:16 0 - 2.27G - > home/cjg at 2006-05-06-21:36:26 0 - 2.27G - > home/cjg at hour_00 78.5K - 2.27G - > home/cjg at hour_01 0 - 2.27G - > home/cjg at day_07 0 - 2.27G - > home/cjg at hour_02 0 - 2.27G - > home/cjg at hour_03 0 - 2.27G - > home/cjg at hour_04 0 - 2.27G - > home/cjg at hour_05 0 - 2.27G - > home/cjg at hour_06 0 - 2.27G - > home/cjg at 2006-05-09-10:08:17 0 - 2.28G - > home/cjg at 2006-05-09-10:08:27 0 - 2.28G - > home/cjg at hour_13 17.6M - 2.28G - > home/cjg at hour_14 684K - 2.28G - > home/cjg at hour_15 4.94M - 2.29G - > home/cjg at hour_16 144K - 2.29G - > home/cjg at hour_17 144K - 2.29G - > home/cjg at hour_18 210K - 2.29G - > home/cjg at hour_19 212K - 2.29G - > home/cjg at 2006-05-10-21:49:42 0 - 2.29G - > home/cjg at 2006-05-10-21:49:52 0 - 2.29G - > home/cjg at hour_23 476K - 1.90G - > home/cjg at 2006-05-11-06:51:16 0 - 1.91G - > home/cjg at 2006-05-11-06:51:26 0 - 1.91G - > home/cjg at hour_07 71.5K - 1.91G - > home/cjg at hour_08 0 - 1.91G - > home/cjg at hour_09 0 - 1.91G - > home/cjg at hour_10 0 - 1.91G - > home/cjg at hour_11 0 - 1.91G - > home/cjg at hour_12 0 - 1.91G - > home/cjg at 2006-05-12-19:23:44 0 - 1.91G - > home/cjg at 2006-05-12-19:23:54 0 - 1.91G - > home/cjg at hour_20 390K - 1.96G - > home/cjg at hour_21 332K - 1.96G - > home/cjg at hour_22 180K - 1.96G - > home/cjg at 2006-05-12-22:10:59 0 - 1.99G - > home/cjg at 2006-05-12-22:11:09 0 - 1.99G - > home/cjg/pics 4.65G 138M 4.61G > /export/home/cjg/pics > ome/cjg/pics at month_02 0 - 4.52G - > home/cjg/pics at 2006-02-02-07:53:46 0 - > 4.52G - > ome/cjg/pics at minute_43 0 - 4.52G - > home/cjg/pics at minute_44 0 - 4.52G - > home/cjg/pics at minute_45 0 - 4.52G - > home/cjg/pics at minute_46 0 - 4.52G - > home/cjg/pics at minute_47 0 - 4.52G - > home/cjg/pics at minute_48 0 - 4.52G - > home/cjg/pics at minute_49 0 - 4.52G - > home/cjg/pics at minute_50 0 - 4.52G - > home/cjg/pics at minute_51 0 - 4.52G - > home/cjg/pics at minute_52 0 - 4.52G - > home/cjg/pics at minute_53 0 - 4.52G - > home/cjg/pics at minute_54 0 - 4.52G - > home/cjg/pics at minute_55 0 - 4.52G - > home/cjg/pics at minute_56 0 - 4.52G - > home/cjg/pics at minute_57 0 - 4.52G - > home/cjg/pics at minute_58 0 - 4.52G - > home/cjg/pics at minute_59 0 - 4.52G - > home/cjg/pics at minute_00 0 - 4.52G - > home/cjg/pics at minute_01 0 - 4.52G - > home/cjg/pics at minute_02 0 - 4.52G - > home/cjg/pics at minute_03 0 - 4.52G - > home/cjg/pics at minute_04 0 - 4.52G - > home/cjg/pics at minute_05 0 - 4.52G - > home/cjg/pics at minute_06 0 - 4.52G - > home/cjg/pics at minute_07 0 - 4.52G - > home/cjg/pics at minute_08 0 - 4.52G - > home/cjg/pics at minute_09 0 - 4.52G - > home/cjg/pics at minute_10 0 - 4.52G - > home/cjg/pics at minute_11 0 - 4.52G - > home/cjg/pics at minute_12 0 - 4.52G - > home/cjg/pics at minute_13 0 - 4.52G - > home/cjg/pics at minute_14 0 - 4.52G - > home/cjg/pics at minute_15 0 - 4.52G - > home/cjg/pics at minute_16 0 - 4.52G - > home/cjg/pics at minute_17 0 - 4.52G - > home/cjg/pics at minute_18 0 - 4.52G - > home/cjg/pics at minute_19 0 - 4.52G - > home/cjg/pics at minute_20 0 - 4.52G - > home/cjg/pics at minute_21 0 - 4.52G - > home/cjg/pics at minute_22 0 - 4.52G - > home/cjg/pics at minute_23 0 - 4.52G - > home/cjg/pics at minute_24 0 - 4.52G - > home/cjg/pics at minute_25 0 - 4.52G - > home/cjg/pics at minute_26 0 - 4.52G - > home/cjg/pics at minute_27 0 - 4.52G - > home/cjg/pics at minute_28 0 - 4.52G - > home/cjg/pics at minute_29 0 - 4.52G - > home/cjg/pics at minute_30 0 - 4.52G - > home/cjg/pics at minute_31 0 - 4.52G - > home/cjg/pics at minute_32 0 - 4.52G - > home/cjg/pics at minute_33 0 - 4.52G - > home/cjg/pics at minute_34 0 - 4.52G - > home/cjg/pics at minute_35 0 - 4.52G - > home/cjg/pics at minute_36 0 - 4.52G - > home/cjg/pics at minute_37 0 - 4.52G - > home/cjg/pics at minute_38 0 - 4.52G - > home/cjg/pics at minute_39 0 - 4.52G - > home/cjg/pics at minute_40 0 - 4.52G - > home/cjg/pics at minute_41 0 - 4.52G - > home/cjg/pics at minute_42 0 - 4.52G - > home/cjg/pics at 2006-02-03-17:45:30 0 - > 4.52G - > ome/cjg/pics at 2006-02-03-17:45:41 0 - 4.52G > - > ome/cjg/pics at 2006-02-03-17:54:55 0 - 4.52G > - > ome/cjg/pics at 2006-02-04-14:14:03 0 - 4.52G > - > ome/cjg/pics at 2006-02-04-14:14:12 0 - 4.52G > - > ome/cjg/pics at day_05 0 - 4.52G - > home/cjg/pics at 2006-02-07-18:20:37 0 - > 4.52G - > ome/cjg/pics at 2006-02-07-20:04:17 0 - 4.52G > - > ome/cjg/pics at 2006-02-07-20:04:28 0 - 4.52G > - > ome/cjg/pics at 2006-02-10-21:52:02 0 - 4.52G > - > ome/cjg/pics at 2006-02-10-21:52:11 0 - 4.52G > - > ome/cjg/pics at 2006-02-11-09:42:04 0 - 4.52G > - > ome/cjg/pics at 2006-02-11-09:42:15 0 - 4.52G > - > ome/cjg/pics at 2006-02-11-09:42:25 0 - 4.52G > - > ome/cjg/pics at 2006-02-18-17:41:07 0 - 4.52G > - > ome/cjg/pics at 2006-02-18-17:41:18 0 - 4.52G > - > ome/cjg/pics at day_19 65K - 4.52G - > home/cjg/pics at day_20 0 - 4.55G - > home/cjg/pics at 2006-02-20-20:16:33 0 - > 4.55G - > ome/cjg/pics at day_22 0 - 4.55G - > home/cjg/pics at 2006-02-23-09:27:50 0 - > 4.55G - > ome/cjg/pics at 2006-02-24-17:51:33 0 - 4.55G > - > ome/cjg/pics at 2006-02-24-17:51:43 0 - 4.55G > - > ome/cjg/pics at 2006-02-25-17:51:43 0 - 4.55G > - > ome/cjg/pics at 2006-02-25-17:51:54 0 - 4.55G > - > ome/cjg/pics at 2006-02-25-17:59:46 0 - 4.55G > - > ome/cjg/pics at 2006-02-25-17:59:56 0 - 4.55G > - > ome/cjg/pics at 2006-02-25-18:01:25 0 - 4.55G > - > ome/cjg/pics at 2006-02-26-15:03:23 97K - 4.55G > - > ome/cjg/pics at 2006-02-28-13:59:51 97K - 4.55G > - > ome/cjg/pics at day_01 0 - 4.55G - > home/cjg/pics at month_03 0 - 4.55G - > home/cjg/pics at 2006-03-01-07:11:40 0 - > 4.55G - > ome/cjg/pics at 2006-03-04-08:34:10 0 - 4.55G > - > ome/cjg/pics at 2006-03-04-11:47:12 97K - 4.55G > - > ome/cjg/pics at 2006-03-04-12:08:14 97K - 4.55G > - > ome/cjg/pics at 2006-03-05-07:58:37 0 - 4.55G > - > ome/cjg/pics at 2006-03-05-07:58:48 0 - 4.55G > - > ome/cjg/pics at 2006-03-05-08:09:43 0 - 4.55G > - > ome/cjg/pics at 2006-03-05-08:09:54 0 - 4.55G > - > ome/cjg/pics at 2006-03-05-13:35:13 97K - 4.55G > - > ome/cjg/pics at day_08 97K - 4.55G - > home/cjg/pics at 2006-03-10-22:02:19 0 - > 4.55G - > ome/cjg/pics at 2006-03-10-22:02:30 0 - 4.55G > - > ome/cjg/pics at day_12 0 - 4.55G - > home/cjg/pics at 2006-03-12-17:48:57 0 - > 4.55G - > ome/cjg/pics at 2006-03-14-22:09:11 0 - 4.57G > - > ome/cjg/pics at 2006-03-14-22:09:21 0 - 4.57G > - > ome/cjg/pics at 2006-03-15-11:38:39 97K - 4.57G > - > ome/cjg/pics at 2006-03-15-20:33:32 97K - 4.57G > - > ome/cjg/pics at 2006-03-15-21:37:53 97K - 4.57G > - > ome/cjg/pics at 2006-03-16-17:58:31 0 - 4.57G > - > ome/cjg/pics at 2006-03-16-17:58:41 0 - 4.57G > - > ome/cjg/pics at 2006-03-16-21:59:00 0 - 4.57G > - > ome/cjg/pics at 2006-03-16-22:05:13 0 - 4.57G > - > ome/cjg/pics at 2006-03-16-22:05:25 0 - 4.57G > - > ome/cjg/pics at 2006-03-16-22:13:33 0 - 4.57G > - > ome/cjg/pics at 2006-03-16-22:13:44 0 - 4.57G > - > ome/cjg/pics at 2006-03-16-22:13:54 0 - 4.57G > - > ome/cjg/pics at 2006-03-19-09:03:31 0 - 4.57G > - > ome/cjg/pics at 2006-03-19-09:03:52 0 - 4.57G > - > ome/cjg/pics at 2006-03-20-16:28:03 0 - 4.57G > - > ome/cjg/pics at day_21 0 - 4.57G - > home/cjg/pics at 2006-03-21-11:33:28 0 - > 4.57G - > ome/cjg/pics at 2006-03-21-11:33:38 0 - 4.57G > - > ome/cjg/pics at 2006-03-21-21:05:01 97K - 4.61G > - > ome/cjg/pics at 2006-03-21-23:07:23 0 - 4.61G > - > ome/cjg/pics at 2006-03-21-23:07:32 0 - 4.61G > - > ome/cjg/pics at 2006-03-21-23:07:43 0 - 4.61G > - > ome/cjg/pics at 2006-03-21-23:16:43 0 - 4.61G > - > ome/cjg/pics at 2006-03-21-23:16:53 0 - 4.61G > - > ome/cjg/pics at 2006-03-21-23:17:03 0 - 4.61G > - > ome/cjg/pics at 2006-03-22-17:12:25 97K - 4.61G > - > ome/cjg/pics at day_24 0 - 4.61G - > home/cjg/pics at 2006-03-24-12:06:13 0 - > 4.61G - > ome/cjg/pics at 2006-03-25-13:54:23 0 - 4.61G > - > ome/cjg/pics at 2006-03-25-17:03:24 0 - 4.62G > - > ome/cjg/pics at 2006-03-25-17:03:34 0 - 4.62G > - > ome/cjg/pics at 2006-03-25-17:13:29 97K - 4.62G > - > ome/cjg/pics at 2006-03-26-16:18:34 15.5K - 4.62G > - > ome/cjg/pics at 2006-03-28-17:47:24 0 - 4.62G > - > ome/cjg/pics at 2006-03-28-17:47:34 0 - 4.62G > - > ome/cjg/pics at 2006-03-28-18:51:19 0 - 4.62G > - > ome/cjg/pics at 2006-03-28-18:51:29 0 - 4.62G > - > ome/cjg/pics at 2006-03-28-18:51:39 0 - 4.62G > - > ome/cjg/pics at 2006-04-08-08:29:32 0 - 4.62G > - > ome/cjg/pics at 2006-04-08-08:29:42 0 - 4.62G > - > ome/cjg/pics at 2006-04-08-09:34:27 0 - 4.62G > - > ome/cjg/pics at 2006-04-08-09:34:38 0 - 4.62G > - > ome/cjg/pics at 2006-04-08-19:09:47 15.5K - 4.62G > - > ome/cjg/pics at 2006-04-08-21:39:49 15.5K - 4.62G > - > ome/cjg/pics at 2006-04-12-20:20:40 0 - 4.62G > - > ome/cjg/pics at 2006-04-12-20:20:50 0 - 4.62G > - > ome/cjg/pics at 2006-04-12-20:32:44 0 - 4.62G > - > ome/cjg/pics at 2006-04-12-20:32:54 0 - 4.62G > - > ome/cjg/pics at 2006-04-13-06:42:41 15.5K - 4.62G > - > ome/cjg/pics at 2006-04-14-18:10:34 0 - 4.62G > - > ome/cjg/pics at 2006-04-14-18:10:45 0 - 4.62G > - > ome/cjg/pics at 2006-04-14-18:15:39 0 - 4.62G > - > ome/cjg/pics at 2006-04-14-18:15:50 0 - 4.62G > - > ome/cjg/pics at 2006-04-16-11:07:22 15.5K - 4.62G > - > ome/cjg/pics at 2006-04-16-21:45:20 0 - 4.62G > - > ome/cjg/pics at 2006-04-16-21:45:41 0 - 4.62G > - > ome/cjg/pics at 2006-04-17-11:59:41 15.5K - 4.62G > - > ome/cjg/pics at 2006-04-18-10:39:33 0 - 4.62G > - > ome/cjg/pics at 2006-04-18-19:42:13 0 - 4.62G > - > ome/cjg/pics at 2006-04-20-09:43:40 15.5K - 4.62G > - > ome/cjg/pics at 2006-04-20-11:11:18 0 - 4.62G > - > ome/cjg/pics at 2006-04-20-11:11:27 0 - 4.62G > - > ome/cjg/pics at 2006-04-20-13:35:22 0 - 4.62G > - > ome/cjg/pics at 2006-04-20-13:35:32 0 - 4.62G > - > ome/cjg/pics at backup 0 - 4.62G - > home/cjg/pics at 2006-04-20-16:42:13 15.5K - > 4.62G - > ome/cjg/pics at 2006-04-22-19:23:56 15.5K - 4.62G > - > ome/cjg/pics at day_23 0 - 4.62G - > home/cjg/pics at 2006-04-23-15:43:28 0 - > 4.62G - > ome/cjg/pics at 2006-04-23-18:12:50 0 - 4.62G > - > ome/cjg/pics at 2006-04-23-18:18:14 0 - 4.62G > - > ome/cjg/pics at 2006-04-25-20:55:29 0 - 4.62G > - > ome/cjg/pics at 2006-04-25-20:55:38 0 - 4.62G > - > ome/cjg/pics at 2006-04-26-20:14:56 0 - 4.62G > - > ome/cjg/pics at 2006-04-26-20:15:06 0 - 4.62G > - > ome/cjg/pics at 2006-04-26-20:15:16 0 - 4.62G > - > ome/cjg/pics at 2006-04-26-20:22:09 0 - 4.62G > - > ome/cjg/pics at 2006-05-01-16:38:41 15.5K - 4.62G > - > ome/cjg/pics at 2006-05-01-23:37:15 0 - 4.62G > - > ome/cjg/pics at day_02 0 - 4.62G - > home/cjg/pics at 2006-05-02-09:17:53 15.5K - > 4.62G - > ome/cjg/pics at 2006-05-06-13:34:11 15.5K - 4.62G > - > ome/cjg/pics at 2006-05-06-20:20:54 0 - 4.62G > - > ome/cjg/pics at 2006-05-06-20:21:05 0 - 4.62G > - > ome/cjg/pics at 2006-05-06-21:36:26 0 - 4.62G > - > ome/cjg/pics at hour_00 3.25M - 4.61G - > home/cjg/pics at hour_01 0 - 4.61G - > home/cjg/pics at day_07 0 - 4.61G - > home/cjg/pics at hour_02 0 - 4.61G - > home/cjg/pics at hour_03 0 - 4.61G - > home/cjg/pics at hour_04 0 - 4.61G - > home/cjg/pics at hour_05 0 - 4.61G - > home/cjg/pics at hour_06 0 - 4.61G - > home/cjg/pics at 2006-05-09-10:08:17 0 - > 4.61G - > ome/cjg/pics at 2006-05-09-10:08:27 0 - 4.61G > - > ome/cjg/pics at hour_13 55K - 4.61G - > home/cjg/pics at hour_14 55K - 4.61G - > home/cjg/pics at hour_15 1.75M - 4.61G - > home/cjg/pics at hour_16 0 - 4.61G - > home/cjg/pics at hour_17 0 - 4.61G - > home/cjg/pics at hour_18 0 - 4.61G - > home/cjg/pics at hour_19 0 - 4.61G - > home/cjg/pics at 2006-05-10-21:49:42 0 - > 4.61G - > ome/cjg/pics at 2006-05-10-21:49:52 0 - 4.61G > - > ome/cjg/pics at hour_23 0 - 4.61G - > home/cjg/pics at 2006-05-11-06:51:26 0 - > 4.61G - > ome/cjg/pics at hour_07 0 - 4.61G - > home/cjg/pics at hour_08 0 - 4.61G - > home/cjg/pics at hour_09 0 - 4.61G - > home/cjg/pics at hour_10 0 - 4.61G - > home/cjg/pics at hour_11 0 - 4.61G - > home/cjg/pics at hour_12 0 - 4.61G - > home/cjg/pics at 2006-05-12-19:23:44 0 - > 4.61G - > ome/cjg/pics at 2006-05-12-19:23:54 0 - 4.61G > - > ome/cjg/pics at hour_20 0 - 4.61G - > home/cjg/pics at hour_21 0 - 4.61G - > home/cjg/pics at hour_22 0 - 4.61G - > home/cjg/pics at 2006-05-12-22:10:59 0 - > 4.61G - > ome/cjg/pics at 2006-05-12-22:11:09 0 - 4.61G > - > sigma IA 5 $;This message posted from opensolaris.org