Siobhan Patricia Lynch
2008-Jan-28 08:43 UTC
[crossbow-discuss] Panic on incoming TCP requests on snv61 with XB 15 installed via Snapshot
Hi all, I am having a major issue here, our product now relies upon vnics inside non-global zones as a way to solve a routing problem we encounter when using OpenVPN on a global zone. Problem being, we have two machines working in the field just fine, but now I''m consistently getting panics on incoming TCP connects (tried with ssh, telnet, and FTP ports): panic[cpu0]/thread=d2be1de0: BAD TRAP: type=e (#pf Page fault) rp=d2be1ca4 addr=ec occurred in module "unix" due to a NULL pointer dereference sched: #pf Page fault Bad kernel fault at addr=0xec pid=0, pc=0xfe832cbd, sp=0xf9259d00, eflags=0x10246 cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: 6f8<xmme,fxsr,pge,mce,pae,pse,de> cr2: ec cr3: 1f31000 gs: d2be01b0 fs: d2be0000 es: 160 ds: d2be0160 edi: 0 esi: ec ebp: d2be1d1c esp: d2be1cdc ebx: 80 edx: d2be1de0 ecx: ec eax: 0 trp: e err: 2 eip: fe832cbd cs: 158 efl: 10246 usp: f9259d00 ss: ec d2be1bfc unix:die+98 (e, d2be1ca4, ec, 0) d2be1c90 unix:trap+11c4 (d2be1ca4, ec, 0) d2be1ca4 unix:_cmntrap+7c (d2be01b0, d2be0000,) d2be1d1c unix:mutex_enter+d (80, 0, 0, 1) d2be1d78 ip:squeue_drain+165 (d27b4e40, 2, 97215e) d2be1dc8 ip:squeue_worker+1be (d27b4e40, 0) d2be1dd8 unix:thread_start+8 () syncing file systems... done I haven''t started a full crash dump analysis, because I was hping maybe this is a known issue, and is fixed in a later version. Also, which might be helpful, I''m using a GLDv3 bfe driver (v2.6.0a) that was compiled on another snv61-xb_15 machine (my laptop) Also, where can I find sources to XB that I can build with nv78 or higher? I''m not thriolled in basing a security product off an older build, I don''t mind rolling a new archive to bfu with on these machines, but all I really care about is a stable machine that allows TCP to work normally. -SPL This message posted from opensolaris.org
Rajagopal Kunhappan
2008-Jan-28 19:46 UTC
[crossbow-discuss] Panic on incoming TCP requests on snv61 with XB 15 installed via Snapshot
Siobhan Patricia Lynch wrote:> Hi all, I am having a major issue here, our product now relies upon vnics inside non-global zones as a way to solve a routing problem we encounter when using OpenVPN on a global zone. > > Problem being, we have two machines working in the field just fine, but now I''m consistently getting panics on incoming TCP connects (tried with ssh, telnet, and FTP ports): > > panic[cpu0]/thread=d2be1de0: BAD TRAP: type=e (#pf Page fault) rp=d2be1ca4 addr=ec occurred in module "unix" due to a NULL pointer dereference > > sched: #pf Page fault > Bad kernel fault at addr=0xec > pid=0, pc=0xfe832cbd, sp=0xf9259d00, eflags=0x10246 > cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: 6f8<xmme,fxsr,pge,mce,pae,pse,de> > cr2: ec cr3: 1f31000 > gs: d2be01b0 fs: d2be0000 es: 160 ds: d2be0160 > edi: 0 esi: ec ebp: d2be1d1c esp: d2be1cdc > ebx: 80 edx: d2be1de0 ecx: ec eax: 0 > trp: e err: 2 eip: fe832cbd cs: 158 > efl: 10246 usp: f9259d00 ss: ec > > d2be1bfc unix:die+98 (e, d2be1ca4, ec, 0) > d2be1c90 unix:trap+11c4 (d2be1ca4, ec, 0) > d2be1ca4 unix:_cmntrap+7c (d2be01b0, d2be0000,) > d2be1d1c unix:mutex_enter+d (80, 0, 0, 1) > d2be1d78 ip:squeue_drain+165 (d27b4e40, 2, 97215e) > d2be1dc8 ip:squeue_worker+1be (d27b4e40, 0) > d2be1dd8 unix:thread_start+8 () > > syncing file systems... done > > I haven''t started a full crash dump analysis, because I was hping maybe this is a known issue, and is fixed in a later version. > > Also, which might be helpful, I''m using a GLDv3 bfe driver (v2.6.0a) that was compiled on another snv61-xb_15 machine (my laptop) > > Also, where can I find sources to XB that I can build with nv78 or higher? I''m not thriolled in basing a security product off an older build, I don''t mind rolling a new archive to bfu with on these machines, but all I really care about is a stable machine that allows TCP to work normally. >We are working on releasing newer crossbow bits and sources based on nv79 either this week or next. So hopefully the panic is fixed in that and your above security concern will be allayed. Thanks, -krgopi> -SPL > > > This message posted from opensolaris.org > _______________________________________________ > crossbow-discuss mailing list > crossbow-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/crossbow-discuss >
Siobhan P. Lynch
2008-Jan-28 21:35 UTC
[crossbow-discuss] Panic on incoming TCP requests on snv61 with XB 15 installed via Snapshot
What are the chances of this being merged into the main branch within a few months? I''d love to be able to use a standard SXCE install for this... and then the bfu archives for security related upgrades. -SPL -----Original Message----- From: Rajagopal Kunhappan [mailto:rajagopal.kunhappan at sun.com] Sent: Monday, January 28, 2008 2:46 PM To: Siobhan P. Lynch Cc: crossbow-discuss at opensolaris.org Subject: Re: [crossbow-discuss] Panic on incoming TCP requests on snv61 with XB 15 installed via Snapshot Siobhan Patricia Lynch wrote:> Hi all, I am having a major issue here, our product now relies uponvnics inside non-global zones as a way to solve a routing problem we encounter when using OpenVPN on a global zone.> > Problem being, we have two machines working in the field just fine,but now I''m consistently getting panics on incoming TCP connects (tried with ssh, telnet, and FTP ports):> > panic[cpu0]/thread=d2be1de0: BAD TRAP: type=e (#pf Page fault)rp=d2be1ca4 addr=ec occurred in module "unix" due to a NULL pointer dereference> > sched: #pf Page fault > Bad kernel fault at addr=0xec > pid=0, pc=0xfe832cbd, sp=0xf9259d00, eflags=0x10246 > cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4:6f8<xmme,fxsr,pge,mce,pae,pse,de>> cr2: ec cr3: 1f31000 > gs: d2be01b0 fs: d2be0000 es: 160 ds: d2be0160 > edi: 0 esi: ec ebp: d2be1d1c esp: d2be1cdc > ebx: 80 edx: d2be1de0 ecx: ec eax: 0 > trp: e err: 2 eip: fe832cbd cs: 158 > efl: 10246 usp: f9259d00 ss: ec > > d2be1bfc unix:die+98 (e, d2be1ca4, ec, 0) > d2be1c90 unix:trap+11c4 (d2be1ca4, ec, 0) > d2be1ca4 unix:_cmntrap+7c (d2be01b0, d2be0000,) > d2be1d1c unix:mutex_enter+d (80, 0, 0, 1) > d2be1d78 ip:squeue_drain+165 (d27b4e40, 2, 97215e) > d2be1dc8 ip:squeue_worker+1be (d27b4e40, 0) > d2be1dd8 unix:thread_start+8 () > > syncing file systems... done > > I haven''t started a full crash dump analysis, because I was hpingmaybe this is a known issue, and is fixed in a later version.> > Also, which might be helpful, I''m using a GLDv3 bfe driver (v2.6.0a)that was compiled on another snv61-xb_15 machine (my laptop)> > Also, where can I find sources to XB that I can build with nv78 orhigher? I''m not thriolled in basing a security product off an older build, I don''t mind rolling a new archive to bfu with on these machines, but all I really care about is a stable machine that allows TCP to work normally.>We are working on releasing newer crossbow bits and sources based on nv79 either this week or next. So hopefully the panic is fixed in that and your above security concern will be allayed. Thanks, -krgopi> -SPL > > > This message posted from opensolaris.org > _______________________________________________ > crossbow-discuss mailing list > crossbow-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/crossbow-discuss >
Sunay Tripathi
2008-Jan-28 21:53 UTC
[crossbow-discuss] Panic on incoming TCP requests on snv61 with XB 15 installed via Snapshot
I think that is the target. We are starting a extensive beta in a few weeks. If that goes well, then the current target to merge in nevada is late april/early may. We will be able to accurately predict this after the beta is done. Cheers, Sunay Siobhan P. Lynch wrote:> What are the chances of this being merged into the main branch within a > few months? I''d love to be able to use a standard SXCE install for > this... and then the bfu archives for security related upgrades. > > -SPL > > -----Original Message----- > From: Rajagopal Kunhappan [mailto:rajagopal.kunhappan at sun.com] > Sent: Monday, January 28, 2008 2:46 PM > To: Siobhan P. Lynch > Cc: crossbow-discuss at opensolaris.org > Subject: Re: [crossbow-discuss] Panic on incoming TCP requests on snv61 > with XB 15 installed via Snapshot > > > > Siobhan Patricia Lynch wrote: >> Hi all, I am having a major issue here, our product now relies upon > vnics inside non-global zones as a way to solve a routing problem we > encounter when using OpenVPN on a global zone. >> Problem being, we have two machines working in the field just fine, > but now I''m consistently getting panics on incoming TCP connects (tried > with ssh, telnet, and FTP ports): >> panic[cpu0]/thread=d2be1de0: BAD TRAP: type=e (#pf Page fault) > rp=d2be1ca4 addr=ec occurred in module "unix" due to a NULL pointer > dereference >> sched: #pf Page fault >> Bad kernel fault at addr=0xec >> pid=0, pc=0xfe832cbd, sp=0xf9259d00, eflags=0x10246 >> cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: > 6f8<xmme,fxsr,pge,mce,pae,pse,de> >> cr2: ec cr3: 1f31000 >> gs: d2be01b0 fs: d2be0000 es: 160 ds: d2be0160 >> edi: 0 esi: ec ebp: d2be1d1c esp: d2be1cdc >> ebx: 80 edx: d2be1de0 ecx: ec eax: 0 >> trp: e err: 2 eip: fe832cbd cs: 158 >> efl: 10246 usp: f9259d00 ss: ec >> >> d2be1bfc unix:die+98 (e, d2be1ca4, ec, 0) >> d2be1c90 unix:trap+11c4 (d2be1ca4, ec, 0) >> d2be1ca4 unix:_cmntrap+7c (d2be01b0, d2be0000,) >> d2be1d1c unix:mutex_enter+d (80, 0, 0, 1) >> d2be1d78 ip:squeue_drain+165 (d27b4e40, 2, 97215e) >> d2be1dc8 ip:squeue_worker+1be (d27b4e40, 0) >> d2be1dd8 unix:thread_start+8 () >> >> syncing file systems... done >> >> I haven''t started a full crash dump analysis, because I was hping > maybe this is a known issue, and is fixed in a later version. >> Also, which might be helpful, I''m using a GLDv3 bfe driver (v2.6.0a) > that was compiled on another snv61-xb_15 machine (my laptop) >> Also, where can I find sources to XB that I can build with nv78 or > higher? I''m not thriolled in basing a security product off an older > build, I don''t mind rolling a new archive to bfu with on these machines, > but all I really care about is a stable machine that allows TCP to work > normally. >> > We are working on releasing newer crossbow bits and sources based on > nv79 either this week or next. So hopefully the panic is fixed in that > and your above security concern will be allayed. > > Thanks, > -krgopi >> -SPL >> >> >> This message posted from opensolaris.org >> _______________________________________________ >> crossbow-discuss mailing list >> crossbow-discuss at opensolaris.org >> http://mail.opensolaris.org/mailman/listinfo/crossbow-discuss >> > _______________________________________________ > crossbow-discuss mailing list > crossbow-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/crossbow-discuss-- Sunay Tripathi Distinguished Engineer Solaris Core Operating System Sun MicroSystems Inc. Solaris Networking: http://www.opensolaris.org/os/community/networking Project Crossbow: http://www.opensolaris.org/os/project/crossbow
Siobhan P. Lynch
2008-Jan-28 21:57 UTC
[crossbow-discuss] Panic on incoming TCP requests on snv61 with XB 15 installed via Snapshot
Nice, if you need help with the beta testing extensively under "production" conditions, we''re using this in a pilot of our hardware product (obviously I can''t give too much info without someone signing an NDA), I''d love to work with you guys on providing feedback on the beta release. Even the old beta works great on the boxes that it hasn''t panic''d on. I''m still not 100% sure why some (ostensibly identical) boxes panic and others don''t, however I''ll be doing some comparison of PCI ids and outputs of prtconf and prtdiag outputs, to see if hardware is slightly different on what SHOULD be the identical motherboard. -SPL -----Original Message----- From: Sunay Tripathi [mailto:Sunay.Tripathi at sun.com] Sent: Monday, January 28, 2008 4:54 PM To: Siobhan P. Lynch Cc: rajagopal.kunhappan at sun.com; crossbow-discuss at opensolaris.org Subject: Re: [crossbow-discuss] Panic on incoming TCP requests on snv61 with XB 15 installed via Snapshot I think that is the target. We are starting a extensive beta in a few weeks. If that goes well, then the current target to merge in nevada is late april/early may. We will be able to accurately predict this after the beta is done. Cheers, Sunay Siobhan P. Lynch wrote:> What are the chances of this being merged into the main branch withina> few months? I''d love to be able to use a standard SXCE install for > this... and then the bfu archives for security related upgrades. > > -SPL > > -----Original Message----- > From: Rajagopal Kunhappan [mailto:rajagopal.kunhappan at sun.com] > Sent: Monday, January 28, 2008 2:46 PM > To: Siobhan P. Lynch > Cc: crossbow-discuss at opensolaris.org > Subject: Re: [crossbow-discuss] Panic on incoming TCP requests onsnv61> with XB 15 installed via Snapshot > > > > Siobhan Patricia Lynch wrote: >> Hi all, I am having a major issue here, our product now relies upon > vnics inside non-global zones as a way to solve a routing problem we > encounter when using OpenVPN on a global zone. >> Problem being, we have two machines working in the field just fine, > but now I''m consistently getting panics on incoming TCP connects(tried> with ssh, telnet, and FTP ports): >> panic[cpu0]/thread=d2be1de0: BAD TRAP: type=e (#pf Page fault) > rp=d2be1ca4 addr=ec occurred in module "unix" due to a NULL pointer > dereference >> sched: #pf Page fault >> Bad kernel fault at addr=0xec >> pid=0, pc=0xfe832cbd, sp=0xf9259d00, eflags=0x10246 >> cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: > 6f8<xmme,fxsr,pge,mce,pae,pse,de> >> cr2: ec cr3: 1f31000 >> gs: d2be01b0 fs: d2be0000 es: 160 ds: d2be0160 >> edi: 0 esi: ec ebp: d2be1d1c esp: d2be1cdc >> ebx: 80 edx: d2be1de0 ecx: ec eax: 0 >> trp: e err: 2 eip: fe832cbd cs: 158 >> efl: 10246 usp: f9259d00 ss: ec >> >> d2be1bfc unix:die+98 (e, d2be1ca4, ec, 0) >> d2be1c90 unix:trap+11c4 (d2be1ca4, ec, 0) >> d2be1ca4 unix:_cmntrap+7c (d2be01b0, d2be0000,) >> d2be1d1c unix:mutex_enter+d (80, 0, 0, 1) >> d2be1d78 ip:squeue_drain+165 (d27b4e40, 2, 97215e) >> d2be1dc8 ip:squeue_worker+1be (d27b4e40, 0) >> d2be1dd8 unix:thread_start+8 () >> >> syncing file systems... done >> >> I haven''t started a full crash dump analysis, because I was hping > maybe this is a known issue, and is fixed in a later version. >> Also, which might be helpful, I''m using a GLDv3 bfe driver (v2.6.0a) > that was compiled on another snv61-xb_15 machine (my laptop) >> Also, where can I find sources to XB that I can build with nv78 or > higher? I''m not thriolled in basing a security product off an older > build, I don''t mind rolling a new archive to bfu with on thesemachines,> but all I really care about is a stable machine that allows TCP towork> normally. >> > We are working on releasing newer crossbow bits and sources based on > nv79 either this week or next. So hopefully the panic is fixed in that> and your above security concern will be allayed. > > Thanks, > -krgopi >> -SPL >> >> >> This message posted from opensolaris.org >> _______________________________________________ >> crossbow-discuss mailing list >> crossbow-discuss at opensolaris.org >> http://mail.opensolaris.org/mailman/listinfo/crossbow-discuss >> > _______________________________________________ > crossbow-discuss mailing list > crossbow-discuss at opensolaris.org > http://mail.opensolaris.org/mailman/listinfo/crossbow-discuss-- Sunay Tripathi Distinguished Engineer Solaris Core Operating System Sun MicroSystems Inc. Solaris Networking: http://www.opensolaris.org/os/community/networking Project Crossbow: http://www.opensolaris.org/os/project/crossbow
Sunay Tripathi
2008-Jan-28 22:50 UTC
[crossbow-discuss] Panic on incoming TCP requests on snv61 with XB 15 installed via Snapshot
Sure. We would love to get some serious exposure. The panics you were seeing were probably due to missing locking framework not done while create/modify/delete of NICs/VNICs/flows. This beta would would focus on functionality, stability and performance. Cheers, Sunay Siobhan P. Lynch wrote:> Nice, if you need help with the beta testing extensively under > "production" conditions, we''re using this in a pilot of our hardware > product (obviously I can''t give too much info without someone signing an > NDA), I''d love to work with you guys on providing feedback on the beta > release. > > Even the old beta works great on the boxes that it hasn''t panic''d on. > I''m still not 100% sure why some (ostensibly identical) boxes panic and > others don''t, however I''ll be doing some comparison of PCI ids and > outputs of prtconf and prtdiag outputs, to see if hardware is slightly > different on what SHOULD be the identical motherboard. > > -SPL > > -----Original Message----- > From: Sunay Tripathi [mailto:Sunay.Tripathi at sun.com] > Sent: Monday, January 28, 2008 4:54 PM > To: Siobhan P. Lynch > Cc: rajagopal.kunhappan at sun.com; crossbow-discuss at opensolaris.org > Subject: Re: [crossbow-discuss] Panic on incoming TCP requests on snv61 > with XB 15 installed via Snapshot > > I think that is the target. We are starting a extensive beta in a few > weeks. If that goes well, then the current target to merge in nevada > is late april/early may. We will be able to accurately predict this > after the beta is done. > > Cheers, > Sunay > > Siobhan P. Lynch wrote: >> What are the chances of this being merged into the main branch within > a >> few months? I''d love to be able to use a standard SXCE install for >> this... and then the bfu archives for security related upgrades. >> >> -SPL >> >> -----Original Message----- >> From: Rajagopal Kunhappan [mailto:rajagopal.kunhappan at sun.com] >> Sent: Monday, January 28, 2008 2:46 PM >> To: Siobhan P. Lynch >> Cc: crossbow-discuss at opensolaris.org >> Subject: Re: [crossbow-discuss] Panic on incoming TCP requests on > snv61 >> with XB 15 installed via Snapshot >> >> >> >> Siobhan Patricia Lynch wrote: >>> Hi all, I am having a major issue here, our product now relies upon >> vnics inside non-global zones as a way to solve a routing problem we >> encounter when using OpenVPN on a global zone. >>> Problem being, we have two machines working in the field just fine, >> but now I''m consistently getting panics on incoming TCP connects > (tried >> with ssh, telnet, and FTP ports): >>> panic[cpu0]/thread=d2be1de0: BAD TRAP: type=e (#pf Page fault) >> rp=d2be1ca4 addr=ec occurred in module "unix" due to a NULL pointer >> dereference >>> sched: #pf Page fault >>> Bad kernel fault at addr=0xec >>> pid=0, pc=0xfe832cbd, sp=0xf9259d00, eflags=0x10246 >>> cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: >> 6f8<xmme,fxsr,pge,mce,pae,pse,de> >>> cr2: ec cr3: 1f31000 >>> gs: d2be01b0 fs: d2be0000 es: 160 ds: d2be0160 >>> edi: 0 esi: ec ebp: d2be1d1c esp: d2be1cdc >>> ebx: 80 edx: d2be1de0 ecx: ec eax: 0 >>> trp: e err: 2 eip: fe832cbd cs: 158 >>> efl: 10246 usp: f9259d00 ss: ec >>> >>> d2be1bfc unix:die+98 (e, d2be1ca4, ec, 0) >>> d2be1c90 unix:trap+11c4 (d2be1ca4, ec, 0) >>> d2be1ca4 unix:_cmntrap+7c (d2be01b0, d2be0000,) >>> d2be1d1c unix:mutex_enter+d (80, 0, 0, 1) >>> d2be1d78 ip:squeue_drain+165 (d27b4e40, 2, 97215e) >>> d2be1dc8 ip:squeue_worker+1be (d27b4e40, 0) >>> d2be1dd8 unix:thread_start+8 () >>> >>> syncing file systems... done >>> >>> I haven''t started a full crash dump analysis, because I was hping >> maybe this is a known issue, and is fixed in a later version. >>> Also, which might be helpful, I''m using a GLDv3 bfe driver (v2.6.0a) >> that was compiled on another snv61-xb_15 machine (my laptop) >>> Also, where can I find sources to XB that I can build with nv78 or >> higher? I''m not thriolled in basing a security product off an older >> build, I don''t mind rolling a new archive to bfu with on these > machines, >> but all I really care about is a stable machine that allows TCP to > work >> normally. >>> >> We are working on releasing newer crossbow bits and sources based on >> nv79 either this week or next. So hopefully the panic is fixed in that > >> and your above security concern will be allayed. >> >> Thanks, >> -krgopi >>> -SPL >>> >>> >>> This message posted from opensolaris.org >>> _______________________________________________ >>> crossbow-discuss mailing list >>> crossbow-discuss at opensolaris.org >>> http://mail.opensolaris.org/mailman/listinfo/crossbow-discuss >>> >> _______________________________________________ >> crossbow-discuss mailing list >> crossbow-discuss at opensolaris.org >> http://mail.opensolaris.org/mailman/listinfo/crossbow-discuss > >-- Sunay Tripathi Distinguished Engineer Solaris Core Operating System Sun MicroSystems Inc. Solaris Networking: http://www.opensolaris.org/os/community/networking Project Crossbow: http://www.opensolaris.org/os/project/crossbow