Hi... I have a strange problem with my Private NIC Channel, here is my environment details : 1. RHAS 2.1 with kernel 2.4.9-e.27 Enterprise 2. OCFS version : 2.4.9-e-enterprise-1.0.9-6 3. Oracle RDBMS : 9.2.0.4 RAC with 5 Nodes 4. Private NIC Channel: Broadcom BCM5700 My Private NIC channel is down intermittently, we just tracing the root of the problems by identify each product installed the server, including OCFS. But there is no problem with my Public NIC Channel, which is having deferent made. My question is : From OCFS point of view is there any chance that OCFS is conflicting with the BCM5700 NIC? Thanks Jeram
no ocfs in particular in v1 hardly touches the network must be something else On Wed, Sep 29, 2004 at 08:31:52AM +0700, Jeram wrote:> > Hi... > > I have a strange problem with my Private NIC Channel, here is my environment > details : > 1. RHAS 2.1 with kernel 2.4.9-e.27 Enterprise > 2. OCFS version : 2.4.9-e-enterprise-1.0.9-6 > 3. Oracle RDBMS : 9.2.0.4 RAC with 5 Nodes > 4. Private NIC Channel: Broadcom BCM5700 > > My Private NIC channel is down intermittently, we just tracing the root of > the problems by identify each product installed the server, including OCFS. > But there is no problem with my Public NIC Channel, which is having deferent > made. > > My question is : From OCFS point of view is there any chance that OCFS is > conflicting with the BCM5700 NIC? > > Thanks > Jeram > _______________________________________________ > Ocfs-users mailing list > Ocfs-users@oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs-users
Hi Wim I got this link from Metalink: http://metalink.oracle.com/metalink/plsql/ml2_documents.showDocument?p_datab ase_id=FOR&p_id=483220.995 It's very close to our problem, can you advice? Rgds/Jeram -----Original Message----- From: Wim Coekaerts [mailto:wim.coekaerts@oracle.com] Sent: Wednesday, September 29, 2004 9:39 AM To: Jeram Cc: ocfs-users@oss.oracle.com Subject: Re: [Ocfs-users] OCFS and BCM5700 no ocfs in particular in v1 hardly touches the network must be something else On Wed, Sep 29, 2004 at 08:31:52AM +0700, Jeram wrote:> > Hi... > > I have a strange problem with my Private NIC Channel, here is myenvironment> details : > 1. RHAS 2.1 with kernel 2.4.9-e.27 Enterprise > 2. OCFS version : 2.4.9-e-enterprise-1.0.9-6 > 3. Oracle RDBMS : 9.2.0.4 RAC with 5 Nodes > 4. Private NIC Channel: Broadcom BCM5700 > > My Private NIC channel is down intermittently, we just tracing the root of > the problems by identify each product installed the server, includingOCFS.> But there is no problem with my Public NIC Channel, which is havingdeferent> made. > > My question is : From OCFS point of view is there any chance that OCFS is > conflicting with the BCM5700 NIC? > > Thanks > Jeram > _______________________________________________ > Ocfs-users mailing list > Ocfs-users@oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs-users
Based on our experience with an identical config, we determined the cause to be the actual cards themselves. While others seem to work ok with these, we had multiple issues. Our solution was to replace the Broadcoms with Intel NICs. HTH, Matt -----Original Message----- From: ocfs-users-bounces@oss.oracle.com [mailto:ocfs-users-bounces@oss.oracle.com]On Behalf Of Jeram Sent: Tuesday, September 28, 2004 9:32 PM To: ocfs-users@oss.oracle.com Subject: [Ocfs-users] OCFS and BCM5700 Hi... I have a strange problem with my Private NIC Channel, here is my environment details : 1. RHAS 2.1 with kernel 2.4.9-e.27 Enterprise 2. OCFS version : 2.4.9-e-enterprise-1.0.9-6 3. Oracle RDBMS : 9.2.0.4 RAC with 5 Nodes 4. Private NIC Channel: Broadcom BCM5700 My Private NIC channel is down intermittently, we just tracing the root of the problems by identify each product installed the server, including OCFS. But there is no problem with my Public NIC Channel, which is having deferent made. My question is : From OCFS point of view is there any chance that OCFS is conflicting with the BCM5700 NIC? Thanks Jeram _______________________________________________ Ocfs-users mailing list Ocfs-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs-users
If indeed that is your problem, i.e., you're using AQ's and having propagation issues, there's an internal Oracle note that addresses this, it involves an undocumented init param, don't recall off top of my head, but could possibly find it, or you could open a TAR. -Matt -----Original Message----- From: ocfs-users-bounces@oss.oracle.com [mailto:ocfs-users-bounces@oss.oracle.com]On Behalf Of Jeram Sent: Tuesday, September 28, 2004 10:45 PM To: Wim Coekaerts Cc: ocfs-users@oss.oracle.com Subject: RE: [Ocfs-users] OCFS and BCM5700 Hi Wim I got this link from Metalink: http://metalink.oracle.com/metalink/plsql/ml2_documents.showDocument?p_datab ase_id=FOR&p_id=483220.995 It's very close to our problem, can you advice? Rgds/Jeram -----Original Message----- From: Wim Coekaerts [mailto:wim.coekaerts@oracle.com] Sent: Wednesday, September 29, 2004 9:39 AM To: Jeram Cc: ocfs-users@oss.oracle.com Subject: Re: [Ocfs-users] OCFS and BCM5700 no ocfs in particular in v1 hardly touches the network must be something else On Wed, Sep 29, 2004 at 08:31:52AM +0700, Jeram wrote:> > Hi... > > I have a strange problem with my Private NIC Channel, here is myenvironment> details : > 1. RHAS 2.1 with kernel 2.4.9-e.27 Enterprise > 2. OCFS version : 2.4.9-e-enterprise-1.0.9-6 > 3. Oracle RDBMS : 9.2.0.4 RAC with 5 Nodes > 4. Private NIC Channel: Broadcom BCM5700 > > My Private NIC channel is down intermittently, we just tracing the root of > the problems by identify each product installed the server, includingOCFS.> But there is no problem with my Public NIC Channel, which is havingdeferent> made. > > My question is : From OCFS point of view is there any chance that OCFS is > conflicting with the BCM5700 NIC? > > Thanks > Jeram > _______________________________________________ > Ocfs-users mailing list > Ocfs-users@oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs-users_______________________________________________ Ocfs-users mailing list Ocfs-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs-users
We had similar experience (decided it was the NICs) but just changed from bcm modules to tg3 modules as our solution. j.> ---------- > From: Matt Daniels[SMTP:Matt.Daniels@priorityhealthcare.com] > Sent: Wednesday, September 29, 2004 8:32 AM > To: Jeram; ocfs-users@oss.oracle.com > Subject: RE: [Ocfs-users] OCFS and BCM5700 > > Based on our experience with an identical config, we determined > the cause to be the actual cards themselves. While others seem to > work ok with these, we had multiple issues. Our solution was to > replace the Broadcoms with Intel NICs. > > HTH, > Matt > > -----Original Message----- > From: ocfs-users-bounces@oss.oracle.com > [mailto:ocfs-users-bounces@oss.oracle.com]On Behalf Of Jeram > Sent: Tuesday, September 28, 2004 9:32 PM > To: ocfs-users@oss.oracle.com > Subject: [Ocfs-users] OCFS and BCM5700 > > > > Hi... > > I have a strange problem with my Private NIC Channel, here is my environment > details : > 1. RHAS 2.1 with kernel 2.4.9-e.27 Enterprise > 2. OCFS version : 2.4.9-e-enterprise-1.0.9-6 > 3. Oracle RDBMS : 9.2.0.4 RAC with 5 Nodes > 4. Private NIC Channel: Broadcom BCM5700 > > My Private NIC channel is down intermittently, we just tracing the root of > the problems by identify each product installed the server, including OCFS. > But there is no problem with my Public NIC Channel, which is having deferent > made. > > My question is : From OCFS point of view is there any chance that OCFS is > conflicting with the BCM5700 NIC? > > Thanks > Jeram > _______________________________________________ > Ocfs-users mailing list > Ocfs-users@oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs-users > > > _______________________________________________ > Ocfs-users mailing list > Ocfs-users@oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs-users >
As for the issue of ocfs conflicting with the NIC... no. BTW, upgrading from 1.0.9-6 to 1.0.13 is highly recommended. On Wed, 2004-09-29 at 07:55, Godfrey, Judy wrote:> We had similar experience (decided it was the NICs) but just changed from bcm modules to tg3 modules as our solution. > j. > > > ---------- > > From: Matt Daniels[SMTP:Matt.Daniels@priorityhealthcare.com] > > Sent: Wednesday, September 29, 2004 8:32 AM > > To: Jeram; ocfs-users@oss.oracle.com > > Subject: RE: [Ocfs-users] OCFS and BCM5700 > > > > Based on our experience with an identical config, we determined > > the cause to be the actual cards themselves. While others seem to > > work ok with these, we had multiple issues. Our solution was to > > replace the Broadcoms with Intel NICs. > > > > HTH, > > Matt > > > > -----Original Message----- > > From: ocfs-users-bounces@oss.oracle.com > > [mailto:ocfs-users-bounces@oss.oracle.com]On Behalf Of Jeram > > Sent: Tuesday, September 28, 2004 9:32 PM > > To: ocfs-users@oss.oracle.com > > Subject: [Ocfs-users] OCFS and BCM5700 > > > > > > > > Hi... > > > > I have a strange problem with my Private NIC Channel, here is my environment > > details : > > 1. RHAS 2.1 with kernel 2.4.9-e.27 Enterprise > > 2. OCFS version : 2.4.9-e-enterprise-1.0.9-6 > > 3. Oracle RDBMS : 9.2.0.4 RAC with 5 Nodes > > 4. Private NIC Channel: Broadcom BCM5700 > > > > My Private NIC channel is down intermittently, we just tracing the root of > > the problems by identify each product installed the server, including OCFS. > > But there is no problem with my Public NIC Channel, which is having deferent > > made. > > > > My question is : From OCFS point of view is there any chance that OCFS is > > conflicting with the BCM5700 NIC? > > > > Thanks > > Jeram > > _______________________________________________ > > Ocfs-users mailing list > > Ocfs-users@oss.oracle.com > > http://oss.oracle.com/mailman/listinfo/ocfs-users > > > > > > _______________________________________________ > > Ocfs-users mailing list > > Ocfs-users@oss.oracle.com > > http://oss.oracle.com/mailman/listinfo/ocfs-users > > > _______________________________________________ > Ocfs-users mailing list > Ocfs-users@oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs-users
FWIW (to throw my 2 cents out there), our Netware guys advised us before we started to avoid the broadcom NIC's so we have used Intel's from the start. Haven't had any problems yet with them. Like Wim said, though, ocfs itself hardly touches the NIC's. GSD hits them harder (if you're 9i or later, with Cache Fusion, and you're pulling data blocks over the interconnect). Jeremy>>> "Matt Daniels" <Matt.Daniels@priorityhealthcare.com> 09/29/20049:32:40 AM >>> Based on our experience with an identical config, we determined the cause to be the actual cards themselves. While others seem to work ok with these, we had multiple issues. Our solution was to replace the Broadcoms with Intel NICs. HTH, Matt -----Original Message----- From: ocfs-users-bounces@oss.oracle.com [mailto:ocfs-users-bounces@oss.oracle.com]On Behalf Of Jeram Sent: Tuesday, September 28, 2004 9:32 PM To: ocfs-users@oss.oracle.com Subject: [Ocfs-users] OCFS and BCM5700 Hi... I have a strange problem with my Private NIC Channel, here is my environment details : 1. RHAS 2.1 with kernel 2.4.9-e.27 Enterprise 2. OCFS version : 2.4.9-e-enterprise-1.0.9-6 3. Oracle RDBMS : 9.2.0.4 RAC with 5 Nodes 4. Private NIC Channel: Broadcom BCM5700 My Private NIC channel is down intermittently, we just tracing the root of the problems by identify each product installed the server, including OCFS. But there is no problem with my Public NIC Channel, which is having deferent made. My question is : From OCFS point of view is there any chance that OCFS is conflicting with the BCM5700 NIC? Thanks Jeram This message (including any attachments) contains confidential information intended for a specific individual(s) and purpose, and is protected by law. If you are not the intended recipient, you should delete this message. Any disclosure, copying, or distribution of this message, or the taking of any action based on it, by anyone other than the intended recipient(s), is strictly prohibited. <<<<...>>>>
Hi all... Thanks for your responses of my query. You all are correct, I have 2 NIC Broadcom and Intel made, the Broadcom one is giving problem. I applied the latest driver of Broadcom and upgrade the Linux kernel to 2.4.9-e.41 Enterprise, after 2 days testing, it looks OK... Thanks once again for your good response. Rgds/Jeram -----Original Message----- From: Jeremy Schneider [mailto:jer1887@asugroup.com] Sent: Thursday, September 30, 2004 10:49 PM To: jeram@jisedu.or.id; ocfs-users@oss.oracle.com; Matt.Daniels@priorityhealthcare.com Subject: RE: [Ocfs-users] OCFS and BCM5700 FWIW (to throw my 2 cents out there), our Netware guys advised us before we started to avoid the broadcom NIC's so we have used Intel's from the start. Haven't had any problems yet with them. Like Wim said, though, ocfs itself hardly touches the NIC's. GSD hits them harder (if you're 9i or later, with Cache Fusion, and you're pulling data blocks over the interconnect). Jeremy>>> "Matt Daniels" <Matt.Daniels@priorityhealthcare.com> 09/29/20049:32:40 AM >>> Based on our experience with an identical config, we determined the cause to be the actual cards themselves. While others seem to work ok with these, we had multiple issues. Our solution was to replace the Broadcoms with Intel NICs. HTH, Matt -----Original Message----- From: ocfs-users-bounces@oss.oracle.com [mailto:ocfs-users-bounces@oss.oracle.com]On Behalf Of Jeram Sent: Tuesday, September 28, 2004 9:32 PM To: ocfs-users@oss.oracle.com Subject: [Ocfs-users] OCFS and BCM5700 Hi... I have a strange problem with my Private NIC Channel, here is my environment details : 1. RHAS 2.1 with kernel 2.4.9-e.27 Enterprise 2. OCFS version : 2.4.9-e-enterprise-1.0.9-6 3. Oracle RDBMS : 9.2.0.4 RAC with 5 Nodes 4. Private NIC Channel: Broadcom BCM5700 My Private NIC channel is down intermittently, we just tracing the root of the problems by identify each product installed the server, including OCFS. But there is no problem with my Public NIC Channel, which is having deferent made. My question is : From OCFS point of view is there any chance that OCFS is conflicting with the BCM5700 NIC? Thanks Jeram This message (including any attachments) contains confidential information intended for a specific individual(s) and purpose, and is protected by law. If you are not the intended recipient, you should delete this message. Any disclosure, copying, or distribution of this message, or the taking of any action based on it, by anyone other than the intended recipient(s), is strictly prohibited. <<<<...>>>> _______________________________________________ Ocfs-users mailing list Ocfs-users@oss.oracle.com http://oss.oracle.com/mailman/listinfo/ocfs-users