We are currently using OCFS2 to host multiple Oracle 10g RAC databases on Itanium servers running Redhat AS 4.7, we are running this OCFS2 version so far with no issues ocfs2-2.6.9-78.0.13.EL-1.2.9-1.el4 We would like to use OCFS2 to host binaries files for the database and / or application. This will be 4 active nodes mounting an OCFS2 formatted LUN through iSCSI. What are the issues, caveats or things we need to be aware if we take this approach. Like, is there a limit on the number of files or directories hosted on OCFS2? Are there a performance issue / degradation in comparison with GFS hosting binaries files? What are the good, bad and ugly of OCFS2 in comparison with GFS hosting binaries files? Is OCFS2 certified by Oracle to run database/application binaries? Please advice what is your experience on this topic, it will be greatly appreciated. Saul -------------- next part -------------- An HTML attachment was scrubbed... URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20090609/5d0bc03e/attachment.html
Fahrenfort, Keith (HP Shared Solutions Architect for Oracle)
2009-Jun-09 20:00 UTC
[Ocfs2-users] OCFS2 hosting and running binaries
Hi Saul, I see Metalink note 236826.1 has the following that will answer one of the last questions: Unlike the previous release (OCFS), OCFS2 is a general-purpose file system that can be used for shared Oracle home installations making management of Oracle Real Application Cluster (RAC) installations even easier.. Hope this helps! Regards! ________________________________ Please let me know if you prefer to not receive email from me. <blocked::http://www.hp.com/> [cid:217484219 at 09062009-22C5]<http://www.hp.com/> <blocked::http://www.hp.com/> Keith Fahrenfort Solutions Architect - Hewlett Packard Solution Design Services for Oracle Shared Solutions Architecture HP Americas Solution Architecture keith.fahrenfort at hp.com<mailto:keith.fahrenfort at hp.com> Email ssa at hp.com<mailto:ssa at hp.com> to reach our Team http://www.hp.com/go/oracle For HP's privacy policy and contact information, please see http://welcome.hp.com/country/us/en/privacy.html ________________________________ ________________________________ From: ocfs2-users-bounces at oss.oracle.com [mailto:ocfs2-users-bounces at oss.oracle.com] On Behalf Of Saul Gabay Sent: Tuesday, June 09, 2009 2:09 PM To: ocfs2-users at oss.oracle.com Cc: Server Ops_Linux Subject: [Ocfs2-users] OCFS2 hosting and running binaries We are currently using OCFS2 to host multiple Oracle 10g RAC databases on Itanium servers running Redhat AS 4.7, we are running this OCFS2 version so far with no issues ocfs2-2.6.9-78.0.13.EL-1.2.9-1.el4 We would like to use OCFS2 to host binaries files for the database and / or application. This will be 4 active nodes mounting an OCFS2 formatted LUN through iSCSI. What are the issues, caveats or things we need to be aware if we take this approach. Like, is there a limit on the number of files or directories hosted on OCFS2? Are there a performance issue / degradation in comparison with GFS hosting binaries files? What are the good, bad and ugly of OCFS2 in comparison with GFS hosting binaries files? Is OCFS2 certified by Oracle to run database/application binaries? Please advice what is your experience on this topic, it will be greatly appreciated. Saul -------------- next part -------------- An HTML attachment was scrubbed... URL: http://oss.oracle.com/pipermail/ocfs2-users/attachments/20090609/6fe4a371/attachment-0001.html -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.gif Type: image/gif Size: 39567 bytes Desc: image001.gif Url : http://oss.oracle.com/pipermail/ocfs2-users/attachments/20090609/6fe4a371/attachment-0001.gif
Sure. One can use ocfs2 to host almost anything. The one exception is the crs_home. crs_home needs to be on a local volume. OCFS 1.2/1.4 has two limits. Like ext3, the number of sub-directories in _a_ directory cannot exceed 32000. (There is no limit to the number of subdirs in a volume.) The other limit is the volume size. Currently max is 16T. There is no limit to the number of files in a volume. (The two limits have been relaxed in mainline for few kernel versions.) As far as performance goes, I have yet to see a benchmark that shows ocfs2 slower than gfs/gfs2. For certification, please check metalink. Sunil Saul Gabay wrote:> > We are currently using OCFS2 to host multiple Oracle 10g RAC databases > on Itanium servers running Redhat AS 4.7, we are running this OCFS2 > version so far with no issues > > > > ocfs2-2.6.9-78.0.13.EL-1.2.9-1.el4 > > > > We would like to use OCFS2 to host binaries files for the database and > / or application. > > > > This will be 4 active nodes mounting an OCFS2 formatted LUN through iSCSI. > > > > What are the issues, caveats or things we need to be aware if we take > this approach. > > > > Like, is there a limit on the number of files or directories hosted on > OCFS2? > > > > Are there a performance issue / degradation in comparison with GFS > hosting binaries files? > > > > What are the good, bad and ugly of OCFS2 in comparison with GFS > hosting binaries files? > > > > Is OCFS2 certified by Oracle to run database/application binaries? > > > > Please advice what is your experience on this topic, it will be > greatly appreciated. > > /*/ /*/ > > /*/Saul/*/ >
Saul, OCFS2 1.2 doesnt has support for indexed directories. So you will need to have a cleaning procedure for the database dump directories to keep the quantity of log files reasonable. Unless you dont mind a "ls" hanging when you try to find a trace. I am not sure if OCFS 1. has support for indexed directories on the enterprise tree. Also when sharing database binaries there is a need to use a special type of file that is different on each node for certain configuration files . The OCFS2 1.2 "enterprise" has support for this. This was necessary on 10g, not sure about 11g. There are some files that need to be outside of OCFS2 1.2 so you will need to create some symlinks for each database too. And the mount options for database files and binaries/traces are different, so you will need to plan your filesystems in a way to keep datafiles, logfiles, archivelogs separated from your binaries and trace/dump locations. One important point is that when you do this you will be unable to do a rolling patch application. Depending on your availability requirements this could be important. Also you introduce a single point of failure. If someone accidentaly damage or delete a important database or configuration file the entire cluster will fail. When you have non-shared binaries filesystems one would expect the other nodes to continue operating if this happens. Regards, Luis --- On Tue, 6/9/09, Sunil Mushran <sunil.mushran at oracle.com> wrote:> From: Sunil Mushran <sunil.mushran at oracle.com> > Subject: Re: [Ocfs2-users] OCFS2 hosting and running binaries > To: "Saul Gabay" <SaulG at herbalife.com> > Cc: "Server Ops_Linux" <ServerOps_Linux at herbalife.com>, ocfs2-users at oss.oracle.com > Date: Tuesday, June 9, 2009, 5:20 PM > Sure. One can use ocfs2 to host > almost anything. The one exception > is the crs_home. crs_home needs to be on a local volume. > > OCFS 1.2/1.4 has two limits. Like ext3, the number of > sub-directories in _a_ > directory cannot exceed 32000. (There is no limit to the > number of subdirs > in a volume.) The other limit is the volume size. Currently > max is 16T. > There is no limit to the number of files in a volume. (The > two limits have > been relaxed in mainline for few kernel versions.) > > As far as performance goes, I have yet to see a benchmark > that shows ocfs2 > slower than gfs/gfs2. > > For certification, please check metalink. > > Sunil > > Saul Gabay wrote: > > > > We are currently using OCFS2 to host multiple Oracle > 10g RAC databases > > on Itanium servers running Redhat AS 4.7, we are > running this OCFS2 > > version so far with no issues > > > >? > > > > ocfs2-2.6.9-78.0.13.EL-1.2.9-1.el4 > > > >? > > > > We would like to use OCFS2 to host binaries files for > the database and > > / or application. > > > >? > > > > This will be 4 active nodes mounting an OCFS2 > formatted LUN through iSCSI. > > > >? > > > > What are the issues, caveats or things we need to be > aware if we take > > this approach. > > > >? > > > > Like, is there a limit on the number of files or > directories hosted on > > OCFS2? > > > >? > > > > Are there a performance issue / degradation in > comparison with GFS > > hosting binaries files? > > > >? > > > > What are the good, bad and ugly of OCFS2 in comparison > with GFS > > hosting binaries files? > > > >? > > > > Is OCFS2 certified by Oracle to run > database/application binaries? > > > >? > > > > Please advice what is your experience on this topic, > it will be > > greatly appreciated. > > > > /*/ /*/ > > > > /*/Saul/*/ > > > > > _______________________________________________ > Ocfs2-users mailing list > Ocfs2-users at oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs2-users >
Yes, we already have OCFS2 running for the datafiles, logfiles, archivelogs separated from your binaries. We are running separate ext3 for the binaries on each server. We want to switch from EXT3 and run OCFS2 for the shared binaries. We plan to separate the dump and log location outside of the OCFS2 volume to the local EXT3 partition / drive on the server to avoid the unnecessary high number file count and added I/O. Saul -----Original Message----- From: Luis Freitas [mailto:lfreitas34 at yahoo.com] Sent: Tuesday, June 09, 2009 2:34 PM To: ocfs2-users at oss.oracle.com Cc: Saul Gabay Subject: Re: [Ocfs2-users] OCFS2 hosting and running binaries Saul, OCFS2 1.2 doesnt has support for indexed directories. So you will need to have a cleaning procedure for the database dump directories to keep the quantity of log files reasonable. Unless you dont mind a "ls" hanging when you try to find a trace. I am not sure if OCFS 1. has support for indexed directories on the enterprise tree. Also when sharing database binaries there is a need to use a special type of file that is different on each node for certain configuration files . The OCFS2 1.2 "enterprise" has support for this. This was necessary on 10g, not sure about 11g. There are some files that need to be outside of OCFS2 1.2 so you will need to create some symlinks for each database too. And the mount options for database files and binaries/traces are different, so you will need to plan your filesystems in a way to keep datafiles, logfiles, archivelogs separated from your binaries and trace/dump locations. One important point is that when you do this you will be unable to do a rolling patch application. Depending on your availability requirements this could be important. Also you introduce a single point of failure. If someone accidentaly damage or delete a important database or configuration file the entire cluster will fail. When you have non-shared binaries filesystems one would expect the other nodes to continue operating if this happens. Regards, Luis --- On Tue, 6/9/09, Sunil Mushran <sunil.mushran at oracle.com> wrote:> From: Sunil Mushran <sunil.mushran at oracle.com> > Subject: Re: [Ocfs2-users] OCFS2 hosting and running binaries > To: "Saul Gabay" <SaulG at herbalife.com> > Cc: "Server Ops_Linux" <ServerOps_Linux at herbalife.com>, ocfs2-users at oss.oracle.com > Date: Tuesday, June 9, 2009, 5:20 PM > Sure. One can use ocfs2 to host > almost anything. The one exception > is the crs_home. crs_home needs to be on a local volume. > > OCFS 1.2/1.4 has two limits. Like ext3, the number of > sub-directories in _a_ > directory cannot exceed 32000. (There is no limit to the > number of subdirs > in a volume.) The other limit is the volume size. Currently > max is 16T. > There is no limit to the number of files in a volume. (The > two limits have > been relaxed in mainline for few kernel versions.) > > As far as performance goes, I have yet to see a benchmark > that shows ocfs2 > slower than gfs/gfs2. > > For certification, please check metalink. > > Sunil > > Saul Gabay wrote: > > > > We are currently using OCFS2 to host multiple Oracle > 10g RAC databases > > on Itanium servers running Redhat AS 4.7, we are > running this OCFS2 > > version so far with no issues > > > >? > > > > ocfs2-2.6.9-78.0.13.EL-1.2.9-1.el4 > > > >? > > > > We would like to use OCFS2 to host binaries files for > the database and > > / or application. > > > >? > > > > This will be 4 active nodes mounting an OCFS2 > formatted LUN through iSCSI. > > > >? > > > > What are the issues, caveats or things we need to be > aware if we take > > this approach. > > > >? > > > > Like, is there a limit on the number of files or > directories hosted on > > OCFS2? > > > >? > > > > Are there a performance issue / degradation in > comparison with GFS > > hosting binaries files? > > > >? > > > > What are the good, bad and ugly of OCFS2 in comparison > with GFS > > hosting binaries files? > > > >? > > > > Is OCFS2 certified by Oracle to run > database/application binaries? > > > >? > > > > Please advice what is your experience on this topic, > it will be > > greatly appreciated. > > > > /*/ /*/ > > > > /*/Saul/*/ > > > > > _______________________________________________ > Ocfs2-users mailing list > Ocfs2-users at oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs2-users >
Really good information on this topic, thank you all! Besides Oracle RAC, do you see a problem on running this OCFS2 shared LUN for Oracle EBS? Thank you Saul -----Original Message----- From: Saul Gabay Sent: Tuesday, June 09, 2009 3:00 PM To: Luis Freitas; ocfs2-users at oss.oracle.com Cc: Server Ops_Linux Subject: RE: [Ocfs2-users] OCFS2 hosting and running binaries Yes, we already have OCFS2 running for the datafiles, logfiles, archivelogs separated from your binaries. We are running separate ext3 for the binaries on each server. We want to switch from EXT3 and run OCFS2 for the shared binaries. We plan to separate the dump and log location outside of the OCFS2 volume to the local EXT3 partition / drive on the server to avoid the unnecessary high number file count and added I/O. Saul -----Original Message----- From: Luis Freitas [mailto:lfreitas34 at yahoo.com] Sent: Tuesday, June 09, 2009 2:34 PM To: ocfs2-users at oss.oracle.com Cc: Saul Gabay Subject: Re: [Ocfs2-users] OCFS2 hosting and running binaries Saul, OCFS2 1.2 doesnt has support for indexed directories. So you will need to have a cleaning procedure for the database dump directories to keep the quantity of log files reasonable. Unless you dont mind a "ls" hanging when you try to find a trace. I am not sure if OCFS 1. has support for indexed directories on the enterprise tree. Also when sharing database binaries there is a need to use a special type of file that is different on each node for certain configuration files . The OCFS2 1.2 "enterprise" has support for this. This was necessary on 10g, not sure about 11g. There are some files that need to be outside of OCFS2 1.2 so you will need to create some symlinks for each database too. And the mount options for database files and binaries/traces are different, so you will need to plan your filesystems in a way to keep datafiles, logfiles, archivelogs separated from your binaries and trace/dump locations. One important point is that when you do this you will be unable to do a rolling patch application. Depending on your availability requirements this could be important. Also you introduce a single point of failure. If someone accidentaly damage or delete a important database or configuration file the entire cluster will fail. When you have non-shared binaries filesystems one would expect the other nodes to continue operating if this happens. Regards, Luis --- On Tue, 6/9/09, Sunil Mushran <sunil.mushran at oracle.com> wrote:> From: Sunil Mushran <sunil.mushran at oracle.com> > Subject: Re: [Ocfs2-users] OCFS2 hosting and running binaries > To: "Saul Gabay" <SaulG at herbalife.com> > Cc: "Server Ops_Linux" <ServerOps_Linux at herbalife.com>, ocfs2-users at oss.oracle.com > Date: Tuesday, June 9, 2009, 5:20 PM > Sure. One can use ocfs2 to host > almost anything. The one exception > is the crs_home. crs_home needs to be on a local volume. > > OCFS 1.2/1.4 has two limits. Like ext3, the number of > sub-directories in _a_ > directory cannot exceed 32000. (There is no limit to the > number of subdirs > in a volume.) The other limit is the volume size. Currently > max is 16T. > There is no limit to the number of files in a volume. (The > two limits have > been relaxed in mainline for few kernel versions.) > > As far as performance goes, I have yet to see a benchmark > that shows ocfs2 > slower than gfs/gfs2. > > For certification, please check metalink. > > Sunil > > Saul Gabay wrote: > > > > We are currently using OCFS2 to host multiple Oracle > 10g RAC databases > > on Itanium servers running Redhat AS 4.7, we are > running this OCFS2 > > version so far with no issues > > > >? > > > > ocfs2-2.6.9-78.0.13.EL-1.2.9-1.el4 > > > >? > > > > We would like to use OCFS2 to host binaries files for > the database and > > / or application. > > > >? > > > > This will be 4 active nodes mounting an OCFS2 > formatted LUN through iSCSI. > > > >? > > > > What are the issues, caveats or things we need to be > aware if we take > > this approach. > > > >? > > > > Like, is there a limit on the number of files or > directories hosted on > > OCFS2? > > > >? > > > > Are there a performance issue / degradation in > comparison with GFS > > hosting binaries files? > > > >? > > > > What are the good, bad and ugly of OCFS2 in comparison > with GFS > > hosting binaries files? > > > >? > > > > Is OCFS2 certified by Oracle to run > database/application binaries? > > > >? > > > > Please advice what is your experience on this topic, > it will be > > greatly appreciated. > > > > /*/ /*/ > > > > /*/Saul/*/ > > > > > _______________________________________________ > Ocfs2-users mailing list > Ocfs2-users at oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs2-users >