ORACLE RAC如何增加节点

ORACLE RAC系统是一个可以横向进行扩展的系统，当一个RAC系统计算能力不满足客户的需求时候，增加节点能够快速增加整个系统的计算能力，使得客户系统计算能力得到一定的提升，以满足客户不断增长的计算需求。

在ORACLE RAC系统中，软件提供了很好的，也是很方便的升级方法，对系统管理员和DBA来说，扩展是轻而易举的，本文主要讲解如何为RAC系统增加节点，包括clusterware系统的扩展，和数据库instance的扩展。
亦可以参考我的豆丁文档：

一、        增加节点的准备工作

俗话说，磨刀不误砍柴工，在RAC安装和增加节点过程中，该俗语充分体现了准备工作的重要性。硬件初始化主要包括服务器的安装、存储的连接、网络连接等步骤。本文所基于的基本环境如下：

1.         原有节点分别为cluster1和cluster2

2.         软件环境如下：

操作系统：solaris 10 u11

数据库软件：ORACLE Database 11g

OS用户： grid用户用于管理clusterware，oracle用户用于数据库

3.         IP地址具体规划如下：

192.168.0.12    cluster1  

192.168.0.13    cluster2

192.168.0.14    cluster1-vip

192.168.0.16    cluster2-vip   

192.168.0.15    cluster1-priv

192.168.0.17    cluster2-priv

192.168.0.19    scan-ip

4.         新节点环境规划：

操作系统和database软件必须采用原有节点一个版本的软件

创建grid和oracle用户，具体创建步骤参考下节内容

              IP地址设置为：

              192.168.0.18  cluster3

              192.168.0.20  cluster3-vip

              192.168.0.21  cluster-priv

u  主机系统环境的设置

1.  创建用户

 groupadd -g 1000 oinstall

 groupadd -g 1001 dba

 useradd -u 1100 -g dba -G oinstall -d /export/home/grid -m grid

 useradd -u 1101 -g dba -G oinstall -d /export/home/oracle -m oracle

2.设置password

passwd grid

passwd oracle

3.创建相应的目录

mkdir -p /oracle/app/grid

mkdir -p /oracle/app/11g

chown -R grid:dba /oracle/app/grid

chmod -R 775 /oracle/app/grid

mkdir -p ORACLE_BASE=/oracle/app/oracle

mkdir -p /oracle/app/oracle/product/11.2.0/dbhome_1

chown –R oracle:dba /oracle/app/oracle

4. grid user用的.profile文件

ORACLE_BASE=/oracle/app/grid; export ORACLE_BASE

ORACLE_HOME=/oracle/app/11g; export ORACLE_HOME

JAVA_HOME=$ORACLE_HOME/jdk; export JAVA_HOME

#ORACLE_PATH=/oracle/app/oracle/11g/common/oracle/sql; export ORACLE_PATH

ORACLE_SID=+ASM4; export ORACLE_SID

ORACLE_TERM=xterm; export ORACLE_TERM

NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS"; export NLS_DATE_FORMAT

TNS_ADMIN=$ORACLE_HOME/network/admin; export TNS_ADMIN

ORA_NLS11=$ORACLE_HOME/nls/data; export ORA_NLS11

PATH=$PATH:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin:$JAVA_HOME/bin:$HOME/bin:$ORACLE_HOME/bin; export PATH

LD_LIBRARY_PATH=$ORACLE_HOME/lib:$ORACLE_HOME/oracm/lib:/lib:/usr/lib:/usr/local/lib

export LD_LIBRARY_PATH

CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib:$ORACLE_HOME/network/jlib; export CLASSPATH

NLS_LANG=American_america.zhs16gbk; export NLS_LANG

THREADS_FLAG=native; export THREADS_FLAG

TEMP=/tmp; export TEMP

TMPDIR=/tmp; export TMPDIR

# UMASK

umask 022

5. oracle用户的.profile文件

ORACLE_BASE=/oracle/app/oracle; export ORACLE_BASE

ORACLE_HOME=$ORACLE_BASE/product/11.2.0/dbhome_1; export ORACLE_HOME

JAVA_HOME=$ORACLE_HOME/jdk; export JAVA_HOME

#ORACLE_PATH=/oracle/app/common/oracle/sql; export ORACLE_PATH

ORACLE_TERM=xterm; export ORACLE_TERM

ORACLE_SID=yxjb4; export ORACLE_SID

ORACLE_UNQNAME=yxjb; export ORACLE_UNQNAME

NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS"; export NLS_DATE_FORMAT

TNS_ADMIN=$ORACLE_HOME/network/admin; export TNS_ADMIN

ORA_NLS11=$ORACLE_HOME/nls/data; export ORA_NLS11

PATH=$PATH:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin:$JAVA_HOME/bin:$HOME/bin:$ORACLE_HOME/bin; export PATH

LD_LIBRARY_PATH=$ORACLE_HOME/lib:$ORACLE_HOME/oracm/lib:/lib:/usr/lib:/usr/local/lib

export LD_LIBRARY_PATH

CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib:$ORACLE_HOME/network/jlib; export CLASSPATH

NLS_LANG=American_america.zhs16gbk; export NLS_LANG

THREADS_FLAG=native; export THREADS_FLAG

TEMP=/tmp; export TEMP

TMPDIR=/tmp; export TMPDIR

# UMASK

umask 022

6. 修改UDP-TCP的kernel参数

vi /etc/rc3.d/S99NddUDPTCP

#!/bin/sh

/usr/sbin/ndd -set /dev/tcp tcp_smallest_anon_port 9000

/usr/sbin/ndd -set /dev/tcp tcp_largest_anon_port 65500

/usr/sbin/ndd -set /dev/udp udp_smallest_anon_port 9000

/usr/sbin/ndd -set /dev/udp udp_largest_anon_port 65500 1.创建用户

chmod +x /etc/rc3.d/S99NddUDPTCP

6.设置主机的存储

根据具体存储进行设置，将原有ASM使用的磁盘在新节点上更改器属性，OCR的盘更改为grid：oinstall，数据盘更改为oracle：dba，这些盘都这对raw设备进行属性更改，读写属性都修改为660。

7.建立grid,oracle用户的ssh信任关系

具体如何建立ssh信任关系可以参考我的豆丁文档：

二、        增加节点具体步骤：

准备工作完成后，就可以根据新环境将新节点增加到RAC系统了，RAC增加节点总共分为三步进行，第一步就是将clusterware软件系统进行扩展，将所有11g的clusterware软件添加到新节点，第二步就是将ORACLE数据库的软件扩展到新节点，最后一步就是使用dbca创建新节点的数据库实例instance。

1.         Clusterware软件扩展

软件的扩展就是在新节点上进行CRS软件的安装，此处无需使用原有的软件包来进行runInstaller的安装，只需要在现有的节点上执行脚本即可完成。

 CRS软件的安装用户必须使用grid user，在10g里面还需要将CRS软件的home目录属性修改为grid的，使用完成后，在修改成root用户的。

       以下为执行脚本的具体命令格式：

/oracle/app/11g/oui/bin/addNode.sh -silent "CLUSTER_NEW_NODES={cluster3}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={cluster3-vip}"

       命令里面只需要将两个option的值改成新节点主机就可以直接执行了，具体的过程可以参考文档后面的附件一。

       根据提示执行root.sh脚本将新节点加入到CRS中去，执行完成后就可以使用crs_stat –t命令查看新节点的crs状态了，root.sh脚本执行情况查阅文档后面的附件二。

2.         ORACLE数据库软件的扩展

使用oracle用户登录，执行以下脚本，该脚本能够将RAC群集节点上正常节点上的所有软件包远程拷贝到新节点上，无需做其他任何多余操作。

$  /oracle/app/oracle/product/11.2.0/dbhome_1/oui/bin/addNode.sh

该脚本运行过程可查阅附件三。

3.         DBCA创建cluster实例

当CRS和ORACLE数据库软件扩展到新节点后，crs_stat –t 显示三个节点都正常后，就可以直接使用dbca来创建第三个节点上的数据库实例了，这步骤就比较简单了，但需要注意的时候，dbca图形界面启动后，一定要选择 instance manager，后面选择add instance，后面就是next即可。

附件一：

/oracle/app/11g/oui/bin/addNode.sh -silent "CLUSTER_NEW_NODES={cluster3}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={cluster3-vip}"

Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 10217 MB    Passed

Oracle Universal Installer, Version 11.2.0.1.0 Production

Copyright (C) 1999, 2009, Oracle. All rights reserved.

Performing tests to see whether nodes cluster2,cluster3 are available

............................................................... 100% Done.

Cluster Node Addition Summary

Global Settings

   Source: /oracle/app/11g

   New Nodes

Space Requirements

   New Nodes

      cluster3

         /: Required 4.33GB : Available 7.51GB

Installed Products

   Product Names

      Oracle Grid Infrastructure 11.2.0.1.0

      Sun JDK 1.5.0.17.0

      Installer SDK Component 11.2.0.1.0

      Oracle One-Off Patch Installer 11.2.0.0.2

      Oracle Universal Installer 11.2.0.1.0

      Oracle Configuration Manager Deconfiguration 10.3.1.0.0

      Enterprise Manager Common Core Files 10.2.0.4.2

      Oracle DBCA Deconfiguration 11.2.0.1.0

      Oracle RAC Deconfiguration 11.2.0.1.0

      Oracle Quality of Service Management (Server) 11.2.0.1.0

      Installation Plugin Files 11.2.0.1.0

      Universal Storage Manager Files 11.2.0.1.0

      Oracle Text Required Support Files 11.2.0.1.0

      Automatic Storage Management Assistant 11.2.0.1.0

      Oracle Database 11g Multimedia Files 11.2.0.1.0

      Oracle Multimedia Java Advanced Imaging 11.2.0.1.0

      Oracle Globalization Support 11.2.0.1.0

      Oracle Multimedia Locator RDBMS Files 11.2.0.1.0

      Oracle Core Required Support Files 11.2.0.1.0

      Bali Share 1.1.18.0.0

      Oracle Database Deconfiguration 11.2.0.1.0

      Oracle Quality of Service Management (Client) 11.2.0.1.0

      Expat libraries 2.0.1.0.1

      Oracle Containers for Java 11.2.0.1.0

      Perl Modules 5.10.0.0.1

      Secure Socket Layer 11.2.0.1.0

      Oracle JDBC/OCI Instant Client 11.2.0.1.0

      Oracle Multimedia Client Option 11.2.0.1.0

      LDAP Required Support Files 11.2.0.1.0

      Character Set Migration Utility 11.2.0.1.0

      Perl Interpreter 5.10.0.0.1

      PL/SQL Embedded Gateway 11.2.0.1.0

      OLAP SQL Scripts 11.2.0.1.0

      Database SQL Scripts 11.2.0.1.0

      Oracle Extended Windowing Toolkit 3.4.47.0.0

      SSL Required Support Files for InstantClient 11.2.0.1.0

      SQL*Plus Files for Instant Client 11.2.0.1.0

      Oracle Net Required Support Files 11.2.0.1.0

      Oracle Database User Interface 2.2.13.0.0

      RDBMS Required Support Files for Instant Client 11.2.0.1.0

      Enterprise Manager Minimal Integration 11.2.0.1.0

      XML Parser for Java 11.2.0.1.0

      Oracle Security Developer Tools 11.2.0.1.0

      Oracle Wallet Manager 11.2.0.1.0

      Enterprise Manager plugin Common Files 11.2.0.1.0

      Platform Required Support Files 11.2.0.1.0

      Oracle JFC Extended Windowing Toolkit 4.2.36.0.0

      RDBMS Required Support Files 11.2.0.1.0

      Oracle Ice Browser 5.2.3.6.0

      Oracle Help For Java 4.2.9.0.0

      Enterprise Manager Common Files 10.2.0.4.2

      Deinstallation Tool 11.2.0.1.0

      Oracle Java Client 11.2.0.1.0

      Cluster Verification Utility Files 11.2.0.1.0

      Oracle Notification Service (eONS) 11.2.0.1.0

      Oracle LDAP administration 11.2.0.1.0

      Cluster Verification Utility Common Files 11.2.0.1.0

      Oracle Clusterware RDBMS Files 11.2.0.1.0

      Oracle Locale Builder 11.2.0.1.0

      Oracle Globalization Support 11.2.0.1.0

      Buildtools Common Files 11.2.0.1.0

      Oracle RAC Required Support Files-HAS 11.2.0.1.0

      SQL*Plus Required Support Files 11.2.0.1.0

      XDK Required Support Files 11.2.0.1.0

      Agent Required Support Files 10.2.0.4.2

      Parser Generator Required Support Files 11.2.0.1.0

      Precompiler Required Support Files 11.2.0.1.0

      Installation Common Files 11.2.0.1.0

      Required Support Files 11.2.0.1.0

      Oracle JDBC/THIN Interfaces 11.2.0.1.0

      Oracle Multimedia Locator 11.2.0.1.0

      Oracle Multimedia 11.2.0.1.0

      HAS Common Files 11.2.0.1.0

      Assistant Common Files 11.2.0.1.0

      PL/SQL 11.2.0.1.0

      HAS Files for DB 11.2.0.1.0

      Oracle Recovery Manager 11.2.0.1.0

      Oracle Database Utilities 11.2.0.1.0

      Oracle Notification Service 11.2.0.0.0

      SQL*Plus 11.2.0.1.0

      Oracle Netca Client 11.2.0.1.0

      Oracle Net 11.2.0.1.0

      Oracle JVM 11.2.0.1.0

      Oracle Internet Directory Client 11.2.0.1.0

      Oracle Net Listener 11.2.0.1.0

      Cluster Ready Services Files 11.2.0.1.0

      Oracle Database 11g 11.2.0.1.0

-----------------------------------------------------------------------------

Instantiating scripts for add node (Thursday, May 23, 2013 10:29:18 PM CST)

.                                                                 1% Done.

Instantiation of add node scripts complete

Copying to remote nodes (Thursday, May 23, 2013 10:29:34 PM CST)

...............................................................................................                                 96% Done.

Home copied to new nodes

Saving inventory on nodes (Thursday, May 23, 2013 10:47:19 PM CST)

.                                                               100% Done.

Save inventory complete

WARNING:A new inventory has been created on one or more nodes in this session. However, it has not yet been registered as the central inventory of this system.

To register the new inventory please run the script at '/oracle/app/grid/oraInventory/orainstRoot.sh' with root privileges on nodes 'cluster3'.

If you do not register the inventory, you may not be able to update or patch the products you installed.

The following configuration scripts need to be executed as the "root" user in each cluster node.

/oracle/app/grid/oraInventory/orainstRoot.sh #On nodes cluster3

/oracle/app/11g/root.sh #On nodes cluster3

To execute the configuration scripts:

    1. Open a terminal window

    2. Log in as "root"

    3. Run the scripts in each cluster node

   

The Cluster Node Addition of /oracle/app/11g was successful.

Please check '/tmp/silentInstall.log' for more details.

附件二  root.sh:

/oracle/app/11g/root.sh

Running Oracle 11g root.sh script...

The following environment variables are set as:

    ORACLE_OWNER= grid

    ORACLE_HOME=  /oracle/app/11g

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The file "dbhome" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]: y

   Copying dbhome to /usr/local/bin ...

The file "oraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]: y

   Copying oraenv to /usr/local/bin ...

The file "coraenv" already exists in /usr/local/bin.  Overwrite it? (y/n) [n]: y

   Copying coraenv to /usr/local/bin ...

Entries will be added to the /var/opt/oracle/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root.sh script.

Now product-specific root actions will be performed.

2013-05-24 01:34:05: Parsing the host name

2013-05-24 01:34:05: Checking for super user privileges

2013-05-24 01:34:05: User has super user privileges

Using configuration parameter file: /oracle/app/11g/crs/install/crsconfig_params

Creating trace directory

LOCAL ADD MODE

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

Adding daemon to inittab

May 24 01:33:26 cluster3 last message repeated 1 time

May 24 01:34:33 cluster3 root: exec /oracle/app/11g/perl/bin/perl -I/oracle/app/11g/perl/lib /oracle/app/11g/bin/crswrapexece.pl /oracle/app/11g/crs/install/s_crsconfig_cluster3_env.txt /oracle/app/11g/bin/ohasd.bin "reboot"

CRS-4123: Oracle High Availability Services has been started.

ohasd is starting

May 24 01:35:48 cluster3 mDNSResponder (Engineering Build) (Nov  2 2009 05:02:07) [1740]: starting

May 24 01:35:49 cluster3 mDNSResponder: Oracle mDNSResponder starting

May 24 01:35:49 cluster3 mDNSResponder: mdnsd found interface name=lo0 AF=2

May 24 01:35:49 cluster3 mDNSResponder: mdnsd found interface name=vnet0 AF=2

May 24 01:35:49 cluster3 mDNSResponder: mdnsd found interface name=vnet1 AF=2

May 24 01:35:49 cluster3 mDNSResponder: Unable to parse DNS server list. Unicast DNS-SD unavailable

May 24 01:36:37 cluster3 mDNSResponder: clsdm requested mdnsd exit

May 24 01:36:37 cluster3 mDNSResponder: mdnsd exit

May 24 01:36:37 cluster3 mDNSResponder (Engineering Build) (Nov  2 2009 05:02:07) [1740]: stopping

CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node cluster2, number 1, and is terminating

CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'cluster3'

CRS-2677: Stop of 'ora.cssdmonitor' on 'cluster3' succeeded

An active cluster was found during exclusive startup, restarting to join the cluster

CRS-2672: Attempting to start 'ora.mdnsd' on 'cluster3'

May 24 01:36:47 cluster3 mDNSResponder (Engineering Build) (Nov  2 2009 05:02:07) [1881]: starting

May 24 01:36:48 cluster3 mDNSResponder: Oracle mDNSResponder starting

May 24 01:36:48 cluster3 mDNSResponder: mdnsd found interface name=lo0 AF=2

May 24 01:36:48 cluster3 mDNSResponder: mdnsd found interface name=vnet0 AF=2

May 24 01:36:48 cluster3 mDNSResponder: mdnsd found interface name=vnet1 AF=2

May 24 01:36:48 cluster3 mDNSResponder: Unable to parse DNS server list. Unicast DNS-SD unavailable

CRS-2676: Start of 'ora.mdnsd' on 'cluster3' succeeded

CRS-2672: Attempting to start 'ora.gipcd' on 'cluster3'

CRS-2676: Start of 'ora.gipcd' on 'cluster3' succeeded

CRS-2672: Attempting to start 'ora.gpnpd' on 'cluster3'

CRS-2676: Start of 'ora.gpnpd' on 'cluster3' succeeded

CRS-2672: Attempting to start 'ora.cssdmonitor' on 'cluster3'

CRS-2676: Start of 'ora.cssdmonitor' on 'cluster3' succeeded

CRS-2672: Attempting to start 'ora.cssd' on 'cluster3'

CRS-2672: Attempting to start 'ora.diskmon' on 'cluster3'

CRS-2676: Start of 'ora.diskmon' on 'cluster3' succeeded

CRS-2676: Start of 'ora.cssd' on 'cluster3' succeeded

CRS-2672: Attempting to start 'ora.ctssd' on 'cluster3'

CRS-2676: Start of 'ora.ctssd' on 'cluster3' succeeded

CRS-2672: Attempting to start 'ora.asm' on 'cluster3'

CRS-2676: Start of 'ora.asm' on 'cluster3' succeeded

CRS-2672: Attempting to start 'ora.crsd' on 'cluster3'

CRS-2676: Start of 'ora.crsd' on 'cluster3' succeeded

CRS-2672: Attempting to start 'ora.evmd' on 'cluster3'

CRS-2676: Start of 'ora.evmd' on 'cluster3' succeeded

clscfg: EXISTING configuration version 5 detected.

clscfg: version 5 is 11g Release 2.

Successfully accumulated necessary OCR keys.

Creating OCR keys for user 'root', privgrp 'root'..

Operation successful.

cluster3     2013/05/24 01:39:28     /oracle/app/11g/cdata/cluster3/backup_20130524_013928.olr

Configure Oracle Grid Infrastructure for a Cluster ... succeeded

Updating inventory properties for clusterware

Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 11494 MB    Passed

The inventory pointer is located at /var/opt/oracle/oraInst.loc

The inventory is located at /oracle/app/grid/oraInventory

'UpdateNodeList' was successful.

附件三：

$/oracle/app/oracle/product/11.2.0/dbhome_1/oui/bin/addNode.sh  -silent "CLUSTER_NEW_NODES={cluster3}"

Starting Oracle Universal Installer...

Checking swap space: must be greater than 500 MB.   Actual 11208 MB    Passed

Oracle Universal Installer, Version 11.2.0.1.0 Production

Copyright (C) 1999, 2009, Oracle. All rights reserved.

Performing tests to see whether nodes cluster1,cluster3 are available

............................................................... 100% Done.

Cluster Node Addition Summary

Global Settings

   Source: /oracle/app/oracle/product/11.2.0/dbhome_1

   New Nodes

Space Requirements

   New Nodes

      cluster3

         /: Required 4.30GB : Available 378MB

Installed Products

   Product Names

      Oracle Database 11g 11.2.0.1.0

      Sun JDK 1.5.0.17.0

      Installer SDK Component 11.2.0.1.0

      Oracle One-Off Patch Installer 11.2.0.0.2

      Oracle Universal Installer 11.2.0.1.0

      Oracle Configuration Manager Deconfiguration 10.3.1.0.0

      Oracle DBCA Deconfiguration 11.2.0.1.0

      Oracle RAC Deconfiguration 11.2.0.1.0

      Oracle Database Deconfiguration 11.2.0.1.0

      Oracle Configuration Manager 10.3.1.1.0

      Oracle ODBC Driverfor Instant Client 11.2.0.1.0

      LDAP Required Support Files 11.2.0.1.0

      SSL Required Support Files for InstantClient 11.2.0.1.0

      Bali Share 1.1.18.0.0

      Oracle Extended Windowing Toolkit 3.4.47.0.0

      Oracle JFC Extended Windowing Toolkit 4.2.36.0.0

      Oracle Real Application Testing 11.2.0.1.0

      Oracle Database Vault J2EE Application 11.2.0.1.0

      Oracle Label Security 11.2.0.1.0

      Oracle Data Mining RDBMS Files 11.2.0.1.0

      Oracle OLAP RDBMS Files 11.2.0.1.0

      Oracle OLAP API 11.2.0.1.0

      Platform Required Support Files 11.2.0.1.0

      Oracle Database Vault option 11.2.0.1.0

      Oracle RAC Required Support Files-HAS 11.2.0.1.0

      SQL*Plus Required Support Files 11.2.0.1.0

      Oracle Display Fonts 9.0.2.0.0

      Oracle Ice Browser 5.2.3.6.0

      Oracle JDBC Server Support Package 11.2.0.1.0

      Oracle SQL Developer 11.2.0.1.0

      Oracle Application Express 11.2.0.1.0

      XDK Required Support Files 11.2.0.1.0

      RDBMS Required Support Files for Instant Client 11.2.0.1.0

      SQLJ Runtime 11.2.0.1.0

      Database Workspace Manager 11.2.0.1.0

      RDBMS Required Support Files 11.2.0.1.0

      Oracle Globalization Support 11.2.0.1.0

      Exadata Storage Server 11.2.0.1.0

      Provisioning Advisor Framework 10.2.0.4.2

      Enterprise Manager Database Plugin -- Repository Support 11.2.0.1.0

      Enterprise Manager Repository Core Files 10.2.0.4.2

      Enterprise Manager Database Plugin -- Agent Support 11.2.0.1.0

      Enterprise Manager Grid Control Core Files 10.2.0.4.2

      Enterprise Manager Common Core Files 10.2.0.4.2

      Enterprise Manager Agent Core Files 10.2.0.4.2

      Agent Required Support Files 10.2.0.4.2

      regexp 2.1.9.0.0

      Parser Generator Required Support Files 11.2.0.1.0

      Oracle 11g Warehouse Builder Required Files 11.2.0.1.0

      Oracle Notification Service (eONS) 11.2.0.1.0

      Oracle Text Required Support Files 11.2.0.1.0

      Precompiler Required Support Files 11.2.0.1.0

      Oracle Database 11g Multimedia Files 11.2.0.1.0

      Oracle Multimedia Java Advanced Imaging 11.2.0.1.0

      Oracle Multimedia Annotator 11.2.0.1.0

      Oracle JDBC/OCI Instant Client 11.2.0.1.0

      Oracle Multimedia Locator RDBMS Files 11.2.0.1.0

      Oracle Core Required Support Files 11.2.0.1.0

      Oracle Help For Java 4.2.9.0.0

      Sample Schema Data 11.2.0.1.0

      Oracle Starter Database 11.2.0.1.0

      Oracle Message Gateway Common Files 11.2.0.1.0

      Oracle XML Query 11.2.0.1.0

      XML Parser for Oracle JVM 11.2.0.1.0

      Expat libraries 2.0.1.0.1

      Installation Plugin Files 11.2.0.1.0

      Enterprise Manager Common Files 10.2.0.4.2

      Perl Modules 5.10.0.0.1

      Deinstallation Tool 11.2.0.1.0

      Oracle Quality of Service Management (Client) 11.2.0.1.0

      Perl Interpreter 5.10.0.0.1

      JAccelerator (COMPANION) 11.2.0.1.0

      Oracle Containers for Java 11.2.0.1.0

      Oracle Code Editor 1.2.1.0.0I

      Oracle Net Required Support Files 11.2.0.1.0

      Secure Socket Layer 11.2.0.1.0

      Oracle Universal Connection Pool 11.2.0.1.0

      Oracle JDBC/THIN Interfaces 11.2.0.1.0

      Oracle Multimedia Client Option 11.2.0.1.0

      Oracle Java Client 11.2.0.1.0

      Character Set Migration Utility 11.2.0.1.0

      Oracle Locale Builder 11.2.0.1.0

      PL/SQL Embedded Gateway 11.2.0.1.0

      OLAP SQL Scripts 11.2.0.1.0

      Database SQL Scripts 11.2.0.1.0

      Oracle Globalization Support 11.2.0.1.0

      Required Support Files 11.2.0.1.0

      SQL*Plus Files for Instant Client 11.2.0.1.0

      Oracle ODBC Driver 11.2.0.1.0

      Oracle Database User Interface 2.2.13.0.0

      Oracle Notification Service 11.2.0.0.0

      Enterprise Manager Minimal Integration 11.2.0.1.0

      XML Parser for Java 11.2.0.1.0

      Oracle Security Developer Tools 11.2.0.1.0

      Oracle Wallet Manager 11.2.0.1.0

      Cluster Verification Utility Common Files 11.2.0.1.0

      Oracle Clusterware RDBMS Files 11.2.0.1.0

      Oracle UIX 2.2.24.5.0

      Enterprise Manager plugin Common Files 11.2.0.1.0

      HAS Common Files 11.2.0.1.0

      Precompiler Common Files 11.2.0.1.0

      Installation Common Files 11.2.0.1.0

      Oracle Help for the  Web 2.0.14.0.0

      Oracle LDAP administration 11.2.0.1.0

      Buildtools Common Files 11.2.0.1.0

      Assistant Common Files 11.2.0.1.0

      Oracle Recovery Manager 11.2.0.1.0

      PL/SQL 11.2.0.1.0

      Generic Connectivity Common Files 11.2.0.1.0

      Oracle Database Gateway for ODBC 11.2.0.1.0

      Oracle Programmer 11.2.0.1.0

      Oracle Database Utilities 11.2.0.1.0

      Enterprise Manager Agent 10.2.0.4.2

      Oracle Netca Client 11.2.0.1.0

      SQL*Plus 11.2.0.1.0

      Oracle Call Interface (OCI) 11.2.0.1.0

      Oracle Multimedia Locator 11.2.0.1.0

      Oracle Multimedia 11.2.0.1.0

      Oracle Net 11.2.0.1.0

      Database Configuration and Upgrade Assistants 11.2.0.1.0

      Oracle XML Development Kit 11.2.0.1.0

      Oracle JVM 11.2.0.1.0

      Oracle Advanced Security 11.2.0.1.0

      Oracle Internet Directory Client 11.2.0.1.0

      HAS Files for DB 11.2.0.1.0

      Oracle Enterprise Manager Console DB 11.2.0.1.0

      Oracle Net Listener 11.2.0.1.0

      Oracle Text 11.2.0.1.0

      Oracle Net Services 11.2.0.1.0

      Oracle Database 11g 11.2.0.1.0

      Oracle OLAP 11.2.0.1.0

      Oracle Spatial 11.2.0.1.0

      Oracle Partitioning 11.2.0.1.0

      Enterprise Edition Options 11.2.0.1.0

-----------------------------------------------------------------------------

Instantiating scripts for add node (Friday, May 24, 2013 2:12:14 AM CST)

.                                                                 1% Done.

Instantiation of add node scripts complete

Copying to remote nodes (Friday, May 24, 2013 2:12:35 AM CST)

...............................................................................................                                 96% Done.

Home copied to new nodes

Saving inventory on nodes (Friday, May 24, 2013 2:35:20 AM CST)

.                                                               100% Done.

Save inventory complete

WARNING:

The following configuration scripts need to be executed as the "root" user in each cluster node.

/oracle/app/oracle/product/11.2.0/dbhome_1/root.sh #On nodes cluster3

To execute the configuration scripts:

    1. Open a terminal window

    2. Log in as "root"

    3. Run the scripts in each cluster node

The Cluster Node Addition of /oracle/app/oracle/product/11.2.0/dbhome_1 was successful.

Please check '/tmp/silentInstall.log' for more details.