OEL6.1下安装Oracle 11gr2 RAC

经过前期的准备，操作系统、数据库及asm测试均没有问题，现尝试在oel6.1下安装oracle11gr2，具体步骤如下： RAC安装测试(11.2.0.3):

1. 测试环境规划:

a) 虚拟机:Vmware Workstation 8

b) 操作系统:OEL 6.1

c) Oracle RAC 版本:11.2.0.3

d) 主机名: erp1oel 与erp2oel

2. 网卡:各三块,一块连公用网络,两块私有网络做冗余,(如网卡名称与规划不符合,按以下方式修改,如缺少相应网卡配置文件,将eth0复制后修改即可)

a) shutdown 相应接口，将
/etc/sysconfig/network-scripts/ifcfg-eth0中的
DEVICE="eth0"

HWADDR="00:0C:29:0d:72:c6"

b) 修改 /etc/udev/rules.d/70-persistent-net.rules文件,将mac改为一致:

# PCI device 0x8086:0x100f (e1000)

SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="00:0c:29:0d:72:c6", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth0"

# PCI device 0x8086:0x100f (e1000)

SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="00:0c:29:0d:72:bc", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth1"

# PCI device 0x8086:0x100f (e1000)

SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="00:0c:29:0d:72:d0", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth2"

c) service udev-post stop; service udev-post start

d) Service network restart

3. IP规划(关闭IPv6 改network文件NETWORKING_IPV6=no):

i. 公有IP:
erp1oel:192.168.9.157
erp2oel:192.168.9.158

ii. 私有ip:
erp1-priv1:1.1.1.11
erp1-priv2:1.1.1.21
erp2-priv1:1.1.1.12
erp2-priv1:1.1.1.22

iii. Vip:
erp1-vip:192.168.9.237

erp2-vip:192.168.9.238

iv. Scan ip:
erp-scan:192.168.9.239

4. Hosts文件修改

192.168.9.157 erp1oel

192.168.9.158 erp2oel

1.1.1.11 erp1-priv1

1.1.1.21 erp1-priv2

1.1.1.12 erp2-priv1

1.1.1.22 erp2-priv2

192.168.9.237 erp1-vip

192.168.9.238 erp2-vip

192.168.9.239 erp-scan

1. 关闭防火墙
chkconfig --list iptables
chkconfig --level 2345 iptables off

service iptables stop

5. 拓朴图:

6. 模拟共享磁盘:

a) 按以下方式添加三块2g磁盘文件,注意修改scsi通道

磁盘命名分别如下:

Ocr和voting 使用磁盘 OCR_VOTE.vmdk
存放数据文件的使用 data.vmdk

存放闪回的使用fra.vmdk

b) 修改erp1oel节点的vmx配置文件

在vmx文件添加如下内容

diskLib.dataCacheMaxSize = "0"
diskLib.dataCacheMaxReadAheadSize = "0"
diskLib.DataCacheMinReadAheadSize = "0"
diskLib.dataCachePageSize = "4096"
diskLib.maxUnsyncedWrites = "0"
scsi1:0.deviceType = "disk"
scsi1:1.deviceType = "disk"
scsi1:2.deviceType = "disk"
scsi1:3.deviceType = "disk"
disk.EnableUUID = "TRUE"

c) 在erp2oel节点按以上步骤直接使用之前创建好的vmdk文件添加磁盘,同样修改虚拟机vmx文件

d) 启动两台机器 ,如开机后都能用fdisk识别到新增磁盘,则共享磁盘添加成功

|

7. 安装oracle相应补丁包
(OEL6.2)
rpm -ivh binutils-2.20.51.0.2-5.28.el6.x86_64.rpm compat-libstdc++-33-3.2.3-69.el6.x86_64.rpm elfutils-libelf-0.152-1.el6.x86_64.rpm elfutils-libelf-devel-0.152-1.el6.x86_64.rpm glibc-common-2.12-1.47.el6.x86_64.rpm glibc-devel-2.12-1.47.el6.x86_64.rpm gcc-4.4.6-3.el6.x86_64.rpm gcc-c++-4.4.6-3.el6.x86_64.rpm libaio-devel-0.3.107-10.el6.x86_64.rpm libaio-0.3.107-10.el6.x86_64.rpm libgcc-4.4.6-3.el6.x86_64.rpm libstdc++-4.4.6-3.el6.x86_64.rpm libstdc++-devel-4.4.6-3.el6.x86_64.rpm make-3.81-19.el6.x86_64.rpm sysstat-9.0.4-18.el6.x86_64.rpm unixODBC-2.2.14-11.el6.x86_64.rpm unixODBC-devel-2.2.14-11.el6.x86_64.rpm compat-libcap1-1.10-1.x86_64.rpm compat-libstdc++-33-3.2.3-69.el6.x86_64.rpm ksh-20100621-12.el6.x86_64.rpm libaio-devel-0.3.107-10.el6.x86_64.rpm

(OEL6.1)
rpm -ivh binutils-2.20.51.0.2-5.20.el6.x86_64.rpm

rpm -ivh compat-libstdc++-33-3.2.3-69.el6.x86_64.rpm

rpm -ivh elfutils-libelf-0.152-1.el6.x86_64.rpm

rpm -ivh elfutils-libelf-devel-0.152-1.el6.x86_64.rpm

rpm -ivh glibc-common-2.12-1.25.el6.x86_64.rpm

rpm -ivh glibc-devel-2.12-1.25.el6.x86_64.rpm

rpm -ivh gcc-4.4.5-6.el6.x86_64.rpm

rpm -ivh gcc-c++-4.4.5-6.el6.x86_64.rpm

rpm -ivh libaio-devel-0.3.107-10.el6.x86_64.rpm

rpm -ivh libaio-0.3.107-10.el6.x86_64.rpm

rpm -ivh libgcc-4.4.5-6.el6.x86_64.rpm

rpm -ivh libstdc++-4.4.5-6.el6.x86_64.rpm

rpm -ivh libstdc++-devel-4.4.5-6.el6.x86_64.rpm

rpm -ivh make-3.81-19.el6.x86_64.rpm

rpm -ivh sysstat-9.0.4-18.el6.x86_64.rpm

rpm -ivh unixODBC-2.2.14-11.el6.x86_64.rpm

rpm -ivh unixODBC-devel-2.2.14-11.el6.x86_64.rpm

rpm -ivh compat-libcap1-1.10-1.x86_64.rpm

rpm -ivh compat-libstdc++-33-3.2.3-69.el6.x86_64.rpm

rpm -ivh ksh-20100621-6.el6.x86_64.rpm

8. 增加组与用户并配置相应权限
groupadd oinstall
groupadd dba
groupadd oper
groupadd asmadmin
groupadd asmdba
groupadd asmoper
useradd -g oinstall -G dba,asmdba,asmadmin,asmoper grid
useradd -g oinstall -G dba,oper,asmdba oracle
passwd grid

Passwd oracle

Id oracle
id grid
mkdir -p /u01/app/11.2.0/grid

mkdir -p /u01/app/grid
chown -R grid:oinstall /u01/

mkdir -p /u01/app/oracle
chown -R oracle:oinstall /u01/app/oracle

chmod -R 775 /u01/

9. 修改/etc/sysctl.conf文件

fs.aio-max-nr = 1048576

fs.file-max = 6815744

kernel.shmmni = 4096

kernel.sem = 250 32000 100 128

net.ipv4.ip_local_port_range = 9000 65500

net.core.rmem_default = 262144

net.core.rmem_max = 4194304

net.core.wmem_default = 262144

net.core.wmem_max = 1048586
sysctl –p

10. 修改/etc/security/limits.conf文件
oracle soft nproc 2047

oracle hard nproc 16384

oracle soft nofile 1024

oracle hard nofile 65536

oracle soft stack 10240

grid soft nproc 2047

grid hard nproc 16384

grid soft nofile 1024

grid hard nofile 65536

grid soft stack 10240

11. 配置/etc/profile
if [ $USER = "oracle" ] || [ $USER = "grid" ];then

if [ $SHELL = "/bin/ksh" ];then

ulimit -p 16384

ulimit -n 65536

else

ulimit -u 16384 -n 65536

fi

umask 022

fi

export PATH=$PATH:/u01/app/11.2.0/grid/bin

12. 配置用户环境变量 (erp1节点与ERP2节点注意修改hostname)

a) Grid 用户

export ORACLE_HOSTNAME=erp1oel

export ORACLE_SID=+ASM1

export ORACLE_BASE=/u01/app/grid

export ORACLE_HOME=/u01/app/11.2.0/grid

export NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"

export PATH=$ORACLE_HOME/bin:$PATH

export NLS_LANG=AMERICAN_AMERICA.ZHS16GBK

b) Oracle用户
export ORACLE_HOSTNAME=erp1oel

export ORACLE_BASE=/u01/app/oracle

export ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1
export ORACLE_UNQNAME=center

export ORACLE_SID=center1

export ORACLE_TERM=xterm

export PATH=/usr/sbin:$PATH

export PATH=$ORACLE_HOME/bin:$PATH

export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib

export CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib

export NLS_DATE_FORMAT="yyyy-mm-dd HH24:MI:SS"

export NLS_LANG=AMERICAN_AMERICA.ZHS16GBK

13. 使用NTP配置时间同步

i. 备注:修改硬件时间

1. 查看主板时间
hwclock –show

2. 查看系统时间
date

3. 设置硬件时间
hwclock –set –date=”06/29/12 12:00:00”

4. 将系统时间改为硬件时间
hwclock –hctosys

5. 将硬件时间改为系统时间
hwclock –systohc

ii. 在erp1oel节点上配置/etc/ntp.conf配置文件
添加server 1.1.1.11
取消注释
server 127.127.1.0 # local clock

fudge 127.127.1.0 stratum 10

service ntpd start

iii. 在erp2oel节点

iv. 配置ntp client
vi /etc/ntp.conf
添加server 1.1.1.11
ntpdate 1.1.1.11

v. 在erp2oel节点配置定时执行同步脚本
crontab –e
0 0 1 * * /etc/ntp/ntprsync.sh
vi /etc/ntp/ntprsync.sh
#!/bin/sh
/usr/sbin/ntpdate 1.1.1.11
/sbin/hwclock –w

Chmod 777 ntprsync.sh

14. 磁盘配置

a) 使用以下命令获取需要绑定为asm disk的磁盘uuid

[root@erp1 ~]# scsi_id --whitelisted --replace-whitespace --device=/dev/sdb

36000c292af661da68d9aff76ea815bac

[root@erp1 ~]# scsi_id --whitelisted --replace-whitespace --device=/dev/sdc

36000c295f525d1248c22d8958cda5c9c
[root@erp1 ~]# scsi_id --whitelisted --replace-whitespace --device=/dev/sdd

36000c2948d82d022d55f00a8fbd31bb7