数据库空间不够，硬盘坏了，无法扩容

接到软件开发人员的邮件，在创建索引的时候，发现异常，在客户端登陆数据库的时候，登陆不上，最后发现空间不够！

# df -k

Filesystem    1024-blocks      Free %Used    Iused %Iused Mounted on

/dev/hd4           131072     93380   29%     1909     9% /

/dev/hd2          3145728   1652812   48%    35119     9% /usr

/dev/hd9var        131072    102504   22%      809     4% /var

/dev/hd3          5242880   4384236   17%     1094     1% /tmp

/dev/fwdump        524288    523508    1%        5     1% /var/adm/ras/platform

/dev/hd1          1179648   1109752    6%     2202     1% /home

/proc                   -         -    -         -     -  /proc

/dev/hd10opt       655360    545428   17%     3135     3% /opt

/dev/oracle_lv    17432576         0  100%    67974    93% /oracle

/dev/oracle_data   272629760 197199984   28%     6134     1% /data

其实，很简单扩充磁盘空间就可以解决。不过发现IUSED%达到了93%，非常奇怪。怎么节点用掉这么多？

# lsvg rootvg

VOLUME GROUP:       rootvg                   VG IDENTIFIER: 00c97c6000004c00000001196e3bdd35

VG STATE:           active                   PP SIZE:        128 megabyte(s)

VG PERMISSION:      read/write               TOTAL PPs:      1092 (139776 megabytes)

MAX LVs:            256                      FREE PPs:       128 (16384 megabytes)

LVs:                12                       USED PPs:       964 (123392 megabytes)

OPEN LVs:           11                       QUORUM:         1 (Disabled)

TOTAL PVs:          2                        VG DESCRIPTORS: 3

STALE PVs:          1                        STALE PPs:      142

ACTIVE PVs:         1                        AUTO ON:        no

MAX PPs per VG:     32512                                    

MAX PPs per PV:     1016                     MAX PVs:        32

LTG size (Dynamic): 256 kilobyte(s)          AUTO SYNC:      no

HOT SPARE:          no                       BB POLICY:      relocatable

从空间来说，还有一些预留空间，扩充一下/ORACLE目录就可以了。

# chfs -a size=+100M/oracle

lquerypv: Warning, physical volume hdisk0 is excluded since it may be

        either missing or removed.

0516-404 allocp: This system cannot fulfill the allocation request.

        There are not enough free partitions or not enough physical volumes

        to keep strictness and satisfy allocation requests.  The command

        should be retried with different allocation characteristics.

0516-1734 extendlv: Warning, savebase failed.  Please manually run 'savebase' before rebooting.

怀疑磁盘有问题，尝试如下命令：

# lsvg -l rootvg

rootvg:

LVNAME             TYPE       LPs     PPs     PVs LVSTATE      MOUNT POINT

hd5                 boot       1       2       2    closed/syncd  N/A

hd6                 paging     255     510     2    open/stale    N/A

hd8                 jfs2log    1       2       2    open/stale    N/A

hd4                 jfs2       1       2       2    open/stale    /

hd2                 jfs2       24      48      2    open/stale    /usr

hd9var              jfs2       1       2       2    open/stale    /var

hd3                 jfs2       40      80      2    open/stale    /tmp

hd1                 jfs2       9       18      2    open/stale    /home

hd10opt             jfs2       5       10      2    open/stale    /opt

fwdump              jfs2       4       8       2    open/syncd    /var/adm/ras/platform

lg_dumplv           sysdump    16      16      1    open/syncd    N/A

oracle_lv           jfs2       133     266     2    open/stale    /oracle

呵呵，果然有盘有问题。尝试修复一下！

# savebase -v

No partition table found.

# bosboot -a

 0301-108 /usr/lib/boot/bin/mkboot_chrp: Unable to read file blocks. Return code: -1

 0301-158 bosboot: mkboot failed to create bootimage.

0301-165 bosboot: WARNING! bosboot failed - do not attempt to boot device.

看来只能到客户现场了。后来发现客户的trc文件累积很多，而且有几个很大，有一个TRC文件达到1G，我将这些文件移到阵列上，空间和节点数立刻降下来了。然后让软件开发的将数据库进行，，找厂家更换磁盘。

这次事件，我觉得自己在数据库有个失误，应该将数据库的HOME放在存储，而不是在本地磁盘更合理。