很久都没有操作都忘的差不多了，重新练练，加深点印象。
这些操作都是在VMWare虚拟机上进行的。首先把RHEL5安装在/dev/sda上。安装完后从添加了四块硬盘，分别是/dev/sdb、/dev/sdc、/dev/sdd、/dev/sde
以root进入系统，首先看一下磁盘的情况：
|
[root@TSM54-Test ~]# fdisk -l
Disk /dev/sda: 15.0 GB, 15032385536 bytes
255 heads, 63 sectors/track, 1827 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 13 104391 83 Linux
/dev/sda2 14 1827 14570955 8e Linux LVM
Disk /dev/sdb: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
Disk /dev/sdc: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
Disk /dev/sdd: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
Disk /dev/sde: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
|
一.创建Soft RAID
1.创建raid分区
|
[root@TSM54-Test ~]# fdisk /dev/sdb
The number of cylinders for this disk is set to 1044.
There is nothing wrong with that, but this is larger than 1024,
and could in certain setups cause problems with:
1) software that runs at boot time (e.g., old versions of LILO)
2) booting and partitioning software from other OSs
(e.g., DOS FDISK, OS/2 FDISK)
Command (m for help): n
Command action
e extended
p primary partition (1-4)
p
Partition number (1-4): 1
First cylinder (1-1044, default 1):
Using default value 1
Last cylinder or +size or +sizeM or +sizeK (1-1044, default 1044):
Using default value 1044
Command (m for help): t
Selected partition 1
Hex code (type L to list codes): L
0 Empty 1e Hidden W95 FAT1 80 Old Minix be Solaris boot
1 FAT12 24 NEC DOS 81 Minix / old Lin bf Solaris
2 XENIX root 39 Plan 9 82 Linux swap / So c1 DRDOS/sec (FAT-
3 XENIX usr 3c PartitionMagic 83 Linux c4 DRDOS/sec (FAT-
4 FAT16 <32M 40 Venix 80286 84 OS/2 hidden C: c6 DRDOS/sec (FAT-
5 Extended 41 PPC PReP Boot 85 Linux extended c7 Syrinx
6 FAT16 42 SFS 86 NTFS volume set da Non-FS data
7 HPFS/NTFS 4d QNX4.x 87 NTFS volume set db CP/M / CTOS / .
8 AIX 4e QNX4.x 2nd part 88 Linux plaintext de Dell Utility
9 AIX bootable 4f QNX4.x 3rd part 8e Linux LVM df BootIt
a OS/2 Boot Manag 50 OnTrack DM 93 Amoeba e1 DOS access
b W95 FAT32 51 OnTrack DM6 Aux 94 Amoeba BBT e3 DOS R/O
c W95 FAT32 (LBA) 52 CP/M 9f BSD/OS e4 SpeedStor
e W95 FAT16 (LBA) 53 OnTrack DM6 Aux a0 IBM Thinkpad hi eb BeOS fs
f W95 Ext'd (LBA) 54 OnTrackDM6 a5 FreeBSD ee EFI GPT
10 OPUS 55 EZ-Drive a6 OpenBSD ef EFI (FAT-12/16/
11 Hidden FAT12 56 Golden Bow a7 NeXTSTEP f0 Linux/PA-RISC b
12 Compaq diagnost 5c Priam Edisk a8 Darwin UFS f1 SpeedStor
14 Hidden FAT16 <3 61 SpeedStor a9 NetBSD f4 SpeedStor
16 Hidden FAT16 63 GNU HURD or Sys ab Darwin boot f2 DOS secondary
17 Hidden HPFS/NTF 64 Novell Netware b7 BSDI fs fd Linux raid auto
18 AST SmartSleep 65 Novell Netware b8 BSDI swap fe LANstep
1b Hidden W95 FAT3 70 DiskSecure Mult bb Boot Wizard hid ff BBT
1c Hidden W95 FAT3 75 PC/IX
Hex code (type L to list codes): fd
Changed system type of partition 1 to fd (Linux raid autodetect)
Command (m for help): p
Disk /dev/sdb: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 1044 8385898+ fd Linux raid autodetect
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table.
Syncing disks.
|
按照上面的方法分别把/dev/sdc,/dev/sdd/也创建raid分区。完成后，用fdisk -l查看
|
[root@TSM54-Test ~]# fdisk -l
Disk /dev/sda: 15.0 GB, 15032385536 bytes
255 heads, 63 sectors/track, 1827 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 13 104391 83 Linux
/dev/sda2 14 1827 14570955 8e Linux LVM
Disk /dev/sdb: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 1044 8385898+ fd Linux raid autodetect
Disk /dev/sdc: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdc1 1 1044 8385898+ fd Linux raid autodetect
Disk /dev/sdd: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdd1 1 1044 8385898+ fd Linux raid autodetect
Disk /dev/sde: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
|
2.创建阵列
mdadm可以支持LINEAR、RAID0 (striping)、 RAID1(mirroring)、 RAID4、RAID5、RAID6和MULTIPATH的阵列模式。
命令格式：
mdadm --create device -chunk=X --level=Y --raid-devices=Z devices
|
[root@TSM54-Test ~]# mdadm --create /dev/md0 --level=5 --raid-devices=3 /dev/sdb /dev/sdc /dev/sdd
mdadm: array /dev/md0 started.
|
--level表示创建的阵列模式，--raid-devices表示参与阵列的磁盘数量
3.配置文件
|
[root@TSM54-Test ~]#cp /usr/share/doc/mdadm-2.5.4/mdadm.conf-example /etc/mdadm.conf
[root@TSM54-Test ~]#echo DEVICE /dev/sd[bcd]1 >>/etc/mdadm.conf
[root@TSM54-Test ~]#mdadm -Ds >>/etc/mdadm.conf
|
4.格式化Raid
接下来，只要把/dev/md0作为一个单独的磁盘设备进行操作就可以：
|
[root@TSM54-Test ~]# mkfs.ext3 /dev/md0
mke2fs 1.39 (29-May-2006)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
2097152 inodes, 4194272 blocks
209713 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=0
128 block groups
32768 blocks per group, 32768 fragments per group
16384 inodes per group
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
4096000
Writing inode tables: done
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done
This filesystem will be automatically checked every 36 mounts or
180 days, whichever comes first. Use tune2fs -c or -i to override.
[root@TSM54-Test ~]# mkdir /mnt/software
[root@TSM54-Test ~]# mount /dev/md0 /mnt/software
|
5. 开机自动挂载
更改/etc/fstab文件，添加一行
|
/dev/md0 /mnt/software ext3 defaults 0 0
|
二. 其他的操作
mdadm有7中模式，下面列出了7种模式的命令格式，详细的选项，请参考man手册。
ASSEMBLE MODE :madam --assemble md-device options-and-component-devices
mdadm --assembel --scan md-devices-and-options
mdamd --assembel --scan options
BUILD MODE: mdadm --build device --chunk=X --level=Y --raid-devices=Z devices
CREATE MODE: mdadm --create device --chunk=X --level=Y --raid-devices=Z devices
MANAGE MODE: mdadm device options devices
MISC MODE: mdadm options ... devices ...
MONITOR MODE: mdadm --monitor options... devices...
GROW MODE:
1.查看
MISC模式
|
#mdadm --detail /dev/md0
#mdadm -D /dev/md0
|
2.停止
MISC模式
3.启动
ASSEMBLE模式
|
#mdadm -A /dev/md0 /dev/sd[bcd]1
启动指定的RAID，可以理解为将一个raid重新装配到系统中。
如果在前面已经配置了/etc/mdadm.conf文件，可以使用：
#mdadm -As /dev/md0
|
4.添加删除磁盘
mdadm可以在Manage模式下，对运行中的阵列进行添加及删除磁盘。常用于标识failed磁盘，增加spare（冗余）磁盘，以及替换磁盘等。
|
[root@TSM54-Test ~]# mdadm /dev/md0 --fail /dev/sdd --remove /dev/sdd
mdadm: set /dev/sdd faulty in /dev/md0
mdadm: hot removed /dev/sdd
[root@TSM54-Test ~]# mdadm -D /dev/md0
/dev/md0:
Version : 00.90.03
Creation Time : Fri Aug 1 21:35:31 2008
Raid Level : raid5
Array Size : 16777088 (16.00 GiB 17.18 GB)
Device Size : 8388544 (8.00 GiB 8.59 GB)
Raid Devices : 3
Total Devices : 2
Preferred Minor : 0
Persistence : Superblock is persistent
Update Time : Fri Aug 1 23:34:12 2008
State : clean, degraded
Active Devices : 2
Working Devices : 2
Failed Devices : 0
Spare Devices : 0
Layout : left-symmetric
Chunk Size : 64K
UUID : 28a22990:eac5c231:3fe907f1:1145e264
Events : 0.6
Number Major Minor RaidDevice State
0 8 16 0 active sync /dev/sdb
1 8 32 1 active sync /dev/sdc
2 0 0 2 removed
[root@TSM54-Test ~]# mdadm /dev/md0 --add /dev/sdd
mdadm: re-added /dev/sdd
[root@TSM54-Test ~]# mdadm -D /dev/md0
/dev/md0:
Version : 00.90.03
Creation Time : Fri Aug 1 21:35:31 2008
Raid Level : raid5
Array Size : 16777088 (16.00 GiB 17.18 GB)
Device Size : 8388544 (8.00 GiB 8.59 GB)
Raid Devices : 3
Total Devices : 3
Preferred Minor : 0
Persistence : Superblock is persistent
Update Time : Fri Aug 1 23:34:12 2008
State : clean, degraded, recovering
Active Devices : 2
Working Devices : 3
Failed Devices : 0
Spare Devices : 1
Layout : left-symmetric
Chunk Size : 64K
Rebuild Status : 0% complete
UUID : 28a22990:eac5c231:3fe907f1:1145e264
Events : 0.6
Number Major Minor RaidDevice State
0 8 16 0 active sync /dev/sdb
1 8 32 1 active sync /dev/sdc
2 8 48 2 spare rebuilding /dev/sdd
|
--fail指定坏磁盘,--remove移走。
需要注意的是，对于某些RAID级别，如RAID0，是不能用--fail --remove --add的。
5.监控
MONITOR模式
|
# nohup mdadm --monitor --mail root --delay 200 /dev/md0 &
|
每200秒监控一次，当RAID出现错误时，发送邮件给root用户。
6.增加spare磁盘
可以通过在创建的时候指定冗余磁盘
|
#mdadm --create --verbose /dev/md0 --level=3 --raid-devices=3 -x1 /dev/sdb1 /dev/sdc1 /dev/sdd1 /dev/sde1
|
-x(--spare-devices=)参数指定冗余磁盘的数量。另外，对于full的阵列（例如已经有2个磁盘的RAID1），则直接使用-add参数，mdadm会自动把冗余的磁盘作为spare disk。
7.删除RAID
|
#mdadm -S /dev/md0
或
#rm /dev/md0
删除/etc/mdadm.conf文件；去除/etc/fstab文件中相关的行。
最后，用fdisk对磁盘进行重新分区。
|
三 RAID之上建立LVM
1.前面还有一个/dev/sde没有处理，下面先把它建立成一个RAID1
|
[root@TSM54-Test ~]# fdisk /dev/sde
The number of cylinders for this disk is set to 1044.
There is nothing wrong with that, but this is larger than 1024,
and could in certain setups cause problems with:
1) software that runs at boot time (e.g., old versions of LILO)
2) booting and partitioning software from other OSs
(e.g., DOS FDISK, OS/2 FDISK)
Command (m for help): p
Disk /dev/sde: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
Command (m for help): n
Command action
e extended
p primary partition (1-4)
p
Partition number (1-4): 1
First cylinder (1-1044, default 1):
Using default value 1
Last cylinder or +size or +sizeM or +sizeK (1-1044, default 1044): +5000M
Command (m for help): n
Command action
e extended
p primary partition (1-4)
p
Partition number (1-4): 2
First cylinder (610-1044, default 610):
Using default value 610
Last cylinder or +size or +sizeM or +sizeK (610-1044, default 1044):
Using default value 1044
Command (m for help): p
Disk /dev/sde: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sde1 1 609 4891761 83 Linux
/dev/sde2 610 1044 3494137+ 83 Linux
Command (m for help): t
Partition number (1-4): 1
Hex code (type L to list codes): fd
Changed System type of partition 1 to fd (Linux raid autodetect)
Command (m for help): t
Partition number (1-4): 2
Hex code (type L to list codes): fd
Changed System type of partition 2 to fd (Linux raid autodetect)
Command (m for help): p
Disk /dev/sde: 8589 MB, 8589934592 bytes
255 heads, 63 sectors/track, 1044 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sde1 1 609 4891761 fd Linux raid autodetect
/dev/sde2 610 1044 3494137+ fd Linux raid autodetect
Command (m for help): w
The partition table has been
Calling ioctl() to re-read partition table.
Syncing disks.
|
完成分区后，执行：
|
[root@TSM54-Test dev]# cd /dev/
[root@TSM54-Test dev]# ls -l md0
brw-r----- 1 root disk 9, 0 Aug 1 21:58 md0
[root@TSM54-Test dev]# mknod md1 b 9 1
[root@TSM54-Test dev]# mdadm --create /dev/md1 --level=1 --raid-devices=2 /dev/sde1 /dev/sde2
mdadm: largest drive (/dev/sde1) exceed size (3494016K) by more than 1%
Continue creating array? y
mdadm: array /dev/md1 started.
|
好了，RAID1也做完了，验证一下
|
[root@TSM54-Test dev]# mdadm -Ds
ARRAY /dev/md0 level=raid5 num-devices=3 UUID=28a22990:eac5c231:3fe907f1:1145e264
ARRAY /dev/md1 level=raid1 num-devices=2 UUID=57f24dd1:aed3606c:d467132e:a6b3a010
|
2. 开始建立LVM
首先确保/dev/md0已经卸载，使用#umount /mnt/software
（1）创建PV
|
[root@TSM54-Test ~]# pvcreate /dev/md0
Physical volume "/dev/md0" successfully created
[root@TSM54-Test ~]# pvcreate /dev/md1
Physical volume "/dev/md1" successfully created
[root@TSM54-Test ~]# pvdisplay
--- Physical volume ---
PV Name /dev/sda2
VG Name VolGroup00
PV Size 13.90 GB / not usable 21.45 MB
Allocatable yes (but full)
PE Size (KByte) 32768
Total PE 444
Free PE 0
Allocated PE 444
PV UUID BntsgG-UJLv-agT2-lZ7C-dXY2-51FB-Jxd5tA
--- NEW Physical volume ---
PV Name /dev/md0
VG Name
PV Size 16.00 GB
Allocatable NO
PE Size (KByte) 0
Total PE 0
Free PE 0
Allocated PE 0
PV UUID GriJk2-wyfl-o0CI-NY7t-g75X-zIx3-FJHf1u
--- NEW Physical volume ---
PV Name /dev/md1
VG Name
PV Size 3.33 GB
Allocatable NO
PE Size (KByte) 0
Total PE 0
Free PE 0
Allocated PE 0
PV UUID SImCO1-RmvK-OgfZ-dCFZ-LJNC-8wun-Bd9qzS
|
（2）创建VG
|
[root@TSM54-Test ~]# vgcreate LVMonRaid /dev/md0 /dev/md1
Volume group "LVMonRaid" successfully created
[root@TSM54-Test ~]# vgscan
Reading all physical volumes. This may take a while...
Found volume group "VolGroup00" using metadata type lvm2
Found volume group "LVMonRaid" using metadata type lvm2
|
创建了一个LVMonRaid的卷组。
（3）创建LV
|
[root@TSM54-Test ~]# lvcreate --size 5000M --name LogicLV1 LVMonRaid
Logical volume "LogicLV1" created
[root@TSM54-Test ~]# lvcreate --size 5000M --name LogicLV2 LVMonRaid
Logical volume "LogicLV2" created
[root@TSM54-Test ~]# lvscan
ACTIVE '/dev/VolGroup00/LogVol00' [12.88 GB] inherit
ACTIVE '/dev/VolGroup00/LogVol01' [1.00 GB] inherit
ACTIVE '/dev/LVMonRaid/LogicLV1' [4.88 GB] inherit
ACTIVE '/dev/LVMonRaid/LogicLV2' [4.88 GB] inherit
注：上面两条记录是装系统时默认创建的。
|
（4）格式化创建文件系统，并挂载使用
|
[root@TSM54-Test ~]# mkfs.ext3 /dev/LVMonRaid/LogicLV1
mke2fs 1.39 (29-May-2006)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
640000 inodes, 1280000 blocks
64000 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=1312817152
40 block groups
32768 blocks per group, 32768 fragments per group
16000 inodes per group
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736
Writing inode tables: done
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done
This filesystem will be automatically checked every 35 mounts or
180 days, whichever comes first. Use tune2fs -c or -i to override.
[root@TSM54-Test ~]# mkfs.ext3 /dev/LVMonRaid/LogicLV2
mke2fs 1.39 (29-May-2006)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
640000 inodes, 1280000 blocks
64000 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=1312817152
40 block groups
32768 blocks per group, 32768 fragments per group
16000 inodes per group
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736
Writing inode tables: done
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done
This filesystem will be automatically checked every 33 mounts or
180 days, whichever comes first. Use tune2fs -c or -i to override.
[root@TSM54-Test ~]# mkdir /mnt/doc
[root@TSM54-Test ~]# mkdir /mnt/music
[root@TSM54-Test ~]# mount -t ext3 /dev/LVMonRaid/LogicLV1 /mnt/doc
[root@TSM54-Test ~]# mount -t ext3 /dev/LVMonRaid/LogicLV2 /mnt/music
如果要开机自动挂载，更改/etc/fstab文件，添加如下两行：
/dev/LVMonRaid/LogicLV1 /mnt/doc ext3 defaults 0 0
/dev/LVMonRaid/LogicLV2 /mnt/music ext3 defaults 0 0
|
阅读(1957) | 评论(2) | 转发(0) |
