Chinaunix首页 | 论坛 | 博客
  • 博客访问: 90967181
  • 博文数量: 19283
  • 博客积分: 9968
  • 博客等级: 上将
  • 技术积分: 196062
  • 用 户 组: 普通用户
  • 注册时间: 2007-02-07 14:28
文章分类

全部博文(19283)

文章存档

2011年(1)

2009年(125)

2008年(19094)

2007年(63)

分类: Mysql/postgreSQL

2008-05-24 20:54:32

  来源:  

用sqlldr从mysql导出一个表的数据到oracle


代码:--------------------------------------------------------------------------------
1 进入mysql
mysql> select UUID, CYC_CODE, b03_05, b03_06, b03_07, b03_08, b03_09, b03_10, b03_11, b03_12, Cate_Item_Code, product_name, product_unit
from  jb603_jb603_sub3 into outfile 'd:/tmp/603sub.txt';

Query OK, 79537 rows affected (0.48 sec)
mysql> show create table jb603_jb603_sub3;

| jb603_jb603_sub3 | CREATE TABLE `jb603_jb603_sub3` (
  `UUID` varchar(32) NOT NULL default '',
  `CYC_CODE` char(2) NOT NULL default '',
  `b03_05` decimal(11,2) default '0.00',
  `b03_06` decimal(11,2) default '0.00',
  `b03_07` decimal(11,2) default '0.00',
  `b03_08` decimal(11,2) default '0.00',
  `b03_09` decimal(9,0) default '0',
  `b03_10` decimal(11,2) default '0.00',
  `b03_11` decimal(11,2) default '0.00',
  `b03_12` decimal(11,2) default '0.00',
  `Cate_Item_Code` varchar(7) NOT NULL default '',
  `product_name` varchar(60) default '',
  `product_unit` varchar(20) default '',
  PRIMARY KEY  (`UUID`,`CYC_CODE`,`Cate_Item_Code`)
) TYPE=InnoDB |
将语句整理成oracle支持的格式:
 CREATE TABLE jb603_jb603_sub3 (
  UUID varchar(32) NOT NULL ,
  CYC_CODE char(2) NOT NULL ,
  b03_05 number(11,2) ,
  b03_06 number(11,2) ,
  b03_07 number(11,2) ,
  b03_08 number(11,2) ,
  b03_09 number(9,0) ,
  b03_10 number(11,2) ,
  b03_11 number(11,2) ,
  b03_12 number(11,2) ,
  Cate_Item_Code varchar(7) NOT NULL ,
  product_name varchar(60) ,
  product_unit varchar(20) ,
  PRIMARY KEY  (UUID,CYC_CODE,Cate_Item_Code));
2 编写sqlldr控制文件t.ctl
load data
infile 'd:/tmp/603sub.txt'
into table   jb603_jb603_sub3
replace
fields terminated by x'09'
(UUID, CYC_CODE, b03_05, b03_06, b03_07, b03_08, b03_09, b03_10, b03_11, b03_12, Cate_Item_Code, product_name, product_unit)
3运行sqlplus /nolog
SQL> conn

建立jb603_jb603_sub3表
SQL>  CREATE TABLE jb603_jb603_sub3 (
  2    UUID varchar(32) NOT NULL ,
  3    CYC_CODE char(2) NOT NULL ,
  4    b03_05 number(11,2) ,
  5    b03_06 number(11,2) ,
  6    b03_07 number(11,2) ,
  7    b03_08 number(11,2) ,
  8    b03_09 number(9,0) ,
  9    b03_10 number(11,2) ,
 10    b03_11 number(11,2) ,
 11    b03_12 number(11,2) ,
 12    Cate_Item_Code varchar(7) NOT NULL ,
 13    product_name varchar(60) ,
 14    product_unit varchar(20) ,
 15    PRIMARY KEY  (UUID,CYC_CODE,Cate_Item_Code));

表已创建。
4 ho进入操作系统命令行
在操作系统命令行运行sqlldr
d:/tmp/t.ctl
....
达到提交点,逻辑记录计数79537
5 exit回到sqlplus

SQL> select count(*)from JB603_JB603_SUB3;

  COUNT(*)
----------
     79537

6另外,我不明白为什么用外部表方式不能成功
sqlldr
d:/tmp/t.ctl external_table=generate_only
产生t.log

SQL*Loader: Release 9.2.0.1.0 - Production on 星期日 3月 26 13:11:41 2006

Copyright (c) 1982, 2002, Oracle Corporation.  All rights reserved.

控制文件: d:/tmp/t.ctl
数据文件: d:/tmp/603sub.txt
错误文件: d:/tmp/603sub.bad
废弃文件: 未作指定
:
(可废弃所有记录)

加载数: ALL
跳过数: 0
允许的错误: 50
继续:    未作指定
所用路径:       外部表

表JB603_JB603_SUB3
已加载从每个逻辑记录
插入选项对此表REPLACE生效

   列名                        位置      长度  中止 包装数据类型
------------------------------ ---------- ----- ---- ---- ---------------------
UUID                                FIRST     *  WHT      CHARACTER           
CYC_CODE                             NEXT     *  WHT      CHARACTER           
B03_05                               NEXT     *  WHT      CHARACTER           
B03_06                               NEXT     *  WHT      CHARACTER           
B03_07                               NEXT     *  WHT      CHARACTER           
B03_08                               NEXT     *  WHT      CHARACTER           
B03_09                               NEXT     *  WHT      CHARACTER           
B03_10                               NEXT     *  WHT      CHARACTER           
B03_11                               NEXT     *  WHT      CHARACTER           
B03_12                               NEXT     *  WHT      CHARACTER           
CATE_ITEM_CODE                       NEXT     *  WHT      CHARACTER           
PRODUCT_NAME                         NEXT     *  WHT      CHARACTER           
PRODUCT_UNIT                         NEXT     *  WHT      CHARACTER           

用于外部表的 CREATE TABLE 语句:
------------------------------------------------------------------------
CREATE TABLE "SYS_SQLLDR_X_EXT_JB603_JB603_S"
(
  UUID VARCHAR2(32),
  CYC_CODE CHAR(2),
  B03_05 NUMBER(11,2),
  B03_06 NUMBER(11,2),
  B03_07 NUMBER(11,2),
  B03_08 NUMBER(11,2),
  B03_09 NUMBER(9),
  B03_10 NUMBER(11,2),
  B03_11 NUMBER(11,2),
  B03_12 NUMBER(11,2),
  CATE_ITEM_CODE VARCHAR2(7),
  PRODUCT_NAME VARCHAR2(60),
  PRODUCT_UNIT VARCHAR2(20)
)
ORGANIZATION external
(
  TYPE oracle_loader
  DEFAULT DIRECTORY UTL_FILE_DIR
  ACCESS PARAMETERS
  (
    RECORDS DELIMITED BY NEWLINE CHARACTERSET ZHS16GBK
    BADFILE 'UTL_FILE_DIR':'603sub.bad'
    LOGFILE 't.log_xt'
    READSIZE 1048576
    FIELDS TERMINATED BY 0x'09' LDRTRIM
    REJECT ROWS WITH ALL NULL FIELDS
    (
      UUID CHAR(255)
        TERMINATED BY 0x'09',
      CYC_CODE CHAR(255)
        TERMINATED BY 0x'09',
      B03_05 CHAR(255)
        TERMINATED BY 0x'09',
      B03_06 CHAR(255)
        TERMINATED BY 0x'09',
      B03_07 CHAR(255)
        TERMINATED BY 0x'09',
      B03_08 CHAR(255)
        TERMINATED BY 0x'09',
      B03_09 CHAR(255)
        TERMINATED BY 0x'09',
      B03_10 CHAR(255)
        TERMINATED BY 0x'09',
      B03_11 CHAR(255)
        TERMINATED BY 0x'09',
      B03_12 CHAR(255)
        TERMINATED BY 0x'09',
      CATE_ITEM_CODE CHAR(255)
        TERMINATED BY 0x'09',
      PRODUCT_NAME CHAR(255)
        TERMINATED BY 0x'09',
      PRODUCT_UNIT CHAR(255)
        TERMINATED BY 0x'09'
    )
  )
  location
  (
    '603sub.txt'
  )
)REJECT LIMIT UNLIMITED


用于加载内部表的 INSERT 语句:
------------------------------------------------------------------------
INSERT /*+ append */ INTO JB603_JB603_SUB3
(
  UUID,
  CYC_CODE,
  B03_05,
  B03_06,
  B03_07,
  B03_08,
  B03_09,
  B03_10,
  B03_11,
  B03_12,
  CATE_ITEM_CODE,
  PRODUCT_NAME,
  PRODUCT_UNIT
)
SELECT
  UUID,
  CYC_CODE,
  B03_05,
  B03_06,
  B03_07,
  B03_08,
  B03_09,
  B03_10,
  B03_11,
  B03_12,
  CATE_ITEM_CODE,
  PRODUCT_NAME,
  PRODUCT_UNIT
FROM "SYS_SQLLDR_X_EXT_JB603_JB603_S"


用于清除由以前的语句创建的对象的语句:
------------------------------------------------------------------------
DROP TABLE "SYS_SQLLDR_X_EXT_JB603_JB603_S"

从星期日 3月  26 13:11:41 2006开始运行
在星期日 3月  26 13:11:41 2006处运行结束

经过为: 00: 00: 00.14
CPU 时间为: 00: 00: 00.04

我摘出建外部表的语句执行
SQL> CREATE TABLE "SYS_SQLLDR_X_EXT_JB603_JB603_S"
  2  (
  3    UUID VARCHAR2(32),
  4    CYC_CODE CHAR(2),
  5    B03_05 NUMBER(11,2),
  6    B03_06 NUMBER(11,2),
  7    B03_07 NUMBER(11,2),
  8    B03_08 NUMBER(11,2),
  9    B03_09 NUMBER(9),
 10    B03_10 NUMBER(11,2),
 11    B03_11 NUMBER(11,2),
 12    B03_12 NUMBER(11,2),
 13    CATE_ITEM_CODE VARCHAR2(7),
 14    PRODUCT_NAME VARCHAR2(60),
 15    PRODUCT_UNIT VARCHAR2(20)
 16  )
 17  ORGANIZATION external
 18  (
 19    TYPE oracle_loader
 20    DEFAULT DIRECTORY UTL_FILE_DIR
 21    ACCESS PARAMETERS
 22    (
 23      RECORDS DELIMITED BY NEWLINE CHARACTERSET ZHS16GBK
 24      BADFILE 'UTL_FILE_DIR':'603sub.bad'
 25      LOGFILE 't.log_xt'
 26      READSIZE 1048576
 27      FIELDS TERMINATED BY 0x'09' LDRTRIM
 28    )
 29    location
 30    (
 31      '603sub.txt'
 32    )
 33  )
 34  /

表已创建。
当603sub.txt记录很少的时候,没问题
SQL> select uuid from  SYS_SQLLDR_X_EXT_JB603_JB603_S;

UUID
--------------------------------
00001B3726AD4276AD661393F92F9108


当603sub.txt记录多的时候

SQL> select count(*)from SYS_SQLLDR_X_EXT_JB603_JB603_S;
select count(*)from SYS_SQLLDR_X_EXT_JB603_JB603_S
*
ERROR 位于第 1 行:
ORA-29913: 执行 ODCIEXTTABLEFETCH 调出时出错
ORA-29400: 数据插件错误KUP-04020: found record longer than buffer size
supported, 1048576, in d:tmp603sub.txt
ORA-06512: 在"SYS.ORACLE_LOADER", line 14
ORA-06512: 在line 1


t.log_xt
 LOG file opened at 03/26/06 12:52:33

Field Definitions for table SYS_SQLLDR_X_EXT_JB603_JB603_S
  Record format DELIMITED BY NEWLINE
  Data in file has same endianness as the platform
  Rows with all null fields are accepted

  Fields in Data Source:

    UUID                            CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
    CYC_CODE                        CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
    B03_05                          CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
    B03_06                          CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
    B03_07                          CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
    B03_08                          CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
    B03_09                          CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
    B03_10                          CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
    B03_11                          CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
    B03_12                          CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
    CATE_ITEM_CODE                  CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
    PRODUCT_NAME                    CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
    PRODUCT_UNIT                    CHAR (255)
      Terminated by "09"
      Trim whitespace same as SQL Loader
KUP-04020: found record longer than buffer size supported, 1048576, in d:tmp603sub.txt
KUP-04053: record number 1

-------------------------------------------------------------------------------------------

难道是换行符的原因,但是sqlldr是成功的
果然是换行符的问题
mysql>
select UUID, CYC_CODE, b03_05, b03_06, b03_07, b03_08, b03_09, b03_10, b03_11, b03_12, Cate_Item_Code, product_name, product_unit
from jb603_jb603_sub3 into outfile 'd:/tmp/603sub.txt'LINES TERMINATED BY 'rn';

SQL> select count(*)from SYS_SQLLDR_X_EXT_JB603_JB603_S;

COUNT(*)
----------
79537

RECORDS DELIMITED BY 0x'0A'
SQL> CREATE TABLE "EXT_S"
2 (
3 UUID VARCHAR2(32),
4 CYC_CODE CHAR(2),
5 B03_05 NUMBER(11,2),
6 B03_06 NUMBER(11,2),
7 B03_07 NUMBER(11,2),
8 B03_08 NUMBER(11,2),
9 B03_09 NUMBER(9),
10 B03_10 NUMBER(11,2),
11 B03_11 NUMBER(11,2),
12 B03_12 NUMBER(11,2),
13 CATE_ITEM_CODE VARCHAR2(7),
14 PRODUCT_NAME VARCHAR2(60),
15 PRODUCT_UNIT VARCHAR2(20)
16 )
17 ORGANIZATION external
18 (
19 TYPE oracle_loader
20 DEFAULT DIRECTORY EXT_DATA_DIR
21 ACCESS PARAMETERS
22 (
23 RECORDS DELIMITED BY 0x'0A' CHARACTERSET ZHS16GBK
24 BADFILE 'UTL_FILE_DIR':'603sub.bad'
25 LOGFILE 't.log_xt'
26 READSIZE 1048576
27 FIELDS TERMINATED BY 0x'09' LDRTRIM
28 )
29 location
30 (
31 '603sub.tx1'
32 )
33 )
34 /

表已创建。

SQL> select count(*) from ext_s;

COUNT(*)
----------
79537

阅读(423) | 评论(0) | 转发(0) |
给主人留下些什么吧!~~