Chinaunix首页 | 论坛 | 博客
  • 博客访问: 2647364
  • 博文数量: 416
  • 博客积分: 10220
  • 博客等级: 上将
  • 技术积分: 4193
  • 用 户 组: 普通用户
  • 注册时间: 2006-12-15 09:47
文章分类

全部博文(416)

文章存档

2022年(1)

2021年(1)

2020年(1)

2019年(5)

2018年(7)

2017年(6)

2016年(7)

2015年(11)

2014年(1)

2012年(5)

2011年(7)

2010年(35)

2009年(64)

2008年(48)

2007年(177)

2006年(40)

我的朋友

分类: HADOOP

2017-01-13 20:06:14

来自:http://blog.csdn.net/sparkexpert/article/details/52836374

# cat exp-tbl.sh 
#!/bin/bash
hive -e "show tables;" > tables.txt


cat tables.txt|while read eachline
do
        hive -e "show create table $eachline" >>tablesDDL.txt
done

这个是最简洁的脚本.

CREATE TABLE `ontime`(
  `year` int, 
  `quarter` tinyint, 
  `month` tinyint, 
  `dayofmonth` tinyint, 
  `dayofweek` tinyint, 
  `flightdate` string, 
  `uniquecarrier` string, 
  `airlineid` int, 
  `carrier` string, 
  `tailnum` string, 
  `flightnum` string, 
  `originairportid` int, 
  `originairportseqid` int, 
  `origincitymarketid` int, 
  `origin` string, 
  `origincityname` string, 
  `originstate` string, 
  `originstatefips` string, 
  `originstatename` string, 
  `originwac` int, 
  `destairportid` int, 
  `destairportseqid` int, 
  `destcitymarketid` int, 
  `dest` string, 
  `destcityname` string, 
  `deststate` string, 
  `deststatefips` string, 
  `deststatename` string, 
  `destwac` int, 
  `crsdeptime` int, 
  `deptime` string, 
  `depdelay` string, 
  `depdelayminutes` string, 
  `depdel15` string, 
  `departuredelaygroups` string, 
  `deptimeblk` string, 
  `taxiout` string, 
  `wheelsoff` string, 
  `wheelson` string, 
  `taxiin` string, 
  `crsarrtime` string, 
  `arrtime` string, 
  `arrdelay` string, 
  `arrdelayminutes` string, 
  `arrdel15` string, 
  `arrivaldelaygroups` string, 
  `arrtimeblk` string, 
  `cancelled` tinyint, 
  `cancellationcode` string, 
  `diverted` tinyint, 
  `crselapsedtime` string, 
  `actualelapsedtime` string, 
  `airtime` string, 
  `flights` string, 
  `distance` string, 
  `distancegroup` tinyint, 
  `carrierdelay` string, 
  `weatherdelay` string, 
  `nasdelay` string, 
  `securitydelay` string, 
  `lateaircraftdelay` string, 
  `firstdeptime` string, 
  `totaladdgtime` string, 
  `longestaddgtime` string, 
  `divairportlandings` string, 
  `divreacheddest` string, 
  `divactualelapsedtime` string, 
  `divarrdelay` string, 
  `divdistance` string, 
  `div1airport` string, 
  `div1airportid` string, 
  `div1airportseqid` string, 
  `div1wheelson` string, 
  `div1totalgtime` string, 
  `div1longestgtime` string, 
  `div1wheelsoff` string, 
  `div1tailnum` string, 
  `div2airport` string, 
  `div2airportid` string, 
  `div2airportseqid` string, 
  `div2wheelson` string, 
  `div2totalgtime` string, 
  `div2longestgtime` string, 
  `div2wheelsoff` string, 
  `div2tailnum` string, 
  `div3airport` string, 
  `div3airportid` string, 
  `div3airportseqid` string, 
  `div3wheelson` string, 
  `div3totalgtime` string, 
  `div3longestgtime` string, 
  `div3wheelsoff` string, 
  `div3tailnum` string, 
  `div4airport` string, 
  `div4airportid` string, 
  `div4airportseqid` string, 
  `div4wheelson` string, 
  `div4totalgtime` string, 
  `div4longestgtime` string, 
  `div4wheelsoff` string, 
  `div4tailnum` string, 
  `div5airport` string, 
  `div5airportid` string, 
  `div5airportseqid` string, 
  `div5wheelson` string, 
  `div5totalgtime` string, 
  `div5longestgtime` string, 
  `div5wheelsoff` string, 
  `div5tailnum` string)
COMMENT 'Imported by sqoop on 2017/01/06 01:37:02'
ROW FORMAT SERDE 
  'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' 
WITH SERDEPROPERTIES ( 
  'field.delim'=',', 
  'line.delim'='\n', 
  'serialization.format'=',') 
STORED AS INPUTFORMAT 
  'org.apache.hadoop.mapred.TextInputFormat' 
OUTPUTFORMAT 
  'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'
LOCATION
  'hdfs://localhost:9000/user/hive/warehouse/ontime'
TBLPROPERTIES (
  'numFiles'='4', 
  'numRows'='0', 
  'rawDataSize'='0', 
  'totalSize'='1978552775', 
  'transient_lastDdlTime'='1483695515')

阅读(5608) | 评论(1) | 转发(0) |
给主人留下些什么吧!~~

pamire2017-01-13 21:21:59

Hive增加自增加字段:
add jar hdfs:///user/hive/lib/hive-contrib-2.1.1.jar;
create temporary function row_sequence as \'org.apache.hadoop.hive.contrib.udf.UDFRowSequence\';
create table test_id as select row_sequence() as id, * from test t;