全部博文(162)
发布时间:2017-01-07 12:40:11
1. copyFromLocal hadoop dfs -ls 输出:-rw-r--r-- 3 hduser supergroup 674566 2011-03-10 11:38 /user/hduser/gutenberg/pg20417.txt -rw-r--r-- 3 hduser supergroup 1423801 2011-03-10 11:38 /user/hduser/gutenberg/pg5000.txt3.rmr 删除文件夹 hadoop dfs -rmr /user/hduser.........【阅读全文】
发布时间:2017-01-07 12:29:21
1.启动hadoop, start-all.sh 启动hadoop2. copy local example data to hdfs bin/hadoop jar contrib/streaming/hadoop-*streaming*.jar -file /home/hduser/reducer.py -reducer /home/hduser/reducer.py bin/hadoop dfs -cat /user/hduser/gutenberg-output/part-00000......【阅读全文】
发布时间:2017-01-06 23:45:06
1. 安装Java环境并配置好环境变量 export JAVA_HOME=/opt/java export CLASSPATH=$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib export PATH=$JAVA_HOME/bin:$JAVA_HOME/jre/bin:$PATH:$HOME/bin2. 新建用户组及用户名 (用于隔离环境) .........【阅读全文】