The output from short read aligners like Bowtie and BWA is commonly stored in SAM/BAM format. When presented with one of these files a common first task is to calculate the total number of alignments (reads) captured in the file. In this post I show some examples for finding the total number of re...【阅读全文】
1.查看正在运行app的信息 ?访问master WEB UI : http://master:8080 ?然后点击Running Applications 下Application ID或者Name查看信息 2.查看运行完成app的信息 ?按照上面在master WEB UI中的操作方法访问 ?会产生报错内容:No event logs were found for this application! To enable event logging, set spark.eventLog.enabled to true and spark.eventLog.dir to the directory to which your event logs are written. 解决办法:按照报错内容 ? (1)在$SPARK_HOME/conf中的创建spark-defaults.conf 然后在spark-defaults.conf中添加如下数据 (2)切换到/tmp/目录下,看有没有spark-events文件夹 经过【阅读全文】
本想安装好hive,启动hive-meta服务后,配置好hive 客户端,执行hive 就可以连接了,接下来一系列没想到啊.....1:Failed with exception java.io.IOException:java.net.ConnectException: Call From slave1/192.168.220.139 to master:9000 failed on connection exception: java.net.ConnectException: Connection refuse...【阅读全文】
jstorm 使用过程中遇到的问题1:Exception in thread "main" java.lang.SecurityException: Invalid signature file digest for Manifest main attributes原因:jar文件的问题,google下,发现和maven打包有关系!和研发同时沟通后...【阅读全文】