這篇文章給大家分享的是有關hadoop中如何解決java.io.IOException: Bad connect ack with firstBad問題的內容。小編覺得挺實用的,因此分享給大家做個參考,一起跟隨小編過來看看吧。
[hadoop
@master ~]$
touch bigfile.tar
[hadoop
@master ~]$
cat hadoop-2.5.2.tar.gz >> bigfile.tar
[hadoop
@master ~]$ touch bigfile.tarcat
[hadoop
@master ~]$
[hadoop
@master ~]$
[hadoop@master ~]$
cat hadoop-2.5.2.tar.gz >> bigfile.tar
[hadoop@master ~]$
hadoop fs -put bigfile.tar / 上傳文件到遠程目錄(/)下
15/12/03 00:57:22 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
15/12/03 00:57:26 INFO hdfs.DFSClient: Exception in createBlockOutputStream
java.io.IOException: Bad connect ack with firstBadLink as 192.168.209.102:50010
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1377)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1281)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:526)
15/12/03 00:57:26 INFO hdfs.DFSClient: Abandoning BP-2062059271-192.168.209.100-1448384244888:blk_1073741864_1040
15/12/03 00:57:26 INFO hdfs.DFSClient: Excluding datanode 192.168.209.102:50010
15/12/03 00:57:26 INFO hdfs.DFSClient: Exception in createBlockOutputStream
java.io.IOException: Bad connect ack with firstBadLink as 192.168.209.101:50010
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.createBlockOutputStream(DFSOutputStream.java:1377)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.nextBlockOutputStream(DFSOutputStream.java:1281)
at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:526)
15/12/03 00:57:26 INFO hdfs.DFSClient: Abandoning BP-2062059271-192.168.209.100-1448384244888:blk_1073741865_1041
15/12/03 00:57:26 INFO hdfs.DFSClient: Excluding datanode 192.168.209.101:50010
原因:
1、某個節點機器突然開啟防火墻,導致不能連接
2、強制kill掉某個節點(據說)
3、某個機器直接當掉,豈不是完蛋了?數據冗余容災的設計干什么吃的?(推測)
解決方法:
root用戶關閉防火墻 service iptables stop
可能是某個節點因為重啟把iptables又起來了,
可以用chkconfig iptables off解決重啟帶來的問題,
不重啟的話用service iptables stop關掉。
感謝各位的閱讀!關于“hadoop中如何解決java.io.IOException: Bad connect ack with firstBad問題”這篇文章就分享到這里了,希望以上內容可以對大家有一定的幫助,讓大家可以學到更多知識,如果覺得文章不錯,可以把它分享出去讓更多的人看到吧!
免責聲明:本站發布的內容(圖片、視頻和文字)以原創、轉載和分享為主,文章觀點不代表本網站立場,如果涉及侵權請聯系站長郵箱:is@yisu.com進行舉報,并提供相關證據,一經查實,將立刻刪除涉嫌侵權內容。