CentOS6.5中怎么通過Hadoop用戶實現Yarn偽分布式部署

這篇文章將為大家詳細講解有關CentOS6.5中怎么通過Hadoop用戶實現Yarn偽分布式部署，文章內容質量較高，因此小編分享給大家做個參考，希望大家閱讀完這篇文章后對相關知識有一定的了解。

1.修改mapred-site.xml文件,沒有創建
[hadoop@hadoop001 hadoop]$ pwd
/opt/software/hadoop-2.8.1/etc/hadoop
[hadoop@hadoop001 hadoop]$ cp mapred-site.xml.template mapred-site.xml

[hadoop@hadoop001 hadoop]$ vim mapred-site.xml   -- 添加<property>

1. <configuration>
   

2.         <property>
   

3.            <name>mapreduce.framework.name</name>
   

4.            <value>yarn</value>
   

5.         </property>
   

6. </configuration>

2.修改etc/hadoop/yarn-site.xml

1. <configuration>
   

2.         <property>
   

3.           <name>yarn.nodemanager.aux-services</name>
   

4.           <value>mapreduce_shuffle</value>
   

5.         </property>
   

6. </configuration>

3.Start Stop ResourceManager daemon and NodeManager daemon

[hadoop@hadoop001 sbin]$ ./start-yarn.sh
[hadoop@hadoop001 sbin]$ ./stop-yarn.sh


4.初次啟動項目yarn啟動失敗,查看啟動該日志
[hadoop@hadoop001 sbin]$ jps
18704 Jps
13767 SecondaryNameNode
13595 DataNode
13454 NameNode
[hadoop@hadoop001 sbin]$ cat /opt/software/hadoop-2.8.1/logs/yarn-hadoop-resourcemanager-hadoop001.out
[Fatal Error] mapred-site.xml:24:1: The end-tag for element type "property" must end with a '>' delimiter.

檢查發現發現mapred-site.xml里>缺少 > 結束箭頭 


5.再次啟動yarn 啟動成功
[hadoop@hadoop001 sbin]$ ./start-yarn.sh
starting yarn daemons
starting resourcemanager, logging to /opt/software/hadoop-2.8.1/logs/yarn-hadoop-resourcemanager-hadoop001.out
192.168.0.129: starting nodemanager, logging to /opt/software/hadoop-2.8.1/logs/yarn-hadoop-nodemanager-hadoop001.out
[hadoop@hadoop001 sbin]$ jps
18883 NodeManager        
18918 Jps
13767 SecondaryNameNode
18776 ResourceManager
13595 DataNode
13454 NameNode

6.啟動控制臺啟動端口8088

• ResourceManager - http://localhost:8088/   
  

關于CentOS6.5中怎么通過Hadoop用戶實現Yarn偽分布式部署就分享到這里了，希望以上內容可以對大家有一定的幫助，可以學到更多知識。如果覺得文章不錯，可以把它分享出去讓更多的人看到。