0

wordcount の例を実行して Hadoop をテストしているところですが、次のエラーが発生しました。

14/07/30 12:03:02 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your   
platform... using builtin-java classes where applicable
14/07/30 12:03:03 INFO client.RMProxy: Connecting to ResourceManager at /127.0.0.1:8032
14/07/30 12:03:04 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:8032. Already     
tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 
SECONDS)
14/07/30 12:03:05 INFO ipc.Client: Retrying connect to server: localhost/127.0.0.1:8032. Already   
tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1 
SECONDS)

インターネット上の一部の人々は、yarn-site.xml ファイルが原因であると示唆しています。私は:

    <property>
      <name>yarn.nodemanager.aux-services</name>
      <value>mapreduce_shuffle</value>
    </property>
    <property>
      <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
      <value>org.apache.hadoop.mapred.ShuffleHandler</value>
    </property>
    <property>
      <name>yarn.scheduler.minimum-allocation-mb</name>
      <value>128</value>
      <description>Minimum limit of memory to allocate to each container request at the Resource     
      Manager.</description>
    </property>
    <property>
      <name>yarn.scheduler.maximum-allocation-mb</name>
      <value>1024</value>
      <description>Maximum limit of memory to allocate to each container request at the Resource 
      Manager.</description>
    </property>
    <property>
      <name>yarn.scheduler.minimum-allocation-vcores</name>
      <value>1</value>
      <description>The minimum allocation for every container request at the RM, in terms of 
      virtual CPU cores. Requests lower than this won't take effect, and the specified value will 
      get allocated the minimum.</description>
    </property>
    <property>
      <name>yarn.scheduler.maximum-allocation-vcores</name>
      <value>2</value>
      <description>The maximum allocation for every container request at the RM, in terms of 
      virtual CPU cores. Requests higher than this won't take effect, and will get capped to this 
      value.</description>
    </property>
    <property>
      <name>yarn.nodemanager.resource.memory-mb</name>
      <value>2048</value>
      <description>Physical memory, in MB, to be made available to running containers</description>
    </property>
    <property>
      <name>yarn.nodemanager.resource.cpu-vcores</name>
      <value>2</value>
      <description>Number of CPU cores that can be allocated for containers.</description>
    </property>

    <property>
      <name>yarn.nodemanager.aux-services</name>
      <value>mapreduce_shuffle</value>
    </property>

先週プログラムを実行しましたが、問題なく動作していたので、何が起こっているのか本当にわかりません。助けていただければ幸いです。

4

1 に答える 1