マップを実行しているときにレデューサーが開始すると、0 から 100 になり、次のエラーが発生します。
15/05/12 07:21:27 INFO terasort.TeraSort: starting
15/05/12 07:21:27 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
15/05/12 07:21:29 INFO input.FileInputFormat: Total input paths to process : 18000
Spent 1514ms computing base-splits.
Spent 109ms computing TeraScheduler splits.
Computing input splits took 1624ms
Sampling 10 splits of 18000
Making 1 from 100000 sampled records
Computing parititions took 315ms
Spent 1941ms computing partitions.
15/05/12 07:21:30 INFO client.RMProxy: Connecting to ResourceManager at n1/192.168.2.1:8032
15/05/12 07:21:31 INFO mapreduce.JobSubmitter: number of splits:18000
15/05/12 07:21:31 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1431389162125_0001
15/05/12 07:21:31 INFO impl.YarnClientImpl: Submitted application application_1431389162125_0001
15/05/12 07:21:31 INFO mapreduce.Job: The url to track the job: http://n1:8088/proxy/application_1431389162125_0001/
15/05/12 07:21:31 INFO mapreduce.Job: Running job: job_1431389162125_0001
15/05/12 07:21:37 INFO mapreduce.Job: Job job_1431389162125_0001 running in uber mode : false
15/05/12 07:21:37 INFO mapreduce.Job: map 0% reduce 0%
15/05/12 07:21:47 INFO mapreduce.Job: map 1% reduce 0%
15/05/12 07:22:01 INFO mapreduce.Job: map 2% reduce 0%
15/05/12 07:22:13 INFO mapreduce.Job: map 3% reduce 0%
15/05/12 07:22:25 INFO mapreduce.Job: map 4% reduce 0%
15/05/12 07:22:38 INFO mapreduce.Job: map 5% reduce 0%
15/05/12 07:22:50 INFO mapreduce.Job: map 6% reduce 0%
15/05/12 07:23:02 INFO mapreduce.Job: map 7% reduce 0%
15/05/12 07:23:15 INFO mapreduce.Job: map 8% reduce 0%
15/05/12 07:23:27 INFO mapreduce.Job: map 9% reduce 0%
15/05/12 07:23:40 INFO mapreduce.Job: map 10% reduce 0%
15/05/12 07:23:52 INFO mapreduce.Job: map 11% reduce 0%
15/05/12 07:24:02 INFO mapreduce.Job: map 100% reduce 100%
15/05/12 07:24:06 INFO mapreduce.Job: Job job_1431389162125_0001 failed with state FAILED due to: Task failed task_1431389162125_0001_r_000000
Job failed as tasks failed. failedMaps:0 failedReduces:1
これはデフォルト構成であり、毎回失敗します。
この問題を見つけるためにコメントアウトしたxmlに挿入する構成はすべて、削減の開始時にのみジョブが失敗するという問題がまだあります。