私のHadoopジョブのマッパータスクは、進行状況が100％であっても、常にそこでハングし、ステータスはまだ実行中です。そして、マッパータスクログで多くのマージ操作が行われていることがわかります。パラメータio.sort.mbとio.sort.factorをすでに大きな数値に変更しました。しかし、それは私の問題を解決しませんでした。私は約2000のマッパータスクを持っており、マッパータスクの全体的な出力サイズは200Gです。つまり、各マッパータスクの出力サイズは約100Mであり、私にとっては大きなサイズではないはずです。だから私はマッパータスクがなぜ多くのマージ操作を行うのか理解していません
この問題に関するアイデアはありますか？ありがとう
そして、これが私のログです（BTW、サイズ番号は以下で何を意味しますか？）：
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 44335 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 45076 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 44057 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 45369 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 45388 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 45816 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 44765 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 45761 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 45379 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 44456 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 45581 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 45939 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 45418 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 45241 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 44809 bytes
[INFO] Merger - Merging 2 sorted segments
[INFO] Merger - Down to the last merge-pass, with 2 segments left of total size: 44736 bytes
[INFO] Merger - Merging 2 sorted segments