Ubuntu-14.04でHDP-2.5を使用して、このコマンドを実行し、
$ ./kite-dataset csv-import ./test.csv test_schema
import raw csvKiteSdk を使用して Hive にデータを送信しようとするver.1-1-0
と、次のIOErrorが発生します。
1 件のジョブ エラーが発生しました: org.kitesdk.tools.CopyTask: Kite(dataset:file:/tmp/444e6fc4-10e2-407d-afaf-723c408a6d... ID=1 (1/1)(1): Java .io.FileNotFoundException: ファイル file:/hdp/apps/2.5.0.0-1245/mapreduce/mapreduce.tar.gz は org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:624) at org に存在しません.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:850) org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:614) org.apache.hadoop.fs.DelegateToFileSystem.getFileStatus(DelegateToFileSystem) .java:125) で org.apache.hadoop.fs.AbstractFileSystem.resolvePath(AbstractFileSystem.java:468) で org.apache.hadoop.fs.FilterFs.resolvePath(FilterFs.java:158) で org.apache.hadoop. fs。FileContext$25.next(FileContext.java:2195) at org.apache.hadoop.fs.FileContext$25.next(FileContext.java:2191) at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90) org.apache.hadoop.fs.FileContext.resolve(FileContext.java:2191) で org.apache.hadoop.fs.FileContext.resolvePath(FileContext.java:603) で org.apache.hadoop.mapreduce.JobSubmitter.addMRFrameworkToDistributedCache (JobSubmitter.java:457) org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:142) org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290) org.apache org.apache.org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchControlledJob の org.apache.hadoop.mapreduce.Job.submit(Job.java:1287) の hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)。 org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl の org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.startReadyJobs(CrunchJobControl.java:204) で (CrunchControlledJob.java:329) を送信します。 pollJobStatusAndStartNewOnes(CrunchJobControl.java:238) org.apache.crunch.impl.mr.exec.MRExecutor.monitorLoop(MRExecutor.java:112) org.apache.crunch.impl.mr.exec.MRExecutor.access$000(MRExecutor) .java:55) org.apache.crunch.impl.mr.exec.MRExecutor$1.run(MRExecutor.java:83) で java.lang.Thread.run(Thread.java:745) でorg.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchControlledJob.submit(CrunchControlledJob.java: 329) org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.startReadyJobs(CrunchJobControl.java:204) org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.pollJobStatusAndStartNewOnes(CrunchJobControl.java: 238) org.apache.crunch.impl.mr.exec.MRExecutor.monitorLoop(MRExecutor.java:112) で org.apache.crunch.impl.mr.exec.MRExecutor.access$000(MRExecutor.java:55) でorg.apache.crunch.impl.mr.exec.MRExecutor$1.run(MRExecutor.java:83) at java.lang.Thread.run(Thread.java:745)org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchControlledJob.submit(CrunchControlledJob.java: 329) org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.startReadyJobs(CrunchJobControl.java:204) org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.pollJobStatusAndStartNewOnes(CrunchJobControl.java: 238) org.apache.crunch.impl.mr.exec.MRExecutor.monitorLoop(MRExecutor.java:112) で org.apache.crunch.impl.mr.exec.MRExecutor.access$000(MRExecutor.java:55) でorg.apache.crunch.impl.mr.exec.MRExecutor$1.run(MRExecutor.java:83) at java.lang.Thread.run(Thread.java:745)org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchControlledJob.submit(CrunchControlledJob.java:329) の org.apache.crunch.hadoop.mapreduce.lib の mapreduce.Job.submit(Job.java:1287)。 org.apache.crunch.impl.mr.exec の org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.pollJobStatusAndStartNewOnes(CrunchJobControl.java:238) でMRExecutor.monitorLoop(MRExecutor.java:112) at org.apache.crunch.impl.mr.exec.MRExecutor.access$000(MRExecutor.java:55) at org.apache.crunch.impl.mr.exec.MRExecutor$1. java.lang.Thread.run(Thread.java:745) で run(MRExecutor.java:83)org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchControlledJob.submit(CrunchControlledJob.java:329) の org.apache.crunch.hadoop.mapreduce.lib の mapreduce.Job.submit(Job.java:1287)。 org.apache.crunch.impl.mr.exec の org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.pollJobStatusAndStartNewOnes(CrunchJobControl.java:238) でMRExecutor.monitorLoop(MRExecutor.java:112) at org.apache.crunch.impl.mr.exec.MRExecutor.access$000(MRExecutor.java:55) at org.apache.crunch.impl.mr.exec.MRExecutor$1. java.lang.Thread.run(Thread.java:745) で run(MRExecutor.java:83)java:329) org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.startReadyJobs(CrunchJobControl.java:204) org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.pollJobStatusAndStartNewOnes(CrunchJobControl. java:238) org.apache.crunch.impl.mr.exec.MRExecutor.monitorLoop(MRExecutor.java:112) で org.apache.crunch.impl.mr.exec.MRExecutor.access$000(MRExecutor.java:55) で) org.apache.crunch.impl.mr.exec.MRExecutor$1.run(MRExecutor.java:83) で java.lang.Thread.run(Thread.java:745) でjava:329) org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.startReadyJobs(CrunchJobControl.java:204) org.apache.crunch.hadoop.mapreduce.lib.jobcontrol.CrunchJobControl.pollJobStatusAndStartNewOnes(CrunchJobControl. java:238) org.apache.crunch.impl.mr.exec.MRExecutor.monitorLoop(MRExecutor.java:112) で org.apache.crunch.impl.mr.exec.MRExecutor.access$000(MRExecutor.java:55) で) org.apache.crunch.impl.mr.exec.MRExecutor$1.run(MRExecutor.java:83) で java.lang.Thread.run(Thread.java:745) でapache.crunch.impl.mr.exec.MRExecutor.monitorLoop(MRExecutor.java:112) org.apache.crunch.impl.mr.exec.MRExecutor.access$000(MRExecutor.java:55) org.apache.crunch で.impl.mr.exec.MRExecutor$1.run(MRExecutor.java:83) at java.lang.Thread.run(Thread.java:745)apache.crunch.impl.mr.exec.MRExecutor.monitorLoop(MRExecutor.java:112) org.apache.crunch.impl.mr.exec.MRExecutor.access$000(MRExecutor.java:55) org.apache.crunch で.impl.mr.exec.MRExecutor$1.run(MRExecutor.java:83) at java.lang.Thread.run(Thread.java:745)
ファイル"hdfs:/hdp/apps/2.5.0.0-1245/mapreduce/mapreduce.tar.gz"
が存在することを確認しましたが、このエラーを解決する方法がしばらくわかりません。
どんな助けでも大歓迎です。