「[原创] Hadoop 2.x的DistributedCache无法工作的问题」的评论 https://www.codelast.com/%e5%8e%9f%e5%88%9b-hadoop-2-x%e7%9a%84distributedcache%e6%97%a0%e6%b3%95%e5%b7%a5%e4%bd%9c%e7%9a%84%e9%97%ae%e9%a2%98/ 最优化之路 Tue, 28 Apr 2020 02:09:18 +0000 hourly 1 https://wordpress.org/?v=6.9.4 评论者：胡军涛 https://www.codelast.com/%e5%8e%9f%e5%88%9b-hadoop-2-x%e7%9a%84distributedcache%e6%97%a0%e6%b3%95%e5%b7%a5%e4%bd%9c%e7%9a%84%e9%97%ae%e9%a2%98/comment-page-1/#comment-4096 Mon, 30 Jul 2018 02:38:39 +0000 http://www.codelast.com/?p=8131#comment-4096 啊，怎么我的评论没了

]]> 评论者：胡军涛 https://www.codelast.com/%e5%8e%9f%e5%88%9b-hadoop-2-x%e7%9a%84distributedcache%e6%97%a0%e6%b3%95%e5%b7%a5%e4%bd%9c%e7%9a%84%e9%97%ae%e9%a2%98/comment-page-1/#comment-4095 Mon, 30 Jul 2018 02:37:02 +0000 http://www.codelast.com/?p=8131#comment-4095 博主，你好。我在按照你的方法运行程序时遇到了一些问题：
代码如下：
1. job.addCacheFile(new Path(INPUT_PATH2).toUri()); //其中INPUT_PATH2="hdfs://172.16.136.187:9000/user/root/input/tb.csv" 172.16.136.187为Hadoop 集群Master地址

2. URI[] caches = context.getCacheFiles();

3. BufferedReader reader = new BufferedReader(new FileReader(caches[0].getPath()));

上面是我认为出问题的代码部分

运行报错如下：
2018-07-30 10:31:30,505 WARN [org.apache.hadoop.fs.FileUtil] - Command 'D:\Coding\Java\hadoop-2.6.0\bin\winutils.exe symlink D:\Coding\Java\WorkSpace\MapReduce_01\tb.csv \tmp\hadoop-hujuntaolucky\mapred\local\1532917890006\tb.csv' failed 1 with: CreateSymbolicLink error (1314): ???????????

2018-07-30 10:31:30,505 WARN [org.apache.hadoop.mapred.LocalDistributedCacheManager] - Failed to create symlink: \tmp\hadoop-hujuntaolucky\mapred\local\1532917890006\tb.csv <- D:\Coding\Java\WorkSpace\MapReduce_01/tb.csv
2018-07-30 10:31:30,830 WARN [org.apache.hadoop.mapred.LocalJobRunner] - job_local697191123_0001
java.lang.Exception: java.io.FileNotFoundException: \user\root\input\tb.csv (系统找不到指定的路径。)
at org.apache.hadoop.mapred.LocalJobRunner$Job.runTasks(LocalJobRunner.java:462)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:522)
Caused by: java.io.FileNotFoundException: \user\root\input\tb.csv (系统找不到指定的路径。)
at java.io.FileInputStream.open0(Native Method)
at java.io.FileInputStream.open(Unknown Source)
at java.io.FileInputStream.(Unknown Source)
at java.io.FileInputStream.(Unknown Source)
at java.io.FileReader.(Unknown Source)
at WordCount.Book3$BookJoinMapper.setup(Book3.java:110)

其中这个Book3.java:110 指向的是BufferedReader reader = new BufferedReader(new FileReader(caches[0].getPath())); 这句代码

希望博主看到后能给个回复，谢谢啦！

]]>