Description
20/03/03 11:06:37.615 CST Executor task launch worker for task 13132044<tid=0x156bb> ERROR SnappyExecutor: Exception in task 71.0 in stage 1260543.0 (TID 13132044) java.io.FileNotFoundException: /tmp/blockmgr-aa71ec8b-219c-4038-9c6b-6db761c68830/24/shuffle_2138_71_0.index.dd7775f5-9b63-4a09-8da6-fdf7fffd93a6 (No such file or directory) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.<init>(FileOutputStream.java:213) at java.io.FileOutputStream.<init>(FileOutputStream.java:162) at org.apache.spark.shuffle.IndexShuffleBlockResolver.writeIndexFileAndCommit(IndexShuffleBlockResolver.scala:144) at org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.write(BypassMergeSortShuffleWriter.java:128) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:103) at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:58) at org.apache.spark.scheduler.Task.run(Task.scala:146) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:347) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at org.apache.spark.executor.SnappyExecutor$$anon$2$$anon$3.run(SnappyExecutor.scala:58) at java.lang.Thread.run(Thread.java:748)
I wonder why it can't find the file? It's fine after it restarts