Hi all, I'm trying to load json files into a dataset. I have nine nodes so that I divide a 250GB file into nine files. After one hour, suddenly, I see the following exception on one node. Has anyone experienced this symptom?
org.apache.hyracks.api.exceptions.HyracksDataException: org.apache.hyracks.api.exceptions.HyracksDataException: Input/output error at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:228) at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.initialize(SuperActivityOperatorNodePushable.java:84) at org.apache.hyracks.control.nc.Task.run(Task.java:273) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.util.concurrent.ExecutionException: org.apache.hyracks.api.exceptions.HyracksDataException: Input/output error at java.util.concurrent.FutureTask.report(FutureTask.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.runInParallel(SuperActivityOperatorNodePushable.java:222) ... 5 more Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Input/output error at org.apache.asterix.external.operators.ExternalDataScanOperatorDescriptor$1.initialize(ExternalDataScanOperatorDescriptor.java:65) at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86) at org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePushable.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216) at java.util.concurrent.FutureTask.run(FutureTask.java:266) ... 3 more Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: Input/output error at org.apache.asterix.external.dataflow.RecordDataFlowController.start(RecordDataFlowController.java:63) at org.apache.asterix.external.dataset.adapter.GenericAdapter.start(GenericAdapter.java:37) at org.apache.asterix.external.operators.ExternalDataScanOperatorDescriptor$1.initialize(ExternalDataScanOperatorDescriptor.java:62) ... 6 more Caused by: java.io.IOException: Input/output error at java.io.FileInputStream.readBytes(Native Method) at java.io.FileInputStream.read(FileInputStream.java:255) at org.apache.asterix.external.input.stream.LocalFSInputStream.read(LocalFSInputStream.java:126) at org.apache.asterix.external.input.stream.AsterixInputStreamReader.read(AsterixInputStreamReader.java:95) at org.apache.asterix.external.input.stream.AsterixInputStreamReader.read(AsterixInputStreamReader.java:67) at org.apache.asterix.external.input.record.reader.stream.SemiStructuredRecordReader.hasNext(SemiStructuredRecordReader.java:83) at org.apache.asterix.external.dataflow.RecordDataFlowController.start(RecordDataFlowController.java:52) ... 8 more java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1302) at java.util.concurrent.Semaphore.acquire(Semaphore.java:467) at org.apache.hyracks.control.nc.Task.run(Task.java:310) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) java.lang.InterruptedException at java.util.concurrent.locks.AbstractQueuedSynchronizer.acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1302) at java.util.concurrent.Semaphore.acquire(Semaphore.java:467) at org.apache.hyracks.control.nc.Task.run(Task.java:310) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Jan 29, 2017 3:44:26 PM org.apache.hyracks.control.nc.Joblet close Best, Taewoo
