Hi Taewoo,
This error message usually indicates that there are some disk failures.
Please check /var/log/messages on the machine to see if that's the case.
Best,
Yingyi
On Sun, Jan 29, 2017 at 4:00 PM, Taewoo Kim <wangs...@gmail.com> wrote:
> Hi all,
>
> I'm trying to load json files into a dataset. I have nine nodes so that I
> divide a 250GB file into nine files. After one hour, suddenly, I see the
> following exception on one node. Has anyone experienced this symptom?
>
> org.apache.hyracks.api.exceptions.HyracksDataException:
> org.apache.hyracks.api.exceptions.HyracksDataException: Input/output error
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePusha
> ble.runInParallel(SuperActivityOperatorNodePushable.java:228)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePusha
> ble.initialize(SuperActivityOperatorNodePushable.java:84)
> at org.apache.hyracks.control.nc.Task.run(Task.java:273)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.util.concurrent.ExecutionException:
> org.apache.hyracks.api.exceptions.HyracksDataException: Input/output error
> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
> at java.util.concurrent.FutureTask.get(FutureTask.java:192)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePusha
> ble.runInParallel(SuperActivityOperatorNodePushable.java:222)
> ... 5 more
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException:
> Input/output error
> at
> org.apache.asterix.external.operators.ExternalDataScanOperatorDescri
> ptor$1.initialize(ExternalDataScanOperatorDescriptor.java:65)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePusha
> ble.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86)
> at
> org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePusha
> ble.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ... 3 more
> Caused by: org.apache.hyracks.api.exceptions.HyracksDataException:
> Input/output error
> at
> org.apache.asterix.external.dataflow.RecordDataFlowController.start(
> RecordDataFlowController.java:63)
> at
> org.apache.asterix.external.dataset.adapter.GenericAdapter.start(
> GenericAdapter.java:37)
> at
> org.apache.asterix.external.operators.ExternalDataScanOperatorDescri
> ptor$1.initialize(ExternalDataScanOperatorDescriptor.java:62)
> ... 6 more
> Caused by: java.io.IOException: Input/output error
> at java.io.FileInputStream.readBytes(Native Method)
> at java.io.FileInputStream.read(FileInputStream.java:255)
> at
> org.apache.asterix.external.input.stream.LocalFSInputStream.read(
> LocalFSInputStream.java:126)
> at
> org.apache.asterix.external.input.stream.AsterixInputStreamReader.read(
> AsterixInputStreamReader.java:95)
> at
> org.apache.asterix.external.input.stream.AsterixInputStreamReader.read(
> AsterixInputStreamReader.java:67)
> at
> org.apache.asterix.external.input.record.reader.stream.
> SemiStructuredRecordReader.hasNext(SemiStructuredRecordReader.java:83)
> at
> org.apache.asterix.external.dataflow.RecordDataFlowController.start(
> RecordDataFlowController.java:52)
> ... 8 more
> java.lang.InterruptedException
> at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1302)
> at java.util.concurrent.Semaphore.acquire(Semaphore.java:467)
> at org.apache.hyracks.control.nc.Task.run(Task.java:310)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> java.lang.InterruptedException
> at
> java.util.concurrent.locks.AbstractQueuedSynchronizer.
> acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1302)
> at java.util.concurrent.Semaphore.acquire(Semaphore.java:467)
> at org.apache.hyracks.control.nc.Task.run(Task.java:310)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Jan 29, 2017 3:44:26 PM org.apache.hyracks.control.nc.Joblet close
>
>
> Best,
> Taewoo
>
