@Yingyi: Thanks. I will look into that error. Best, Taewoo
On Sun, Jan 29, 2017 at 5:50 PM, Yingyi Bu <[email protected]> wrote: > Hi Taewoo, > > This error message usually indicates that there are some disk failures. > Please check /var/log/messages on the machine to see if that's the > case. > > Best, > Yingyi > > On Sun, Jan 29, 2017 at 4:00 PM, Taewoo Kim <[email protected]> wrote: > > > Hi all, > > > > I'm trying to load json files into a dataset. I have nine nodes so that I > > divide a 250GB file into nine files. After one hour, suddenly, I see the > > following exception on one node. Has anyone experienced this symptom? > > > > org.apache.hyracks.api.exceptions.HyracksDataException: > > org.apache.hyracks.api.exceptions.HyracksDataException: Input/output > error > > at > > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePusha > > ble.runInParallel(SuperActivityOperatorNodePushable.java:228) > > at > > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePusha > > ble.initialize(SuperActivityOperatorNodePushable.java:84) > > at org.apache.hyracks.control.nc.Task.run(Task.java:273) > > at > > java.util.concurrent.ThreadPoolExecutor.runWorker( > > ThreadPoolExecutor.java:1142) > > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > > ThreadPoolExecutor.java:617) > > at java.lang.Thread.run(Thread.java:745) > > Caused by: java.util.concurrent.ExecutionException: > > org.apache.hyracks.api.exceptions.HyracksDataException: Input/output > error > > at java.util.concurrent.FutureTask.report(FutureTask.java:122) > > at java.util.concurrent.FutureTask.get(FutureTask.java:192) > > at > > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePusha > > ble.runInParallel(SuperActivityOperatorNodePushable.java:222) > > ... 5 more > > Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: > > Input/output error > > at > > org.apache.asterix.external.operators.ExternalDataScanOperatorDescri > > ptor$1.initialize(ExternalDataScanOperatorDescriptor.java:65) > > at > > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePusha > > ble.lambda$initialize$0(SuperActivityOperatorNodePushable.java:86) > > at > > org.apache.hyracks.api.rewriter.runtime.SuperActivityOperatorNodePusha > > ble.lambda$runInParallel$2(SuperActivityOperatorNodePushable.java:216) > > at java.util.concurrent.FutureTask.run(FutureTask.java:266) > > ... 3 more > > Caused by: org.apache.hyracks.api.exceptions.HyracksDataException: > > Input/output error > > at > > org.apache.asterix.external.dataflow.RecordDataFlowController.start( > > RecordDataFlowController.java:63) > > at > > org.apache.asterix.external.dataset.adapter.GenericAdapter.start( > > GenericAdapter.java:37) > > at > > org.apache.asterix.external.operators.ExternalDataScanOperatorDescri > > ptor$1.initialize(ExternalDataScanOperatorDescriptor.java:62) > > ... 6 more > > Caused by: java.io.IOException: Input/output error > > at java.io.FileInputStream.readBytes(Native Method) > > at java.io.FileInputStream.read(FileInputStream.java:255) > > at > > org.apache.asterix.external.input.stream.LocalFSInputStream.read( > > LocalFSInputStream.java:126) > > at > > org.apache.asterix.external.input.stream.AsterixInputStreamReader.read( > > AsterixInputStreamReader.java:95) > > at > > org.apache.asterix.external.input.stream.AsterixInputStreamReader.read( > > AsterixInputStreamReader.java:67) > > at > > org.apache.asterix.external.input.record.reader.stream. > > SemiStructuredRecordReader.hasNext(SemiStructuredRecordReader.java:83) > > at > > org.apache.asterix.external.dataflow.RecordDataFlowController.start( > > RecordDataFlowController.java:52) > > ... 8 more > > java.lang.InterruptedException > > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer. > > acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1302) > > at java.util.concurrent.Semaphore.acquire(Semaphore.java:467) > > at org.apache.hyracks.control.nc.Task.run(Task.java:310) > > at > > java.util.concurrent.ThreadPoolExecutor.runWorker( > > ThreadPoolExecutor.java:1142) > > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > > ThreadPoolExecutor.java:617) > > at java.lang.Thread.run(Thread.java:745) > > java.lang.InterruptedException > > at > > java.util.concurrent.locks.AbstractQueuedSynchronizer. > > acquireSharedInterruptibly(AbstractQueuedSynchronizer.java:1302) > > at java.util.concurrent.Semaphore.acquire(Semaphore.java:467) > > at org.apache.hyracks.control.nc.Task.run(Task.java:310) > > at > > java.util.concurrent.ThreadPoolExecutor.runWorker( > > ThreadPoolExecutor.java:1142) > > at > > java.util.concurrent.ThreadPoolExecutor$Worker.run( > > ThreadPoolExecutor.java:617) > > at java.lang.Thread.run(Thread.java:745) > > Jan 29, 2017 3:44:26 PM org.apache.hyracks.control.nc.Joblet close > > > > > > Best, > > Taewoo > > >
