Chaitanya created APEXMALHAR-2448: ------------------------------------- Summary: Throwing IOException from getValueFromBucketSync() method which is in AbstractManagedStateImpl Key: APEXMALHAR-2448 URL: https://issues.apache.org/jira/browse/APEXMALHAR-2448 Project: Apache Apex Malhar Issue Type: Bug Reporter: Chaitanya Assignee: Chaitanya
This is observed while running the KeyedWindowedOperatorBenchmarkApp with the fixes of APEXMALHAR-2406. Stack trace: ---------------- java.io.IOException: Got error for OP_READ_BLOCK, status=ERROR, self= ***, remote=***, for file /user/chaitanya/WindowedOperatorBenchmark/Store/2/1489661340000, for pool BP-840834871-192.168.2.156-1476349346128 block 1215610008_141934910 at org.apache.hadoop.hdfs.RemoteBlockReader2.checkSuccess(RemoteBlockReader2.java:467) at org.apache.hadoop.hdfs.RemoteBlockReader2.newBlockReader(RemoteBlockReader2.java:432) at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReader(BlockReaderFactory.java:881) at org.apache.hadoop.hdfs.BlockReaderFactory.getRemoteBlockReaderFromTcp(BlockReaderFactory.java:759) at org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:376) at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:662) at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:889) at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:942) at java.io.DataInputStream.read(DataInputStream.java:149) at org.apache.hadoop.io.file.tfile.BoundedRangeFileInputStream.read(BoundedRangeFileInputStream.java:98) at java.io.BufferedInputStream.read1(BufferedInputStream.java:273) at java.io.BufferedInputStream.read(BufferedInputStream.java:334) at java.io.FilterInputStream.read(FilterInputStream.java:107) at org.apache.hadoop.io.file.tfile.DTBCFile$Reader$RBlockState.<init>(DTBCFile.java:531) at org.apache.hadoop.io.file.tfile.DTBCFile$Reader.createReader(DTBCFile.java:786) at org.apache.hadoop.io.file.tfile.DTBCFile$Reader.getDataBlock(DTBCFile.java:779) at org.apache.hadoop.io.file.tfile.DTFile$Reader.getBlockReader(DTFile.java:2068) at org.apache.hadoop.io.file.tfile.DTFile$Reader$Scanner.initBlock(DTFile.java:1583) at org.apache.hadoop.io.file.tfile.DTFile$Reader$Scanner.seekTo(DTFile.java:1440) at org.apache.hadoop.io.file.tfile.DTFile$Reader$Scanner.seekTo(DTFile.java:1407) at org.apache.hadoop.io.file.tfile.DTFile$Reader$Scanner.seekTo(DTFile.java:1389) at com.datatorrent.lib.fileaccess.DTFileReader.seek(DTFileReader.java:93) at org.apache.apex.malhar.lib.state.managed.Bucket$DefaultBucket.readValue(Bucket.java:389) at org.apache.apex.malhar.lib.state.managed.Bucket$DefaultBucket.getValueFromTimeBucketReader(Bucket.java:372) at org.apache.apex.malhar.lib.state.managed.Bucket$DefaultBucket.getFromReaders(Bucket.java:303) at org.apache.apex.malhar.lib.state.managed.Bucket$DefaultBucket.get(Bucket.java:352) at org.apache.apex.malhar.lib.state.managed.AbstractManagedStateImpl.getValueFromBucketSync(AbstractManagedStateImpl.java:297) at org.apache.apex.malhar.lib.state.managed.ManagedTimeUnifiedStateImpl.getSync(ManagedTimeUnifiedStateImpl.java:83) at org.apache.apex.malhar.lib.state.spillable.SpillableMapImpl.get(SpillableMapImpl.java:154) at org.apache.apex.malhar.lib.window.impl.SpillableWindowedKeyedStorage.get(SpillableWindowedKeyedStorage.java:230) at org.apache.apex.malhar.lib.window.impl.KeyedWindowedOperatorImpl.fireNormalTrigger(KeyedWindowedOperatorImpl.java:194) at org.apache.apex.malhar.lib.window.impl.AbstractWindowedOperator.fireTrigger(AbstractWindowedOperator.java:584) at org.apache.apex.malhar.lib.window.impl.AbstractWindowedOperator.fireTimeTriggers(AbstractWindowedOperator.java:561) at org.apache.apex.malhar.lib.window.impl.AbstractWindowedOperator.endWindow(AbstractWindowedOperator.java:499) at org.apache.apex.malhar.lib.window.impl.KeyedWindowedOperatorImpl.endWindow(KeyedWindowedOperatorImpl.java:154) at com.datatorrent.benchmark.window.KeyedWindowedOperatorBenchmarkApp$MyKeyedWindowedOperator.endWindow(KeyedWindowedOperatorBenchmarkApp.java:89) at com.datatorrent.stram.engine.GenericNode.processEndWindow(GenericNode.java:146) at com.datatorrent.stram.engine.GenericNode.run(GenericNode.java:357) -- This message was sent by Atlassian JIRA (v6.3.15#6346)