[
https://issues.apache.org/jira/browse/HIVE-17303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16124587#comment-16124587
]
slim bouguerra edited comment on HIVE-17303 at 8/12/17 2:31 PM:
----------------------------------------------------------------
Druid is using 0.5.18, Spark 0.5.11 and Tez 0.4.9
{code}
org.apache.tez:tez-runtime-library:jar:0.8.4.2.6.2.0-SNAPSHOT:compile [INFO] |
+- org.roaringbitmap:RoaringBitmap:jar:0.4.9:compile
{code}
{code}
INFO] +- org.apache.spark:spark-core_2.10:jar:1.6.0:compile
[INFO] | +- org.apache.avro:avro-mapred:jar:hadoop2:1.7.7:compile
[INFO] | +- org.roaringbitmap:RoaringBitmap:jar:0.5.11:compile
{code}
{code}
io.druid:druid-processing:jar:0.9.2.2.6.2.0-SNAPSHOT:compile
[INFO] | | \- org.roaringbitmap:RoaringBitmap:jar:0.5.18:compile
{code}
was (Author: bslim):
Druid is using 0.5.18, Spark 0.5.11 and Tez 0.4.9
{code}
org.apache.tez:tez-runtime-library:jar:0.8.4.2.6.2.0-SNAPSHOT:compile [INFO] |
+- org.roaringbitmap:RoaringBitmap:jar:0.4.9:compile
{code}
spark is using 0.5.11
{code}
INFO] +- org.apache.spark:spark-core_2.10:jar:1.6.0:compile
[INFO] | +- org.apache.avro:avro-mapred:jar:hadoop2:1.7.7:compile
[INFO] | +- org.roaringbitmap:RoaringBitmap:jar:0.5.11:compile
{code}
{code}
io.druid:druid-processing:jar:0.9.2.2.6.2.0-SNAPSHOT:compile
[INFO] | | \- org.roaringbitmap:RoaringBitmap:jar:0.5.18:compile
{code}
> Missmatch between roaring bitmap library used by druid and the one coming
> from tez
> ----------------------------------------------------------------------------------
>
> Key: HIVE-17303
> URL: https://issues.apache.org/jira/browse/HIVE-17303
> Project: Hive
> Issue Type: Bug
> Components: Druid integration
> Reporter: slim bouguerra
> Assignee: slim bouguerra
> Attachments: HIVE-17303.patch
>
>
> {code}
>
> Caused by: java.util.concurrent.ExecutionException:
> java.lang.NoSuchMethodError:
> org.roaringbitmap.buffer.MutableRoaringBitmap.runOptimize()Z
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.getValue(AbstractFuture.java:299)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture$Sync.get(AbstractFuture.java:286)
> at
> org.apache.hive.druid.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:116)
> at
> org.apache.hadoop.hive.druid.io.DruidRecordWriter.pushSegments(DruidRecordWriter.java:165)
> ... 25 more
> Caused by: java.lang.NoSuchMethodError:
> org.roaringbitmap.buffer.MutableRoaringBitmap.runOptimize()Z
> at
> org.apache.hive.druid.com.metamx.collections.bitmap.WrappedRoaringBitmap.toImmutableBitmap(WrappedRoaringBitmap.java:65)
> at
> org.apache.hive.druid.com.metamx.collections.bitmap.RoaringBitmapFactory.makeImmutableBitmap(RoaringBitmapFactory.java:88)
> at
> org.apache.hive.druid.io.druid.segment.StringDimensionMergerV9.writeIndexes(StringDimensionMergerV9.java:348)
> at
> org.apache.hive.druid.io.druid.segment.IndexMergerV9.makeIndexFiles(IndexMergerV9.java:218)
> at
> org.apache.hive.druid.io.druid.segment.IndexMerger.merge(IndexMerger.java:438)
> at
> org.apache.hive.druid.io.druid.segment.IndexMerger.persist(IndexMerger.java:186)
> at
> org.apache.hive.druid.io.druid.segment.IndexMerger.persist(IndexMerger.java:152)
> at
> org.apache.hive.druid.io.druid.segment.realtime.appenderator.AppenderatorImpl.persistHydrant(AppenderatorImpl.java:996)
> at
> org.apache.hive.druid.io.druid.segment.realtime.appenderator.AppenderatorImpl.access$200(AppenderatorImpl.java:93)
> at
> org.apache.hive.druid.io.druid.segment.realtime.appenderator.AppenderatorImpl$2.doCall(AppenderatorImpl.java:385)
> at
> org.apache.hive.druid.io.druid.common.guava.ThreadRenamingCallable.call(ThreadRenamingCallable.java:44)
> ... 4 more
> ]], Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1
> killedTasks:89, Vertex vertex_1502470020457_0005_12_05 [Reducer 2]
> killed/failed due to:OWN_TASK_FAILURE]DAG did not succeed due to
> VERTEX_FAILURE. failedVertices:1 killedVertices:0 (state=08S01,code=2)
> Options
> Attachments
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
