[GitHub] [druid] averma111 commented on issue #9780: Support directly reading and writing Druid data from Spark

2020-08-20 Thread GitBox
averma111 commented on issue #9780: URL: https://github.com/apache/druid/issues/9780#issuecomment-678035280 Also as per the design document https://github.com/metamx/druid-spark-batch is option for writing into Druid. but the build is failing. Can I get some help.

[GitHub] [druid] averma111 commented on issue #9780: Support directly reading and writing Druid data from Spark

2020-08-20 Thread GitBox
averma111 commented on issue #9780: URL: https://github.com/apache/druid/issues/9780#issuecomment-678033439 @mangrrua and @JulianJaffePinterest I am very thankful to your guys for the work of spark connector to druid. Can I package this jar and make it working with current druid 0.18.1 v

[GitHub] [druid] klDen commented on issue #9207: Load streaming data from Apache Kafka Problem

2020-08-20 Thread GitBox
klDen commented on issue #9207: URL: https://github.com/apache/druid/issues/9207#issuecomment-677972453 I faced the same issue running in docker containers. The issue was the docker service was running as another user. What resolved it temporarily was to make the local volume **storage**

[GitHub] [druid] jon-wei edited a comment on issue #9380: Fine grained config and state resources

2020-08-20 Thread GitBox
jon-wei edited a comment on issue #9380: URL: https://github.com/apache/druid/issues/9380#issuecomment-677957679 @pjain1 > For both compaction and load rule I thought it more intuitive to bind read with read and write with write. Should we just add a new resource type like DATASOUR

[GitHub] [druid] jon-wei commented on issue #9380: Fine grained config and state resources

2020-08-20 Thread GitBox
jon-wei commented on issue #9380: URL: https://github.com/apache/druid/issues/9380#issuecomment-677957679 @pjain1 > For both compaction and load rule I thought it more intuitive to bind read with read and write with write. Should we just add a new resource type like DATASOURCE-CONF

[druid-website-src] branch master updated: Update druid-powered.md

2020-08-20 Thread fjy
This is an automated email from the ASF dual-hosted git repository. fjy pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid-website-src.git The following commit(s) were added to refs/heads/master by this push: new 8e21b5d Update druid-powered.md 8e21b5d

[GitHub] [druid] abhishekrb19 commented on issue #10283: Druid SQL: Querying a new data source with no data returns a CalciteContextException.

2020-08-20 Thread GitBox
abhishekrb19 commented on issue #10283: URL: https://github.com/apache/druid/issues/10283#issuecomment-677909367 @gianm, thanks for the clarification. > Data that's currently only available from the realtime indexing system is still good enough to update the SQL metadata. Would that

[druid] branch master updated (618c04a -> 7620b0c)

2020-08-20 Thread cwylie
This is an automated email from the ASF dual-hosted git repository. cwylie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from 618c04a Fix CombiningFirehose compatibility (#10264) add 7620b0c Segment backed broadcast join IndexedTable (#1

[GitHub] [druid] clintropolis merged pull request #10224: Segment backed broadcast join IndexedTable

2020-08-20 Thread GitBox
clintropolis merged pull request #10224: URL: https://github.com/apache/druid/pull/10224 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [druid] mangrrua commented on issue #9780: Support directly reading and writing Druid data from Spark

2020-08-20 Thread GitBox
mangrrua commented on issue #9780: URL: https://github.com/apache/druid/issues/9780#issuecomment-677879134 Hello @JulianJaffePinterest Do you still work on this connector? We may improve this connector, but for the first version your source code seems good. --

[GitHub] [druid] mangrrua commented on issue #9835: Spark built in connector for Druid

2020-08-20 Thread GitBox
mangrrua commented on issue #9835: URL: https://github.com/apache/druid/issues/9835#issuecomment-677875718 Check issue #9780 for batch read/write operation This is an automated message from the Apache Git Service. To respond

[GitHub] [druid-website-src] druid-matt commented on pull request #150: fix broken links to docs

2020-08-20 Thread GitBox
druid-matt commented on pull request #150: URL: https://github.com/apache/druid-website-src/pull/150#issuecomment-677868428 the relative link was leading to a redirect that was breaking https and Google ranking doesn't like that On Thu, Aug 20, 2020 at 12:36 PM Gian Merlino wro

[GitHub] [druid] gianm commented on a change in pull request #10279: Add SQL "OFFSET" clause.

2020-08-20 Thread GitBox
gianm commented on a change in pull request #10279: URL: https://github.com/apache/druid/pull/10279#discussion_r474232782 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuery.java ## @@ -897,6 +906,11 @@ public GroupByQuery toGroupByQuery() return

[GitHub] [druid] clintropolis commented on a change in pull request #10279: Add SQL "OFFSET" clause.

2020-08-20 Thread GitBox
clintropolis commented on a change in pull request #10279: URL: https://github.com/apache/druid/pull/10279#discussion_r474231095 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuery.java ## @@ -897,6 +906,11 @@ public GroupByQuery toGroupByQuery()

[GitHub] [druid] gianm edited a comment on issue #10282: Druid SQL: A sub-query with expressions returns no data potentially due to an incorrect Query plan.

2020-08-20 Thread GitBox
gianm edited a comment on issue #10282: URL: https://github.com/apache/druid/issues/10282#issuecomment-677862016 Hmm, in general it should be OK to move a HAVING from an inner query to the WHERE of an outer query. That's what seems to be happening here. It doesn't look like a smoking gun t

[GitHub] [druid] gianm commented on issue #10282: Druid SQL: A sub-query with expressions returns no data potentially due to an incorrect Query plan.

2020-08-20 Thread GitBox
gianm commented on issue #10282: URL: https://github.com/apache/druid/issues/10282#issuecomment-677862016 Hmm, in general it should be OK to move a HAVING from an inner query to the WHERE of an outer query. That's what seems to be happening here. It doesn't look like a smoking gun to me. B

[GitHub] [druid-website-src] gianm merged pull request #151: fix broken link to Docs

2020-08-20 Thread GitBox
gianm merged pull request #151: URL: https://github.com/apache/druid-website-src/pull/151 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[druid-website-src] branch master updated: fix broken link to Docs

2020-08-20 Thread gian
This is an automated email from the ASF dual-hosted git repository. gian pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid-website-src.git The following commit(s) were added to refs/heads/master by this push: new 001b8d6 fix broken link to Docs n

[GitHub] [druid-website-src] gianm commented on a change in pull request #150: fix broken links to docs

2020-08-20 Thread GitBox
gianm commented on a change in pull request #150: URL: https://github.com/apache/druid-website-src/pull/150#discussion_r474224670 ## File path: community/index.md ## @@ -52,9 +52,9 @@ If you're looking for some starter projects, we maintain a [list of issues](http for new dev

[druid-website-src] branch master updated: fix /community/ link

2020-08-20 Thread gian
This is an automated email from the ASF dual-hosted git repository. gian pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid-website-src.git The following commit(s) were added to refs/heads/master by this push: new 9002f21 fix /community/ link new

[GitHub] [druid-website-src] gianm merged pull request #154: fix /community/ link

2020-08-20 Thread GitBox
gianm merged pull request #154: URL: https://github.com/apache/druid-website-src/pull/154 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [druid-website-src] gianm merged pull request #153: fix /community/ link

2020-08-20 Thread GitBox
gianm merged pull request #153: URL: https://github.com/apache/druid-website-src/pull/153 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[druid-website-src] branch master updated: fix link to basic-cluster-tuning.html

2020-08-20 Thread gian
This is an automated email from the ASF dual-hosted git repository. gian pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid-website-src.git The following commit(s) were added to refs/heads/master by this push: new da3a8f3 fix link to basic-cluster-tuni

[GitHub] [druid-website-src] gianm merged pull request #152: fix link to basic-cluster-tuning.html

2020-08-20 Thread GitBox
gianm merged pull request #152: URL: https://github.com/apache/druid-website-src/pull/152 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[druid-website-src] branch master updated: fix /community/ link

2020-08-20 Thread gian
This is an automated email from the ASF dual-hosted git repository. gian pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid-website-src.git The following commit(s) were added to refs/heads/master by this push: new add6ccd fix /community/ link new

[GitHub] [druid] gianm commented on issue #10283: Druid SQL: Querying a new data source with no data returns a CalciteContextException.

2020-08-20 Thread GitBox
gianm commented on issue #10283: URL: https://github.com/apache/druid/issues/10283#issuecomment-677859327 This one is interesting. Our SQL metadata is based on doing segment metadata queries. (We look at all the active segments and build a table schema based on what columns are found

[GitHub] [druid] gianm commented on a change in pull request #10279: Add SQL "OFFSET" clause.

2020-08-20 Thread GitBox
gianm commented on a change in pull request #10279: URL: https://github.com/apache/druid/pull/10279#discussion_r474217036 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuery.java ## @@ -762,9 +756,20 @@ public TimeseriesQuery toTimeseriesQuery()

[GitHub] [druid] gianm commented on pull request #10279: Add SQL "OFFSET" clause.

2020-08-20 Thread GitBox
gianm commented on pull request #10279: URL: https://github.com/apache/druid/pull/10279#issuecomment-677854285 @clintropolis Any other comments or should we merge this? This is an automated message from the Apache Git Service

[GitHub] [druid] jihoonson commented on a change in pull request #10243: Add maxNumFiles to splitHintSpec

2020-08-20 Thread GitBox
jihoonson commented on a change in pull request #10243: URL: https://github.com/apache/druid/pull/10243#discussion_r474171560 ## File path: core/src/main/java/org/apache/druid/data/input/MaxSizeSplitHintSpec.java ## @@ -43,22 +45,55 @@ public static final String TYPE = "max

[GitHub] [druid] suneet-s commented on pull request #10264: Fix CombiningFirehose compatibility

2020-08-20 Thread GitBox
suneet-s commented on pull request #10264: URL: https://github.com/apache/druid/pull/10264#issuecomment-677802941 Verified by running the tutorial locally. Thanks again @a2l007 ! This is an automated message from the Apache G

[GitHub] [druid] suneet-s merged pull request #10264: Fix CombiningFirehose compatibility

2020-08-20 Thread GitBox
suneet-s merged pull request #10264: URL: https://github.com/apache/druid/pull/10264 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [druid] suneet-s closed issue #9389: CombiningFirehoseFactory cannot be cast to FiniteFirehoseFactory

2020-08-20 Thread GitBox
suneet-s closed issue #9389: URL: https://github.com/apache/druid/issues/9389 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[druid] branch master updated (b36dab0 -> 618c04a)

2020-08-20 Thread suneet
This is an automated email from the ASF dual-hosted git repository. suneet pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from b36dab0 fix connectionId issue with JDBC prepared statement queries and router (#10272) add 618c04a Fix Combi

[GitHub] [druid] lgtm-com[bot] commented on pull request #10304: WIP: Add vectorization for druid-histogram extension

2020-08-20 Thread GitBox
lgtm-com[bot] commented on pull request #10304: URL: https://github.com/apache/druid/pull/10304#issuecomment-677723556 This pull request **fixes 1 alert** when merging 55401cde3715db3baec2d617cbcef7131713fee2 into b36dab0fe65557e4aaf675423d61bdaa51501a71 - [view on LGTM.com](https://lgtm.

[GitHub] [druid] badalgeek commented on pull request #9579: Add Apache Ranger Authorization

2020-08-20 Thread GitBox
badalgeek commented on pull request #9579: URL: https://github.com/apache/druid/pull/9579#issuecomment-677720282 @bolkedebruin Could you please provide ranger-servicedef-druid.json as specified in the documentation. This

[GitHub] [druid] abhishekagarwal87 commented on a change in pull request #10304: WIP: Add vectorization for druid-histogram extension

2020-08-20 Thread GitBox
abhishekagarwal87 commented on a change in pull request #10304: URL: https://github.com/apache/druid/pull/10304#discussion_r474040705 ## File path: extensions-core/histogram/src/main/java/org/apache/druid/query/aggregation/histogram/FixedBucketsHistogramBufferAggregatorInternal.java #

[GitHub] [druid] abhishekagarwal87 opened a new pull request #10304: WIP: Add vectorization for druid-histogram extension

2020-08-20 Thread GitBox
abhishekagarwal87 opened a new pull request #10304: URL: https://github.com/apache/druid/pull/10304 ### Description This PR adds vectorization support for Aggregators in the `druid-histogram` extension. While these changes are unlikely to result in the usage of SIMD instructions

[GitHub] [druid] clintropolis commented on a change in pull request #10279: Add SQL "OFFSET" clause.

2020-08-20 Thread GitBox
clintropolis commented on a change in pull request #10279: URL: https://github.com/apache/druid/pull/10279#discussion_r473853234 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuery.java ## @@ -762,9 +756,20 @@ public TimeseriesQuery toTimeseriesQuery()

[GitHub] [druid] clintropolis commented on a change in pull request #10279: Add SQL "OFFSET" clause.

2020-08-20 Thread GitBox
clintropolis commented on a change in pull request #10279: URL: https://github.com/apache/druid/pull/10279#discussion_r473853234 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuery.java ## @@ -762,9 +756,20 @@ public TimeseriesQuery toTimeseriesQuery()

[GitHub] [druid] clintropolis commented on a change in pull request #10279: Add SQL "OFFSET" clause.

2020-08-20 Thread GitBox
clintropolis commented on a change in pull request #10279: URL: https://github.com/apache/druid/pull/10279#discussion_r473832613 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/rel/DruidQuery.java ## @@ -762,9 +756,20 @@ public TimeseriesQuery toTimeseriesQuery()

[GitHub] [druid] clintropolis commented on a change in pull request #10243: Add maxNumFiles to splitHintSpec

2020-08-20 Thread GitBox
clintropolis commented on a change in pull request #10243: URL: https://github.com/apache/druid/pull/10243#discussion_r473797085 ## File path: core/src/main/java/org/apache/druid/data/input/MaxSizeSplitHintSpec.java ## @@ -43,22 +45,55 @@ public static final String TYPE = "

[GitHub] [druid] jihoonson commented on a change in pull request #10243: Add maxNumFiles to splitHintSpec

2020-08-20 Thread GitBox
jihoonson commented on a change in pull request #10243: URL: https://github.com/apache/druid/pull/10243#discussion_r473691192 ## File path: core/src/main/java/org/apache/druid/data/input/MaxSizeSplitHintSpec.java ## @@ -43,22 +45,55 @@ public static final String TYPE = "max