[GitHub] [druid] yuanlihan commented on issue #9889: Add new configuration for kill task to skip segments that has been last modified within the config value time

2020-05-21 Thread GitBox
yuanlihan commented on issue #9889: URL: https://github.com/apache/druid/issues/9889#issuecomment-631935055 @maytasm thanks for the explanation. It makes sense to me. This configuration will help a lot to reduce the impact of misoperation. --

[GitHub] [druid] liujianhuanzz opened a new pull request #9907: fix docs error in hadoop-based part

2020-05-21 Thread GitBox
liujianhuanzz opened a new pull request #9907: URL: https://github.com/apache/druid/pull/9907 ### Description There are several errors in the document. * missing type of `indexSpecForIntermediatePersists` of tuningConfig * table format error: `logParseExceptions` and `maxPa

[GitHub] [druid] vvararu opened a new issue #9908: GroupBy returns multiple records for the same group after intermediate flush to disk when querying real-time with a multi-value dimension involved

2020-05-21 Thread GitBox
vvararu opened a new issue #9908: URL: https://github.com/apache/druid/issues/9908 ### Affected Version Druid 0.17.0 ### Description Dependencies: - Kafka 2.12_1.0.1. Topic with 1 partition, no replication. Steps to reproduce: - Start a Kafka super

[GitHub] [druid] gianm commented on a change in pull request #9893: Add REGEXP_LIKE, fix bugs in REGEXP_EXTRACT.

2020-05-21 Thread GitBox
gianm commented on a change in pull request #9893: URL: https://github.com/apache/druid/pull/9893#discussion_r428757383 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/expression/OperatorConversions.java ## @@ -291,15 +294,15 @@ public OperatorBuilder operandTypes

[GitHub] [druid] gianm commented on a change in pull request #9893: Add REGEXP_LIKE, fix bugs in REGEXP_EXTRACT.

2020-05-21 Thread GitBox
gianm commented on a change in pull request #9893: URL: https://github.com/apache/druid/pull/9893#discussion_r428758597 ## File path: docs/querying/sql.md ## @@ -322,17 +322,18 @@ String functions accept strings, and return a type appropriate to the function. |`LOWER(expr)`|R

[GitHub] [druid] jihoonson commented on pull request #9905: Fix compact partially overlapping segments

2020-05-21 Thread GitBox
jihoonson commented on pull request #9905: URL: https://github.com/apache/druid/pull/9905#issuecomment-632190086 @yuanlihan thanks for the comment. I think now I understand your use case. > As far as I know Druid will correctly handle this in `DruidInputSource`. Or do I misunderstan

[GitHub] [druid] jihoonson commented on issue #9904: Fail to compact overlapping segments

2020-05-21 Thread GitBox
jihoonson commented on issue #9904: URL: https://github.com/apache/druid/issues/9904#issuecomment-632189936 Hi @yuanlihan, I believe the timeline is already handling the overlapping segments properly. Looking at the logs above, the issue seems like this: ``` org.apache.druid.java.

[GitHub] [druid] gianm commented on a change in pull request #9893: Add REGEXP_LIKE, fix bugs in REGEXP_EXTRACT.

2020-05-21 Thread GitBox
gianm commented on a change in pull request #9893: URL: https://github.com/apache/druid/pull/9893#discussion_r428780412 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/expression/OperatorConversions.java ## @@ -291,15 +294,15 @@ public OperatorBuilder operandTypes

[GitHub] [druid] gianm commented on a change in pull request #9893: Add REGEXP_LIKE, fix bugs in REGEXP_EXTRACT.

2020-05-21 Thread GitBox
gianm commented on a change in pull request #9893: URL: https://github.com/apache/druid/pull/9893#discussion_r428782087 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/expression/OperatorConversions.java ## @@ -430,36 +434,64 @@ public void inferOperandTypes(

[GitHub] [druid] gianm commented on a change in pull request #9893: Add REGEXP_LIKE, fix bugs in REGEXP_EXTRACT.

2020-05-21 Thread GitBox
gianm commented on a change in pull request #9893: URL: https://github.com/apache/druid/pull/9893#discussion_r428782343 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/expression/OperatorConversions.java ## @@ -291,15 +294,15 @@ public OperatorBuilder operandTypes

[GitHub] [druid] suneet-s commented on a change in pull request #9893: Add REGEXP_LIKE, fix bugs in REGEXP_EXTRACT.

2020-05-21 Thread GitBox
suneet-s commented on a change in pull request #9893: URL: https://github.com/apache/druid/pull/9893#discussion_r428792725 ## File path: processing/src/main/java/org/apache/druid/query/expression/RegexpLikeExprMacro.java ## @@ -0,0 +1,96 @@ +/* + * Licensed to the Apache Softw

[GitHub] [druid] suneet-s commented on a change in pull request #9893: Add REGEXP_LIKE, fix bugs in REGEXP_EXTRACT.

2020-05-21 Thread GitBox
suneet-s commented on a change in pull request #9893: URL: https://github.com/apache/druid/pull/9893#discussion_r428792725 ## File path: processing/src/main/java/org/apache/druid/query/expression/RegexpLikeExprMacro.java ## @@ -0,0 +1,96 @@ +/* + * Licensed to the Apache Softw

[GitHub] [druid] suneet-s commented on a change in pull request #9893: Add REGEXP_LIKE, fix bugs in REGEXP_EXTRACT.

2020-05-21 Thread GitBox
suneet-s commented on a change in pull request #9893: URL: https://github.com/apache/druid/pull/9893#discussion_r428808032 ## File path: sql/src/test/java/org/apache/druid/sql/calcite/CalciteQueryTest.java ## @@ -7300,6 +7301,74 @@ public void testRegexpExtract() throws Excepti

[GitHub] [druid] suneet-s commented on a change in pull request #9893: Add REGEXP_LIKE, fix bugs in REGEXP_EXTRACT.

2020-05-21 Thread GitBox
suneet-s commented on a change in pull request #9893: URL: https://github.com/apache/druid/pull/9893#discussion_r428809485 ## File path: sql/src/test/java/org/apache/druid/sql/calcite/CalciteQueryTest.java ## @@ -7300,6 +7301,74 @@ public void testRegexpExtract() throws Excepti

[GitHub] [druid] gianm commented on a change in pull request #9893: Add REGEXP_LIKE, fix bugs in REGEXP_EXTRACT.

2020-05-21 Thread GitBox
gianm commented on a change in pull request #9893: URL: https://github.com/apache/druid/pull/9893#discussion_r428827872 ## File path: sql/src/test/java/org/apache/druid/sql/calcite/CalciteQueryTest.java ## @@ -7300,6 +7301,74 @@ public void testRegexpExtract() throws Exception

[GitHub] [druid] gianm commented on a change in pull request #9893: Add REGEXP_LIKE, fix bugs in REGEXP_EXTRACT.

2020-05-21 Thread GitBox
gianm commented on a change in pull request #9893: URL: https://github.com/apache/druid/pull/9893#discussion_r428831347 ## File path: processing/src/main/java/org/apache/druid/query/expression/RegexpLikeExprMacro.java ## @@ -0,0 +1,96 @@ +/* + * Licensed to the Apache Software

[GitHub] [druid] gianm commented on a change in pull request #9731: ColumnCapabilities.hasMultipleValues refactor

2020-05-21 Thread GitBox
gianm commented on a change in pull request #9731: URL: https://github.com/apache/druid/pull/9731#discussion_r428840570 ## File path: processing/src/main/java/org/apache/druid/segment/incremental/IncrementalIndexStorageAdapter.java ## @@ -142,24 +141,8 @@ public Comparable get

[GitHub] [druid] suneet-s commented on a change in pull request #9893: Add REGEXP_LIKE, fix bugs in REGEXP_EXTRACT.

2020-05-21 Thread GitBox
suneet-s commented on a change in pull request #9893: URL: https://github.com/apache/druid/pull/9893#discussion_r428846660 ## File path: sql/src/test/java/org/apache/druid/sql/calcite/CalciteQueryTest.java ## @@ -7300,6 +7301,74 @@ public void testRegexpExtract() throws Excepti

[druid] branch master updated (ca5e66d -> b91d500)

2020-05-21 Thread ccaominh
This is an automated email from the ASF dual-hosted git repository. ccaominh pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from ca5e66d Fixed the Copyright year of Druid (#9859) add b91d500 add some details to the build doc (#9885) No n

[GitHub] [druid] ccaominh merged pull request #9885: add some details to the build doc

2020-05-21 Thread GitBox
ccaominh merged pull request #9885: URL: https://github.com/apache/druid/pull/9885 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [druid] vogievetsky commented on pull request #9887: Re-order and document format detection in web console

2020-05-21 Thread GitBox
vogievetsky commented on pull request #9887: URL: https://github.com/apache/druid/pull/9887#issuecomment-632308074 Love it. Makes total sense. Out of curiosity was this change motivated by something you saw IRL that tripped up the current system? --

[GitHub] [druid] clintropolis merged pull request #9897: Fix web console query view crashing on simple query

2020-05-21 Thread GitBox
clintropolis merged pull request #9897: URL: https://github.com/apache/druid/pull/9897 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[druid] branch master updated (b91d500 -> 63baa29)

2020-05-21 Thread cwylie
This is an automated email from the ASF dual-hosted git repository. cwylie pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from b91d500 add some details to the build doc (#9885) add 63baa29 Fix web console query view crashing on simple que

[GitHub] [druid] vogievetsky commented on pull request #9887: Re-order and document format detection in web console

2020-05-21 Thread GitBox
vogievetsky commented on pull request #9887: URL: https://github.com/apache/druid/pull/9887#issuecomment-632396654 Oh I guess you saw a binary file that happened to have more than 3 tabs or commas... This is an automated mes

[GitHub] [druid] vogievetsky merged pull request #9887: Re-order and document format detection in web console

2020-05-21 Thread GitBox
vogievetsky merged pull request #9887: URL: https://github.com/apache/druid/pull/9887 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[druid] branch master updated: Re-order and document format detection in web console (#9887)

2020-05-21 Thread vogievetsky
This is an automated email from the ASF dual-hosted git repository. vogievetsky pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid.git The following commit(s) were added to refs/heads/master by this push: new 132a1c9 Re-order and document format detect

[GitHub] [druid] averma111 opened a new issue #9909: Need to fix twist lock vulnerabilities for Google Cloud Kubernetes Engine

2020-05-21 Thread GitBox
averma111 opened a new issue #9909: URL: https://github.com/apache/druid/issues/9909 Druid Version : 0.18.1 version. There 5 high priority vulnerabilities which have poped up. They are give below: Jackson Guava netty log4j logging-log4j. I am trying to bui

[GitHub] [druid] yuanlihan commented on issue #9904: Fail to compact overlapping segments

2020-05-21 Thread GitBox
yuanlihan commented on issue #9904: URL: https://github.com/apache/druid/issues/9904#issuecomment-632448083 Hi @jihoonson > This log means, you got two segments of overlapping intervals and same version. This is never allowed since Druid doesn't know what segment to read in this case.

[GitHub] [druid] maytasm opened a new pull request #9910: Update doc on tmp dir (java.io.tmpdir) best practice

2020-05-21 Thread GitBox
maytasm opened a new pull request #9910: URL: https://github.com/apache/druid/pull/9910 Update doc on tmp dir (java.io.tmpdir) best practice ### Description We have had issue where our /mnt/tmp is an NFS mount. This can causes the intermediate persist of our streaming ingestio

[GitHub] [druid] cloventt opened a new issue #9911: Sorting on the value of an injective lookup returns incorrect order

2020-05-21 Thread GitBox
cloventt opened a new issue #9911: URL: https://github.com/apache/druid/issues/9911 ### Affected Version 0.17.0 ### Description We have been using injective lookups to perform a one-to-one mapping between an ID and some model data. However, when we construct a query to

[GitHub] [druid] cloventt commented on issue #9911: Sorting on the value of an injective lookup returns incorrect order

2020-05-21 Thread GitBox
cloventt commented on issue #9911: URL: https://github.com/apache/druid/issues/9911#issuecomment-632469480 This is roughly the query we are running: ```json { "queryType": "groupBy", "dataSource": { "type": "table", "name": "test-datasource" }, "in

[GitHub] [druid] cloventt edited a comment on issue #9911: Sorting on the value of an injective lookup returns incorrect order

2020-05-21 Thread GitBox
cloventt edited a comment on issue #9911: URL: https://github.com/apache/druid/issues/9911#issuecomment-632469480 This is roughly the query we are running: ```json { "queryType": "groupBy", "dataSource": { "type": "table", "name": "test-datasource" },

[GitHub] [druid] 2bethere commented on a change in pull request #9879: Querying doc refresh tutorial

2020-05-21 Thread GitBox
2bethere commented on a change in pull request #9879: URL: https://github.com/apache/druid/pull/9879#discussion_r429039250 ## File path: docs/querying/querying.md ## @@ -44,7 +49,7 @@ The Content-Type/Accept Headers can also take 'application/x-jackson-smile'. curl -X POST ':

[GitHub] [druid] xvrl opened a new issue #9912: coordinator restart during index task shutdown may cause succesful task to get failed

2020-05-21 Thread GitBox
xvrl opened a new issue #9912: URL: https://github.com/apache/druid/issues/9912 ### Affected Version 0.17.0 ### Description We got a little unlucky and hit some edge case in the task handling during coordinator restart. If a task taskes a little too long to shutdown,

[GitHub] [druid] stale[bot] commented on issue #8097: Custom Json extractors for Kafka lookup module

2020-05-21 Thread GitBox
stale[bot] commented on issue #8097: URL: https://github.com/apache/druid/issues/8097#issuecomment-632508972 This issue has been closed due to lack of activity. If you think that is incorrect, or the issue requires additional review, you can revive the issue at any time.

[GitHub] [druid] stale[bot] closed issue #8097: Custom Json extractors for Kafka lookup module

2020-05-21 Thread GitBox
stale[bot] closed issue #8097: URL: https://github.com/apache/druid/issues/8097 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the