[GitHub] [druid] senthilkv opened a new issue #10668: Compressed Big Decimal

senthilkv opened a new issue #10668: URL: https://github.com/apache/druid/issues/10668 ### Description Currently in Druid for aggregation of currency based calculations has to be done using longSum, doubleSum or floatSum. Especially doubleSum and floatSum could create issues on

[GitHub] [druid] zhangyue19921010 commented on pull request #10667: Make some additions to IT suite to make Hadoop related testing more understandable

zhangyue19921010 commented on pull request #10667: URL: https://github.com/apache/druid/pull/10667#issuecomment-742907969 Hi @capistrant, Recently I also encountered IT-related problems. And this PR made my job a lot easier! Thanks for this contribution.

[GitHub] [druid] lgtm-com[bot] commented on pull request #10660: fix DruidSchema incorrectly listing tables with no segments

lgtm-com[bot] commented on pull request #10660: URL: https://github.com/apache/druid/pull/10660#issuecomment-742851207 This pull request **introduces 1 alert** when merging 32ecbf710e2e0f3c5ab42b301ce110cfe340b43c into 753fa6b3bd3512ab8e8112e55be2aff667a845c4 - [view on

[GitHub] [druid] maytasm commented on pull request #10667: Make some additions to IT suite to make Hadoop related testing more understandable

maytasm commented on pull request #10667: URL: https://github.com/apache/druid/pull/10667#issuecomment-742839022 > > @capistrant Have you run these tests? (Or do they run in Travis CI automatically, which would be even better?) > > If these changes work properly, then they look good to

[GitHub] [druid] gianm commented on pull request #10667: Make some additions to IT suite to make Hadoop related testing more understandable

gianm commented on pull request #10667: URL: https://github.com/apache/druid/pull/10667#issuecomment-742832075 > None of the hadoop related integration test groups are a part of CI. Why that is, I am not totally sure. Could be for runtime, perhaps? At any rate, I'm less

[GitHub] [druid] clintropolis commented on a change in pull request #10660: fix DruidSchema incorrectly listing tables with no segments

clintropolis commented on a change in pull request #10660: URL: https://github.com/apache/druid/pull/10660#discussion_r540512071 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/schema/DruidSchema.java ## @@ -448,25 +449,27 @@ void removeServerSegment(final

[GitHub] [druid] clintropolis commented on a change in pull request #10660: fix DruidSchema incorrectly listing tables with no segments

clintropolis commented on a change in pull request #10660: URL: https://github.com/apache/druid/pull/10660#discussion_r540509717 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/schema/DruidSchema.java ## @@ -448,25 +449,27 @@ void removeServerSegment(final

[GitHub] [druid] gianm commented on a change in pull request #10660: fix DruidSchema incorrectly listing tables with no segments

gianm commented on a change in pull request #10660: URL: https://github.com/apache/druid/pull/10660#discussion_r540496147 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/schema/DruidSchema.java ## @@ -448,25 +449,27 @@ void removeServerSegment(final

[GitHub] [druid] clintropolis commented on a change in pull request #10660: fix DruidSchema incorrectly listing tables with no segments

clintropolis commented on a change in pull request #10660: URL: https://github.com/apache/druid/pull/10660#discussion_r540481700 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/schema/DruidSchema.java ## @@ -448,25 +449,27 @@ void removeServerSegment(final

[GitHub] [druid] maytasm closed pull request #10625: Add option for maxBytesInMemory to be percentage of JVM memory

maytasm closed pull request #10625: URL: https://github.com/apache/druid/pull/10625 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [druid] maytasm commented on pull request #10625: Add option for maxBytesInMemory to be percentage of JVM memory

maytasm commented on pull request #10625: URL: https://github.com/apache/druid/pull/10625#issuecomment-742781819 @jon-wei @liran-funaro Thank you all for the feedback. I've decided to close this PR for now and will open a separate PR later with making a new separate parameter that

[GitHub] [druid] capistrant commented on pull request #10667: Make some additions to IT suite to make Hadoop related testing more understandable

capistrant commented on pull request #10667: URL: https://github.com/apache/druid/pull/10667#issuecomment-742769404 > @capistrant Have you run these tests? (Or do they run in Travis CI automatically, which would be even better?) > > If these changes work properly, then they look

[GitHub] [druid] remizyaka commented on issue #10508: Kill task launched from web console is stuck

remizyaka commented on issue #10508: URL: https://github.com/apache/druid/issues/10508#issuecomment-742738605 You can always suspend supervisor, wait till kill task finished and after that - resume supervisor. This is an

[GitHub] [druid] a2l007 commented on a change in pull request #10593: IncrementalIndex Tests and Benchmarks Parametrization

a2l007 commented on a change in pull request #10593: URL: https://github.com/apache/druid/pull/10593#discussion_r539593442 ## File path: processing/src/main/java/org/apache/druid/segment/generator/DataGenerator.java ## @@ -143,4 +151,54 @@ private long nextTimestamp() }

[GitHub] [druid] gianm commented on a change in pull request #10660: fix DruidSchema incorrectly listing tables with no segments

gianm commented on a change in pull request #10660: URL: https://github.com/apache/druid/pull/10660#discussion_r540414930 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/schema/DruidSchema.java ## @@ -448,25 +449,27 @@ void removeServerSegment(final

[druid] branch master updated (be01976 -> 753fa6b)

This is an automated email from the ASF dual-hosted git repository. gian pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from be01976 document DynamicConfigProvider for kafka consumer properties (#10658) add 753fa6b IdUtils: Forbid

[GitHub] [druid] gianm merged pull request #10659: IdUtils: Forbid characters that cannot be used in znodes.

gianm merged pull request #10659: URL: https://github.com/apache/druid/pull/10659 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [druid] shrivardhan92 commented on issue #10652: Segments present in historical local cache but not queryable - index_parallel

shrivardhan92 commented on issue #10652: URL: https://github.com/apache/druid/issues/10652#issuecomment-742696594 After some debugging I was able to find out that segments that belong to the particular which are missing. Looking into the

[druid] branch master updated: document DynamicConfigProvider for kafka consumer properties (#10658)

This is an automated email from the ASF dual-hosted git repository. himanshug pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid.git The following commit(s) were added to refs/heads/master by this push: new be01976 document DynamicConfigProvider for

[GitHub] [druid] himanshug merged pull request #10658: document DynamicConfigProvider for kafka consumer properties

himanshug merged pull request #10658: URL: https://github.com/apache/druid/pull/10658 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [druid] capistrant removed a comment on issue #10639: Quickstart Hadoop Container is built off of very old base image

capistrant removed a comment on issue #10639: URL: https://github.com/apache/druid/issues/10639#issuecomment-742626507 Fixed by https://github.com/apache/druid/pull/10638 This is an automated message from the Apache Git

[GitHub] [druid] capistrant closed issue #10639: Quickstart Hadoop Container is built off of very old base image

capistrant closed issue #10639: URL: https://github.com/apache/druid/issues/10639 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [druid] capistrant commented on issue #10639: Quickstart Hadoop Container is built off of very old base image

capistrant commented on issue #10639: URL: https://github.com/apache/druid/issues/10639#issuecomment-742626619 Fixed by https://github.com/apache/druid/pull/10638 This is an automated message from the Apache Git Service. To

[GitHub] [druid] capistrant closed pull request #10640: Temporary work-a-rounds for building the hadoop container

capistrant closed pull request #10640: URL: https://github.com/apache/druid/pull/10640 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [druid] capistrant commented on issue #10639: Quickstart Hadoop Container is built off of very old base image

capistrant commented on issue #10639: URL: https://github.com/apache/druid/issues/10639#issuecomment-742626507 Fixed by https://github.com/apache/druid/pull/10638 This is an automated message from the Apache Git Service. To

[GitHub] [druid] capistrant commented on pull request #10640: Temporary work-a-rounds for building the hadoop container

capistrant commented on pull request #10640: URL: https://github.com/apache/druid/pull/10640#issuecomment-742626206 https://github.com/apache/druid/pull/10638 This was a better fix than mine! This is an automated message

[GitHub] [druid] capistrant opened a new pull request #10667: Make some additions to IT suite to make Hadoop related testing more understandable

capistrant opened a new pull request #10667: URL: https://github.com/apache/druid/pull/10667 ### Description I have been working on some code the past week that involves running the Hadoop Integration Tests. I found the README

[GitHub] [druid] clintropolis opened a new pull request #10666: refactor numeric primitive aggregators in sql compatible mode

clintropolis opened a new pull request #10666: URL: https://github.com/apache/druid/pull/10666 ### Description #10219 added `hasNulls` to `ColumnCapabilities`, allowing things to know if a column has any null values in SQL compatible mode

[GitHub] [druid] josephglanville opened a new issue #10665: Support Confluent Schema Registry for Protobuf

josephglanville opened a new issue #10665: URL: https://github.com/apache/druid/issues/10665 ### Description Support looking up Protobuf schemas from the Confluent Schema Registry during streaming ingestion. ### Motivation This is currently supported for Avro using the

[GitHub] [druid] clintropolis commented on a change in pull request #10660: fix DruidSchema incorrectly listing tables with no segments

clintropolis commented on a change in pull request #10660: URL: https://github.com/apache/druid/pull/10660#discussion_r539987326 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/schema/DruidSchema.java ## @@ -270,8 +270,15 @@ public void start() throws

[GitHub] [druid] Mrxiashu commented on pull request #10524: Dynamic auto scale Kafka-Stream ingest tasks

Mrxiashu commented on pull request #10524: URL: https://github.com/apache/druid/pull/10524#issuecomment-742369617 In my opinion, the dynamic scaling taskcount operation is related to the number of partitions in Kafka. when the data traffic increases, the taskcount has been adjusted to the