[GitHub] [druid] abhishekagarwal87 commented on a change in pull request #10680: integration test for coordinator and overlord leadership client

abhishekagarwal87 commented on a change in pull request #10680: URL: https://github.com/apache/druid/pull/10680#discussion_r543106571 ## File path: sql/src/main/java/org/apache/druid/sql/calcite/schema/SystemSchema.java ## @@ -586,7 +638,8 @@ public TableType

[druid] branch master updated: Fix hadoop docker copy script (#10671)

This is an automated email from the ASF dual-hosted git repository. jihoonson pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid.git The following commit(s) were added to refs/heads/master by this push: new 7a8e9bb Fix hadoop docker copy script

[GitHub] [druid] jihoonson merged pull request #10671: Fix copy_hadoop_resources script in IT

jihoonson merged pull request #10671: URL: https://github.com/apache/druid/pull/10671 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [druid] zhangyue19921010 edited a comment on issue #10542: Create a travis build that runs Druid on a K8S Cluster and runs the integration tests

zhangyue19921010 edited a comment on issue #10542: URL: https://github.com/apache/druid/issues/10542#issuecomment-745067971 Hi @himanshug , I just make a PR https://github.com/apache/druid/pull/10669. This PR add a new IT Job `71`: 1. Deploy a K8s cluster based on minikube. 2.

[GitHub] [druid] abhishekagarwal87 commented on pull request #10642: Correctly handle null values in time column results

abhishekagarwal87 commented on pull request #10642: URL: https://github.com/apache/druid/pull/10642#issuecomment-745087613 LGTM. This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [druid] zhangyue19921010 edited a comment on pull request #10680: integration test for coordinator and overlord leadership client

zhangyue19921010 edited a comment on pull request #10680: URL: https://github.com/apache/druid/pull/10680#issuecomment-745080942 Nice idea! And I have made a PR https://github.com/apache/druid/pull/10669 which run IT for druid on K8s. Maybe it can be helpful here :)

[GitHub] [druid] zhangyue19921010 edited a comment on pull request #10680: integration test for coordinator and overlord leadership client

zhangyue19921010 edited a comment on pull request #10680: URL: https://github.com/apache/druid/pull/10680#issuecomment-745080942 Nice idea! And I have made a PR https://github.com/apache/druid/pull/10669 which run IT for druid on K8s. Maybe it can be helpful here. :)

[GitHub] [druid] zhangyue19921010 commented on pull request #10680: integration test for coordinator and overlord leadership client

zhangyue19921010 commented on pull request #10680: URL: https://github.com/apache/druid/pull/10680#issuecomment-745080942 Nice idea! And I have made a PR https://github.com/apache/druid/pull/10669 which run IT for druid on K8s. Maybe it can be helpful here.

[GitHub] [druid] clintropolis opened a new pull request #10680: integration test for coordinator and overlord leadership client

clintropolis opened a new pull request #10680: URL: https://github.com/apache/druid/pull/10680 ### Description This PR adds integration tests that try to get some coverage of coordinator and overlord leadership changes, using queries against system tables and then cycling which

[GitHub] [druid] zhangyue19921010 commented on pull request #10650: Historical load Segments enhancement

zhangyue19921010 commented on pull request #10650: URL: https://github.com/apache/druid/pull/10650#issuecomment-745071334 @himanshug Thanks for your review and merge! This is an automated message from the Apache Git Service.

[GitHub] [druid] zhangyue19921010 edited a comment on issue #10542: Create a travis build that runs Druid on a K8S Cluster and runs the integration tests

zhangyue19921010 edited a comment on issue #10542: URL: https://github.com/apache/druid/issues/10542#issuecomment-745067971 Hi @himanshug , I just make a PR linked before. This PR add a new IT Job `71`: 1. Deploy a K8s cluster based on minikube. 2. Deploy Druid cluster on K8s:

[GitHub] [druid] zhangyue19921010 edited a comment on issue #10542: Create a travis build that runs Druid on a K8S Cluster and runs the integration tests

zhangyue19921010 edited a comment on issue #10542: URL: https://github.com/apache/druid/issues/10542#issuecomment-745067971 Hi @himanshug , I just make a PR linked before. This PR add a new IT Job `71`: 1. Deploy a K8s cluster based on minikube. 2. Deploy Druid cluster on K8s:

[GitHub] [druid] zhangyue19921010 commented on issue #10542: Create a travis build that runs Druid on a K8S Cluster and runs the integration tests

zhangyue19921010 commented on issue #10542: URL: https://github.com/apache/druid/issues/10542#issuecomment-745067971 Hi @himanshug , I just make a PR linked before. This PR add a new IT Job `71`: Deploy a K8s cluster based on minikube. Deploy Druid cluster on K8s: single Druid, use

[GitHub] [druid] zhangyue19921010 commented on pull request #10669: [WIP] Do Integrate test base on K8s

zhangyue19921010 commented on pull request #10669: URL: https://github.com/apache/druid/pull/10669#issuecomment-745067417 This PR add a new IT Job `71`: 1. Deploy a K8s cluster based on minikube. 2. Deploy Druid cluster on K8s: single Druid, use local disk as Deep Storage and use

[druid] branch master updated (c2e26d2 -> ac1882b)

This is an automated email from the ASF dual-hosted git repository. himanshug pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from c2e26d2 Add status/selfDiscovered endpoint to indexer for self discovery of indexer (#10679) add ac1882b

[GitHub] [druid] himanshug merged pull request #10544: kubernetes based discovery druid extension to run Druid on K8S without Zookeeper

himanshug merged pull request #10544: URL: https://github.com/apache/druid/pull/10544 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [druid] himanshug closed issue #9053: [Proposal] Druid discovery extension for Kubernetes

himanshug closed issue #9053: URL: https://github.com/apache/druid/issues/9053 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [druid] himanshug commented on a change in pull request #10544: kubernetes based discovery druid extension to run Druid on K8S without Zookeeper

himanshug commented on a change in pull request #10544: URL: https://github.com/apache/druid/pull/10544#discussion_r543050899 ## File path: extensions-core/kubernetes-extensions/src/main/java/org/apache/druid/k8s/discovery/DiscoveryDruidNodeList.java ## @@ -0,0 +1,51 @@ +/* +

[GitHub] [druid] zhangyue19921010 closed pull request #10669: [WIP] Do Integrate test base on K8s

zhangyue19921010 closed pull request #10669: URL: https://github.com/apache/druid/pull/10669 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [druid] zhangyue19921010 commented on pull request #10669: [WIP] Do Integrate test base on K8s

zhangyue19921010 commented on pull request #10669: URL: https://github.com/apache/druid/pull/10669#issuecomment-745041271 re-start to trigger CI again. This is an automated message from the Apache Git Service. To respond to

[druid] branch master updated: Add status/selfDiscovered endpoint to indexer for self discovery of indexer (#10679)

This is an automated email from the ASF dual-hosted git repository. xvrl pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/druid.git The following commit(s) were added to refs/heads/master by this push: new c2e26d2 Add status/selfDiscovered endpoint to

[GitHub] [druid] xvrl commented on pull request #10679: Adding example config files for indexer process. Also added status/selfDiscovered endpoint to indexer for self discovery

xvrl commented on pull request #10679: URL: https://github.com/apache/druid/pull/10679#issuecomment-745021418 merging since test failures appear unrelated. This is an automated message from the Apache Git Service. To respond

[GitHub] [druid] xvrl merged pull request #10679: Adding example config files for indexer process. Also added status/selfDiscovered endpoint to indexer for self discovery

xvrl merged pull request #10679: URL: https://github.com/apache/druid/pull/10679 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [druid] lgtm-com[bot] commented on pull request #10676: Allow client to configure batch ingestion task to wait to complete until segments are confirmed to be available by other

lgtm-com[bot] commented on pull request #10676: URL: https://github.com/apache/druid/pull/10676#issuecomment-744870421 This pull request **introduces 1 alert** when merging 8b9d26d07527b8b2b6b1a8ed09dc0ac36e353797 into 0ad27c06da4e0bb195a67ed623cc8fbba5967e27 - [view on

[GitHub] [druid] zhangyue19921010 commented on pull request #10670: [Doc-Fix] Remove extra comma in `druid/integration-tests/README.md`

zhangyue19921010 commented on pull request #10670: URL: https://github.com/apache/druid/pull/10670#issuecomment-744850396 @a2l007 Thanks for your review! This is an automated message from the Apache Git Service. To respond

[GitHub] [druid] zhangyue19921010 commented on pull request #10661: [Minor Doc Fix] Correct the default value of `druid.server.http.gracefulShutdownTimeout`

zhangyue19921010 commented on pull request #10661: URL: https://github.com/apache/druid/pull/10661#issuecomment-744849382 @a2l007 Thanks for your review! This is an automated message from the Apache Git Service. To respond

[GitHub] [druid] zhangyue19921010 commented on pull request #10524: Dynamic auto scale Kafka-Stream ingest tasks

zhangyue19921010 commented on pull request #10524: URL: https://github.com/apache/druid/pull/10524#issuecomment-744842307 Hi @capistrant , Hi @nishantmonu51 ! Sorry to bother you. Is there any updates? Looking forward to your response. Thanks!

[druid] branch master updated (64f97e7 -> 0ad27c0)

This is an automated email from the ASF dual-hosted git repository. himanshug pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/druid.git. from 64f97e7 fix DruidSchema incorrectly listing tables with no segments (#10660) add 0ad27c0 Historical load

[GitHub] [druid] himanshug merged pull request #10650: Historical load Segments enhancement

himanshug merged pull request #10650: URL: https://github.com/apache/druid/pull/10650 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [druid] himanshug closed issue #10649: Druid Historical may never load specific segment again which is failed loading before.

himanshug closed issue #10649: URL: https://github.com/apache/druid/issues/10649 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [druid] xvrl commented on a change in pull request #10679: Adding example config files for indexer process. Also added status/selfDiscovered endpoint to indexer for self discovery

xvrl commented on a change in pull request #10679: URL: https://github.com/apache/druid/pull/10679#discussion_r542820582 ## File path: examples/conf/druid/cluster/data/indexer/runtime.properties ## @@ -0,0 +1,38 @@ +# +# Licensed to the Apache Software Foundation (ASF) under

[GitHub] [druid] harinirajendran commented on a change in pull request #10679: Adding example config files for indexer process. Also added status/selfDiscovered endpoint to indexer for self discovery

harinirajendran commented on a change in pull request #10679: URL: https://github.com/apache/druid/pull/10679#discussion_r542803426 ## File path: examples/conf/druid/cluster/data/indexer/jvm.config ## @@ -0,0 +1,9 @@ +-server +-Xms128m +-Xmx128m +-XX:MaxDirectMemorySize=1g

[GitHub] [druid] harinirajendran commented on a change in pull request #10679: Adding example config files for indexer process. Also added status/selfDiscovered endpoint to indexer for self discovery

harinirajendran commented on a change in pull request #10679: URL: https://github.com/apache/druid/pull/10679#discussion_r542796281 ## File path: examples/conf/druid/cluster/data/indexer/runtime.properties ## @@ -0,0 +1,38 @@ +# +# Licensed to the Apache Software Foundation

[GitHub] [druid] xvrl commented on a change in pull request #10679: Adding example config files for indexer process. Also added status/selfDiscovered endpoint to indexer

xvrl commented on a change in pull request #10679: URL: https://github.com/apache/druid/pull/10679#discussion_r542786845 ## File path: examples/conf/druid/cluster/data/indexer/jvm.config ## @@ -0,0 +1,9 @@ +-server +-Xms128m +-Xmx128m +-XX:MaxDirectMemorySize=1g Review

[GitHub] [druid] xvrl commented on a change in pull request #10679: Adding example config files for indexer process. Also added status/selfDiscovered endpoint to indexer

xvrl commented on a change in pull request #10679: URL: https://github.com/apache/druid/pull/10679#discussion_r542786016 ## File path: examples/conf/druid/cluster/data/indexer/runtime.properties ## @@ -0,0 +1,38 @@ +# +# Licensed to the Apache Software Foundation (ASF) under

[GitHub] [druid] xvrl commented on a change in pull request #10679: Adding example config files for indexer process. Also added status/selfDiscovered endpoint to indexer for self discovery.

xvrl commented on a change in pull request #10679: URL: https://github.com/apache/druid/pull/10679#discussion_r542784759 ## File path: examples/conf/druid/cluster/data/indexer/runtime.properties ## @@ -0,0 +1,38 @@ +# +# Licensed to the Apache Software Foundation (ASF) under

[GitHub] [druid] harinirajendran commented on a change in pull request #10679: Adding example config files for indexer process. Also added status/selfDiscovered endpoint to indexer for self discovery.

harinirajendran commented on a change in pull request #10679: URL: https://github.com/apache/druid/pull/10679#discussion_r542741175 ## File path: examples/conf/druid/cluster/data/indexer/runtime.properties ## @@ -0,0 +1,38 @@ +# +# Licensed to the Apache Software Foundation

[GitHub] [druid] abhishekagarwal87 commented on pull request #10653: Fix post-aggregator computation when used with subtotals

abhishekagarwal87 commented on pull request #10653: URL: https://github.com/apache/druid/pull/10653#issuecomment-744659147 > @abhishekagarwal87 Could you check the errors in https://travis-ci.com/github/apache/druid/jobs/456420636, including the one in

[GitHub] [druid-website-src] druid-matt opened a new pull request #198: remove 12/9 event

druid-matt opened a new pull request #198: URL: https://github.com/apache/druid-website-src/pull/198 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [druid] xvrl commented on a change in pull request #10679: Adding example config files for indexer process. Also added status/selfDiscovered endpoint to indexer for self discovery.

xvrl commented on a change in pull request #10679: URL: https://github.com/apache/druid/pull/10679#discussion_r542563847 ## File path: examples/conf/druid/cluster/data/indexer/runtime.properties ## @@ -0,0 +1,38 @@ +# +# Licensed to the Apache Software Foundation (ASF) under

[GitHub] [druid] lgtm-com[bot] commented on pull request #10676: Allow client to configure batch ingestion task to wait to complete until segments are confirmed to be available by other

lgtm-com[bot] commented on pull request #10676: URL: https://github.com/apache/druid/pull/10676#issuecomment-744586871 This pull request **introduces 1 alert** when merging 027938ea80e385136b32c405f8046b9cef675fc1 into 64f97e7003ebc922e404ff49a31969993669747c - [view on

[GitHub] [druid] harinirajendran opened a new pull request #10679: Adding example config files for indexer process. Also added status/selfDiscovered endpoint to indexer for self discovery.

harinirajendran opened a new pull request #10679: URL: https://github.com/apache/druid/pull/10679 In this PR I have added example config files that can be used to spin up the indexer process. And have also added the `status/selfDiscovered` endpoint to indexer which we use as readiness

[GitHub] [druid] ankitnayan opened a new issue #10678: How to store and query array of key value pairs?

ankitnayan opened a new issue #10678: URL: https://github.com/apache/druid/issues/10678 My data format is like: ``` { timestamp string, name string, kind int, status_code int, ... tags: { key1: value1, key2: value2, ... }

[GitHub] [druid] nishantmonu51 opened a new pull request #10677: Add URI based allowPrefexList and denyPrefixList

nishantmonu51 opened a new pull request #10677: URL: https://github.com/apache/druid/pull/10677 Description Right now there is no support to restrict druid based ingestion to deny ingestion from specific paths. This PR adds a new config `druid.ingestion.uri.allowPrefexList` and

[GitHub] [druid] capistrant opened a new pull request #10676: Allow client to configure batch ingestion task to wait to complete until segments are confirmed to be available by other

capistrant opened a new pull request #10676: URL: https://github.com/apache/druid/pull/10676 ### Description High Level Description Add configuration in `tuningConfig` for end user to tell Indexing Service to wait for

[GitHub] [druid] smit-aterlo commented on pull request #9116: WIP: gcloud pubsub indexing service

smit-aterlo commented on pull request #9116: URL: https://github.com/apache/druid/pull/9116#issuecomment-744539253 Hello @aditya-r-m, Any update on this branch. We would love to use druid if it comes with PubSub indexing.

[GitHub] [druid] zhangyue19921010 commented on a change in pull request #10650: Historical load Segments enhancement

zhangyue19921010 commented on a change in pull request #10650: URL: https://github.com/apache/druid/pull/10650#discussion_r542465563 ## File path: server/src/main/java/org/apache/druid/segment/loading/SegmentLoaderLocalCacheManager.java ## @@ -157,7 +184,15 @@ public File

[GitHub] [druid] zhangyue19921010 commented on a change in pull request #10650: Historical load Segments enhancement

zhangyue19921010 commented on a change in pull request #10650: URL: https://github.com/apache/druid/pull/10650#discussion_r542465563 ## File path: server/src/main/java/org/apache/druid/segment/loading/SegmentLoaderLocalCacheManager.java ## @@ -157,7 +184,15 @@ public File

[GitHub] [druid] nishantmonu51 commented on a change in pull request #10544: kubernetes based discovery druid extension to run Druid on K8S without Zookeeper

nishantmonu51 commented on a change in pull request #10544: URL: https://github.com/apache/druid/pull/10544#discussion_r542410520 ## File path: extensions-core/kubernetes-extensions/src/main/java/org/apache/druid/k8s/discovery/DiscoveryDruidNodeList.java ## @@ -0,0 +1,51 @@