[GitHub] srkukarni closed pull request #2728: [function][runtime] NPE at RuntimeSpawner

2018-10-05 Thread GitBox
srkukarni closed pull request #2728: [function][runtime] NPE at RuntimeSpawner URL: https://github.com/apache/pulsar/pull/2728 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign

[pulsar] branch master updated: [function][runtime] NPE at RuntimeSpawner (#2728)

2018-10-05 Thread sanjeevrk
This is an automated email from the ASF dual-hosted git repository. sanjeevrk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new ea503da [function][runtime] NPE at

[GitHub] sijie commented on issue #2728: [function][runtime] NPE at RuntimeSpawner

2018-10-05 Thread GitBox
sijie commented on issue #2728: [function][runtime] NPE at RuntimeSpawner URL: https://github.com/apache/pulsar/pull/2728#issuecomment-427406609 ping @srkukarni ? This is an automated message from the Apache Git Service. To

[GitHub] srkukarni commented on issue #2729: Added ability a download dependencies in Kubernetes

2018-10-05 Thread GitBox
srkukarni commented on issue #2729: Added ability a download dependencies in Kubernetes URL: https://github.com/apache/pulsar/pull/2729#issuecomment-427411294 run cpp tests This is an automated message from the Apache Git

[GitHub] sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223093861 ## File path:

[GitHub] david-streamlio commented on issue #2615: Azure offloader

2018-10-05 Thread GitBox
david-streamlio commented on issue #2615: Azure offloader URL: https://github.com/apache/pulsar/pull/2615#issuecomment-427405837 I am open to suggestions on how to split these up, but these changes are tightly coupled. I could remove the Glacier offloader, but that would be just one

[GitHub] merlimat commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
merlimat commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223068919 ## File path:

[GitHub] merlimat commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
merlimat commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223069417 ## File path:

[GitHub] srkukarni commented on a change in pull request #2729: Added ability a download dependencies in Kubernetes

2018-10-05 Thread GitBox
srkukarni commented on a change in pull request #2729: Added ability a download dependencies in Kubernetes URL: https://github.com/apache/pulsar/pull/2729#discussion_r223074246 ## File path: pulsar-functions/instance/src/main/python/python_instance.py ## @@ -26,7 +26,10

[pulsar] branch master updated: Added ability a download dependencies in Kubernetes (#2729)

2018-10-05 Thread sanjeevrk
This is an automated email from the ASF dual-hosted git repository. sanjeevrk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new da83322 Added ability a download

[GitHub] srkukarni closed pull request #2729: Added ability a download dependencies in Kubernetes

2018-10-05 Thread GitBox
srkukarni closed pull request #2729: Added ability a download dependencies in Kubernetes URL: https://github.com/apache/pulsar/pull/2729 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is

[pulsar] branch master updated: [functions][conf] Update functions_worker yml with all the possible settings (#2721)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 525239b [functions][conf] Update

[GitHub] sijie closed pull request #2721: [functions][conf] Update functions_worker yml with all the possible settings

2018-10-05 Thread GitBox
sijie closed pull request #2721: [functions][conf] Update functions_worker yml with all the possible settings URL: https://github.com/apache/pulsar/pull/2721 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] sijie commented on a change in pull request #2733: Extra logging for offloaders

2018-10-05 Thread GitBox
sijie commented on a change in pull request #2733: Extra logging for offloaders URL: https://github.com/apache/pulsar/pull/2733#discussion_r223050909 ## File path: pulsar-broker/src/main/java/org/apache/pulsar/broker/PulsarService.java ## @@ -689,6 +689,7 @@ public

[GitHub] merlimat commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
merlimat commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223068545 ## File path:

[GitHub] sijie opened a new pull request #2738: [functions][worker] timeout creating producer for worker

2018-10-05 Thread GitBox
sijie opened a new pull request #2738: [functions][worker] timeout creating producer for worker URL: https://github.com/apache/pulsar/pull/2738 *Motivation* Sometime when we run worker service as part of broker, some pods can be hanging on creating producers to assignment topics.

[GitHub] ivankelly commented on issue #2697: Offloading fails

2018-10-05 Thread GitBox
ivankelly commented on issue #2697: Offloading fails URL: https://github.com/apache/pulsar/issues/2697#issuecomment-427377399 I'm glad to hear it. Let us know if you have more trouble. This is an automated message from the

[GitHub] ivankelly closed issue #2697: Offloading fails

2018-10-05 Thread GitBox
ivankelly closed issue #2697: Offloading fails URL: https://github.com/apache/pulsar/issues/2697 This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above

[GitHub] sijie commented on issue #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on issue #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#issuecomment-427515305 run integration tests run java8 tests

[GitHub] sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223102771 ## File path:

[GitHub] sijie commented on issue #2732: [integration tests] add a smoketest for pulsar standalone

2018-10-05 Thread GitBox
sijie commented on issue #2732: [integration tests] add a smoketest for pulsar standalone URL: https://github.com/apache/pulsar/pull/2732#issuecomment-427460647 run integration tests This is an automated message from the

[GitHub] sijie commented on issue #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on issue #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#issuecomment-427461762 @ivankelly @merlimat I have addressed your comments.

[GitHub] sijie opened a new issue #2736: Add admin command to truncate pulsar topics (partitions)

2018-10-05 Thread GitBox
sijie opened a new issue #2736: Add admin command to truncate pulsar topics (partitions) URL: https://github.com/apache/pulsar/issues/2736 requirement: set infinite retention on a namespace and then manually truncate the topic. - truncate the topic by message id - delete all the

[GitHub] merlimat opened a new pull request #2735: Collect metrics on number of logs lines printed

2018-10-05 Thread GitBox
merlimat opened a new pull request #2735: Collect metrics on number of logs lines printed URL: https://github.com/apache/pulsar/pull/2735 ### Motivation Expose metrics in Prometheus regarding the number of log messages printed by each process. This will add metrics like:

[pulsar] branch master updated: [integration tests] add a smoketest for pulsar standalone (#2732)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new d26bea8 [integration tests] add a smoketest for

[GitHub] sijie opened a new issue #2734: Add namespace level enforcement on schema validation

2018-10-05 Thread GitBox
sijie opened a new issue #2734: Add namespace level enforcement on schema validation URL: https://github.com/apache/pulsar/issues/2734 in 2.2 we have a broker-level setting on enforcing schema validation. in 2.3, we need to add the enforcement to namespace level and eventually get rid

[GitHub] sijie closed pull request #2717: [schema] use AUTO_PRODUCE schema when possible

2018-10-05 Thread GitBox
sijie closed pull request #2717: [schema] use AUTO_PRODUCE schema when possible URL: https://github.com/apache/pulsar/pull/2717 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign

[GitHub] sijie closed pull request #2722: local function-worker use localhost broker service url

2018-10-05 Thread GitBox
sijie closed pull request #2722: local function-worker use localhost broker service url URL: https://github.com/apache/pulsar/pull/2722 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is

[pulsar] branch master updated: local function-worker use localhost broker service url (#2722)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new af58956 local function-worker use localhost

[GitHub] sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r222901063 ## File path:

[GitHub] sijie commented on issue #2722: local function-worker use localhost broker service url

2018-10-05 Thread GitBox
sijie commented on issue #2722: local function-worker use localhost broker service url URL: https://github.com/apache/pulsar/pull/2722#issuecomment-427258722 run cpp tests This is an automated message from the Apache Git

[GitHub] sijie closed pull request #2724: [functions][stats] don't generate function stats at worker service if runtime is k8s

2018-10-05 Thread GitBox
sijie closed pull request #2724: [functions][stats] don't generate function stats at worker service if runtime is k8s URL: https://github.com/apache/pulsar/pull/2724 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the

[pulsar] branch master updated: [functions][stats] don't generate function stats at worker service if runtime is k8s (#2724)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new ab02f4f [functions][stats] don't generate

[GitHub] sijie closed pull request #2723: [functions][stats] NPE in FunctionStatsGenerator when worker service is not ready

2018-10-05 Thread GitBox
sijie closed pull request #2723: [functions][stats] NPE in FunctionStatsGenerator when worker service is not ready URL: https://github.com/apache/pulsar/pull/2723 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake

[pulsar] branch master updated: [functions][stats] NPE in FunctionStatsGenerator when worker service is not ready (#2723)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 9b74e9d [functions][stats] NPE in

[GitHub] rdhabalia commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
rdhabalia commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r222907660 ## File path:

[GitHub] MarkAddison commented on issue #2642: Duplicate classes caught by maven-enforcer-plugin

2018-10-05 Thread GitBox
MarkAddison commented on issue #2642: Duplicate classes caught by maven-enforcer-plugin URL: https://github.com/apache/pulsar/issues/2642#issuecomment-427270535 Thank you for your reply and explanation. As stated above we do have a workaround, which is not completely satisfactory, but

[GitHub] sijie commented on issue #2717: [schema] use AUTO_PRODUCE schema when possible

2018-10-05 Thread GitBox
sijie commented on issue #2717: [schema] use AUTO_PRODUCE schema when possible URL: https://github.com/apache/pulsar/pull/2717#issuecomment-427276854 closing this one in favor of #2730 This is an automated message from the

[GitHub] sijie commented on issue #2728: [function][runtime] NPE at RuntimeSpawner

2018-10-05 Thread GitBox
sijie commented on issue #2728: [function][runtime] NPE at RuntimeSpawner URL: https://github.com/apache/pulsar/pull/2728#issuecomment-427277122 run cpp tests run integration tests This is an automated message from the

[GitHub] sijie commented on issue #2732: [integration tests] add a smoketest for pulsar standalone

2018-10-05 Thread GitBox
sijie commented on issue #2732: [integration tests] add a smoketest for pulsar standalone URL: https://github.com/apache/pulsar/pull/2732#issuecomment-427291138 This is for introducing state related tests for #2714 This is

[GitHub] macthestack edited a comment on issue #2697: Offloading fails

2018-10-05 Thread GitBox
macthestack edited a comment on issue #2697: Offloading fails URL: https://github.com/apache/pulsar/issues/2697#issuecomment-427086068 Here we go: [stderr](https://storage.googleapis.com/pulsar-topic-offload/stderr/2018/10/04/15%3A00%3A00_15%3A59%3A59_S0.json)

[GitHub] sijie commented on a change in pull request #2729: Added ability a download dependencies in Kubernetes

2018-10-05 Thread GitBox
sijie commented on a change in pull request #2729: Added ability a download dependencies in Kubernetes URL: https://github.com/apache/pulsar/pull/2729#discussion_r222902942 ## File path: pulsar-functions/instance/src/main/python/python_instance.py ## @@ -26,7 +26,10 @@

[GitHub] sijie commented on issue #2728: [function][runtime] NPE at RuntimeSpawner

2018-10-05 Thread GitBox
sijie commented on issue #2728: [function][runtime] NPE at RuntimeSpawner URL: https://github.com/apache/pulsar/pull/2728#issuecomment-427258429 run cpp tests run integration tests This is an automated message from the

[GitHub] sijie commented on issue #2721: [functions][conf] Update functions_worker yml with all the possible settings

2018-10-05 Thread GitBox
sijie commented on issue #2721: [functions][conf] Update functions_worker yml with all the possible settings URL: https://github.com/apache/pulsar/pull/2721#issuecomment-427290606 run java8 tests This is an automated message

[GitHub] sijie opened a new pull request #2732: [integration tests] add a smoketest for pulsar standalone

2018-10-05 Thread GitBox
sijie opened a new pull request #2732: [integration tests] add a smoketest for pulsar standalone URL: https://github.com/apache/pulsar/pull/2732 *Motivation* Ideally we should run all integration tests on both cluster mode and standalone mode. However the apache ci can't really

[GitHub] ivankelly commented on issue #2688: Polices On Topic

2018-10-05 Thread GitBox
ivankelly commented on issue #2688: Polices On Topic URL: https://github.com/apache/pulsar/issues/2688#issuecomment-427331833 @codelipenghui This change will cause more load on zookeeper. For each topic loaded, we would have to do a read for the policy of that topic when loading the

[GitHub] ivankelly commented on issue #2697: Offloading fails

2018-10-05 Thread GitBox
ivankelly commented on issue #2697: Offloading fails URL: https://github.com/apache/pulsar/issues/2697#issuecomment-427317383 @macthestack ``` # Driver to use to offload old data to long term storage (Possible values: S3) managedLedgerOffloadDriver=aws-s3 ``` For

[GitHub] ivankelly commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
ivankelly commented on a change in pull request #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#discussion_r223007365 ## File path:

[pulsar] branch master updated: Collect metrics on number of logs lines printed (#2735)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new c3c7f0d Collect metrics on number of logs lines

[GitHub] sijie closed pull request #2735: Collect metrics on number of logs lines printed

2018-10-05 Thread GitBox
sijie closed pull request #2735: Collect metrics on number of logs lines printed URL: https://github.com/apache/pulsar/pull/2735 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[GitHub] sijie commented on issue #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES`

2018-10-05 Thread GitBox
sijie commented on issue #2730: [schema] provide a flag to disable/enable schema validation on broker and change default bytes producer to use `AUTO_PRODUCE_BYTES` URL: https://github.com/apache/pulsar/pull/2730#issuecomment-427531197 run cpp tests

[GitHub] srkukarni closed pull request #2737: The log4j should be prefixed by pulsarRootDir

2018-10-05 Thread GitBox
srkukarni closed pull request #2737: The log4j should be prefixed by pulsarRootDir URL: https://github.com/apache/pulsar/pull/2737 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[pulsar] branch master updated: The log4j should be prefixed by pulsarRootDir (#2737)

2018-10-05 Thread sanjeevrk
This is an automated email from the ASF dual-hosted git repository. sanjeevrk pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new 77e2e0b The log4j should be prefixed by

[pulsar] branch master updated: [functions][worker] timeout creating producer for worker (#2738)

2018-10-05 Thread sijie
This is an automated email from the ASF dual-hosted git repository. sijie pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/pulsar.git The following commit(s) were added to refs/heads/master by this push: new fc0ef90 [functions][worker] timeout creating

[GitHub] sijie commented on issue #2735: Collect metrics on number of logs lines printed

2018-10-05 Thread GitBox
sijie commented on issue #2735: Collect metrics on number of logs lines printed URL: https://github.com/apache/pulsar/pull/2735#issuecomment-427525137 run java8 tests This is an automated message from the Apache Git Service.

[GitHub] sijie closed pull request #2738: [functions][worker] timeout creating producer for worker

2018-10-05 Thread GitBox
sijie closed pull request #2738: [functions][worker] timeout creating producer for worker URL: https://github.com/apache/pulsar/pull/2738 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this

[GitHub] srkukarni commented on issue #2737: The log4j should be prefixed by pulsarRootDir

2018-10-05 Thread GitBox
srkukarni commented on issue #2737: The log4j should be prefixed by pulsarRootDir URL: https://github.com/apache/pulsar/pull/2737#issuecomment-427526752 run java8 tests This is an automated message from the Apache Git