[incubator-pulsar] branch asf-site updated: Updated site at revision e626e2a

2018-04-16 Thread mmerli
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-pulsar.git The following commit(s) were added to refs/heads/asf-site by this push: new 3a13786 Updated site at revision

[GitHub] lucperkins opened a new pull request #1585: Default schemas

2018-04-16 Thread GitBox
lucperkins opened a new pull request #1585: Default schemas URL: https://github.com/apache/incubator-pulsar/pull/1585 This PR provides a string schema for Pulsar Java clients. I'm open to suggestions on which other "default" schemas would be useful.

[GitHub] ivankelly commented on a change in pull request #1572: Compaction CLI integration test

2018-04-16 Thread GitBox
ivankelly commented on a change in pull request #1572: Compaction CLI integration test URL: https://github.com/apache/incubator-pulsar/pull/1572#discussion_r181824948 ## File path: tests/integration/compaction/src/test/java/org/apache/pulsar/tests/integration/TestCompaction.java #

[GitHub] saandrews opened a new pull request #1586: Added config to deploy pulsar in aws using ebs storage

2018-04-16 Thread GitBox
saandrews opened a new pull request #1586: Added config to deploy pulsar in aws using ebs storage URL: https://github.com/apache/incubator-pulsar/pull/1586 1. Uncomment nodeselector to choose the type of instance to be used 2. Added option to use encrypted volume(provide the kmsKeyId to

[GitHub] merlimat closed issue #1071: Rate limiting and throttling should be applied at subscription level

2018-04-16 Thread GitBox
merlimat closed issue #1071: Rate limiting and throttling should be applied at subscription level URL: https://github.com/apache/incubator-pulsar/issues/1071 This is an automated message from the Apache Git Service. To respo

[GitHub] merlimat commented on issue #1071: Rate limiting and throttling should be applied at subscription level

2018-04-16 Thread GitBox
merlimat commented on issue #1071: Rate limiting and throttling should be applied at subscription level URL: https://github.com/apache/incubator-pulsar/issues/1071#issuecomment-381700919 Fixed in #1358 This is an automated

[GitHub] sijie commented on issue #1538: Add rate limit for client lookup requests

2018-04-16 Thread GitBox
sijie commented on issue #1538: Add rate limit for client lookup requests URL: https://github.com/apache/incubator-pulsar/pull/1538#issuecomment-381713973 @merlimat can you review this? This is an automated message from the Ap

[GitHub] sijie opened a new pull request #1587: [WIP] Add key/value operations in StateContext

2018-04-16 Thread GitBox
sijie opened a new pull request #1587: [WIP] Add key/value operations in StateContext URL: https://github.com/apache/incubator-pulsar/pull/1587 ### Motivation key/value state existing with bk table service. but we never expose it to function state. it might be convenient for

[GitHub] sijie commented on issue #1587: [WIP] Add key/value operations in StateContext

2018-04-16 Thread GitBox
sijie commented on issue #1587: [WIP] Add key/value operations in StateContext URL: https://github.com/apache/incubator-pulsar/pull/1587#issuecomment-381720857 @srkukarni @jerrypeng This is an automated message from the Apach

[GitHub] ivankelly opened a new pull request #1588: Don't format bookkeeper if /ledgers exist

2018-04-16 Thread GitBox
ivankelly opened a new pull request #1588: Don't format bookkeeper if /ledgers exist URL: https://github.com/apache/incubator-pulsar/pull/1588 If you want to run pulsar on a preexisting bookkeeper installation, there's currently no way to format the metadata. This patch skips the

[GitHub] rdhabalia opened a new pull request #1589: Start function worker service after broker is fully started

2018-04-16 Thread GitBox
rdhabalia opened a new pull request #1589: Start function worker service after broker is fully started URL: https://github.com/apache/incubator-pulsar/pull/1589 ### Motivation Function-worker service depends on broker in many aspect so, it should start after broker service is fully

[GitHub] srkukarni commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext

2018-04-16 Thread GitBox
srkukarni commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext URL: https://github.com/apache/incubator-pulsar/pull/1587#discussion_r181880963 ## File path: pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/state/Sta

[GitHub] srkukarni commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext

2018-04-16 Thread GitBox
srkukarni commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext URL: https://github.com/apache/incubator-pulsar/pull/1587#discussion_r181881109 ## File path: pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/state/Sta

[GitHub] srkukarni commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext

2018-04-16 Thread GitBox
srkukarni commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext URL: https://github.com/apache/incubator-pulsar/pull/1587#discussion_r181881196 ## File path: pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/state/Sta

[GitHub] srkukarni commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext

2018-04-16 Thread GitBox
srkukarni commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext URL: https://github.com/apache/incubator-pulsar/pull/1587#discussion_r181881493 ## File path: pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/state/Sta

[GitHub] rdhabalia opened a new pull request #1590: Handle NPE for output producer is null for function

2018-04-16 Thread GitBox
rdhabalia opened a new pull request #1590: Handle NPE for output producer is null for function URL: https://github.com/apache/incubator-pulsar/pull/1590 ### Motivation If output topic is not present for function then [MessageProcessor](https://github.com/apache/incubator-pulsar/blob

[GitHub] merlimat commented on issue #1588: Don't format bookkeeper if /ledgers exist

2018-04-16 Thread GitBox
merlimat commented on issue #1588: Don't format bookkeeper if /ledgers exist URL: https://github.com/apache/incubator-pulsar/pull/1588#issuecomment-381748271 retest this please This is an automated message from the Apache Git

[GitHub] merlimat commented on issue #1588: Don't format bookkeeper if /ledgers exist

2018-04-16 Thread GitBox
merlimat commented on issue #1588: Don't format bookkeeper if /ledgers exist URL: https://github.com/apache/incubator-pulsar/pull/1588#issuecomment-381748271 retest this please This is an automated message from the Apache Git

[GitHub] sijie commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext

2018-04-16 Thread GitBox
sijie commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext URL: https://github.com/apache/incubator-pulsar/pull/1587#discussion_r181885174 ## File path: pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/state/StateCo

[GitHub] sijie commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext

2018-04-16 Thread GitBox
sijie commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext URL: https://github.com/apache/incubator-pulsar/pull/1587#discussion_r181885286 ## File path: pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/state/StateCo

[GitHub] sijie commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext

2018-04-16 Thread GitBox
sijie commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext URL: https://github.com/apache/incubator-pulsar/pull/1587#discussion_r181885416 ## File path: pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/state/StateCo

[GitHub] sijie commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext

2018-04-16 Thread GitBox
sijie commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext URL: https://github.com/apache/incubator-pulsar/pull/1587#discussion_r181887018 ## File path: pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/state/StateCo

[GitHub] merlimat commented on issue #1510: java.lang.IllegalArgumentException on refreshing stats

2018-04-16 Thread GitBox
merlimat commented on issue #1510: java.lang.IllegalArgumentException on refreshing stats URL: https://github.com/apache/incubator-pulsar/issues/1510#issuecomment-381753231 Already fixed This is an automated message from the

[GitHub] merlimat closed issue #1510: java.lang.IllegalArgumentException on refreshing stats

2018-04-16 Thread GitBox
merlimat closed issue #1510: java.lang.IllegalArgumentException on refreshing stats URL: https://github.com/apache/incubator-pulsar/issues/1510 This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] lucperkins commented on a change in pull request #1585: Default schemas

2018-04-16 Thread GitBox
lucperkins commented on a change in pull request #1585: Default schemas URL: https://github.com/apache/incubator-pulsar/pull/1585#discussion_r181890923 ## File path: pulsar-client/src/main/java/org/apache/pulsar/client/api/schemas/StringSchema.java ## @@ -0,0 +1,54 @@ +/**

[GitHub] merlimat closed pull request #1589: Start function worker service after broker is fully started

2018-04-16 Thread GitBox
merlimat closed pull request #1589: Start function worker service after broker is fully started URL: https://github.com/apache/incubator-pulsar/pull/1589 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provena

[incubator-pulsar] branch master updated: Start function worker service after broker is fully started (#1589)

2018-04-16 Thread mmerli
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pulsar.git The following commit(s) were added to refs/heads/master by this push: new 44ace52 Start function worker service

[GitHub] rdhabalia opened a new pull request #1591: Fix: deadlock while closing non-shared consumer

2018-04-16 Thread GitBox
rdhabalia opened a new pull request #1591: Fix: deadlock while closing non-shared consumer URL: https://github.com/apache/incubator-pulsar/pull/1591 ### Motivation Fix possible deadlock while closing non-shared consumer. ``` main" #1 prio=5 os_prio=31 tid=0x7fad6e802800

[incubator-pulsar] branch master updated: Handle NPE for output producer is null for function (#1590)

2018-04-16 Thread mmerli
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pulsar.git The following commit(s) were added to refs/heads/master by this push: new 9d19a0e Handle NPE for output produce

[GitHub] merlimat closed pull request #1590: Handle NPE for output producer is null for function

2018-04-16 Thread GitBox
merlimat closed pull request #1590: Handle NPE for output producer is null for function URL: https://github.com/apache/incubator-pulsar/pull/1590 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[incubator-pulsar] branch master updated: Don't format bookkeeper if /ledgers exist (#1588)

2018-04-16 Thread mmerli
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pulsar.git The following commit(s) were added to refs/heads/master by this push: new b421e63 Don't format bookkeeper if /l

[GitHub] merlimat closed pull request #1588: Don't format bookkeeper if /ledgers exist

2018-04-16 Thread GitBox
merlimat closed pull request #1588: Don't format bookkeeper if /ledgers exist URL: https://github.com/apache/incubator-pulsar/pull/1588 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[GitHub] ivankelly commented on a change in pull request #1549: offloadPrefix implementation for managed ledger

2018-04-16 Thread GitBox
ivankelly commented on a change in pull request #1549: offloadPrefix implementation for managed ledger URL: https://github.com/apache/incubator-pulsar/pull/1549#discussion_r181899063 ## File path: managed-ledger/src/main/java/org/apache/bookkeeper/mledger/impl/ManagedLedgerImpl.jav

[GitHub] ivankelly commented on a change in pull request #1549: offloadPrefix implementation for managed ledger

2018-04-16 Thread GitBox
ivankelly commented on a change in pull request #1549: offloadPrefix implementation for managed ledger URL: https://github.com/apache/incubator-pulsar/pull/1549#discussion_r181899488 ## File path: managed-ledger/src/main/java/org/apache/bookkeeper/mledger/impl/ManagedLedgerImpl.jav

[GitHub] ivankelly commented on a change in pull request #1549: offloadPrefix implementation for managed ledger

2018-04-16 Thread GitBox
ivankelly commented on a change in pull request #1549: offloadPrefix implementation for managed ledger URL: https://github.com/apache/incubator-pulsar/pull/1549#discussion_r181826385 ## File path: managed-ledger/src/main/java/org/apache/bookkeeper/mledger/impl/ManagedLedgerImpl.jav

[GitHub] ivankelly commented on issue #1592: Add properties alias for tenants in pulsar-admin

2018-04-16 Thread GitBox
ivankelly commented on issue #1592: Add properties alias for tenants in pulsar-admin URL: https://github.com/apache/incubator-pulsar/pull/1592#issuecomment-381775558 @merlimat This is an automated message from the Apache Git

[GitHub] ivankelly opened a new pull request #1592: Add properties alias for tenants in pulsar-admin

2018-04-16 Thread GitBox
ivankelly opened a new pull request #1592: Add properties alias for tenants in pulsar-admin URL: https://github.com/apache/incubator-pulsar/pull/1592 Recently properties was renamed to tenants in the pulsar-admin CLI. However, people may already have scripts that depend on the propert

[GitHub] merlimat commented on a change in pull request #1592: Add properties alias for tenants in pulsar-admin

2018-04-16 Thread GitBox
merlimat commented on a change in pull request #1592: Add properties alias for tenants in pulsar-admin URL: https://github.com/apache/incubator-pulsar/pull/1592#discussion_r181909505 ## File path: pulsar-client-tools/src/main/java/org/apache/pulsar/admin/cli/CmdTenants.java ##

[GitHub] ivankelly commented on a change in pull request #1592: Add properties alias for tenants in pulsar-admin

2018-04-16 Thread GitBox
ivankelly commented on a change in pull request #1592: Add properties alias for tenants in pulsar-admin URL: https://github.com/apache/incubator-pulsar/pull/1592#discussion_r181912276 ## File path: pulsar-client-tools/src/main/java/org/apache/pulsar/admin/cli/CmdTenants.java #

[GitHub] merlimat commented on a change in pull request #1592: Add properties alias for tenants in pulsar-admin

2018-04-16 Thread GitBox
merlimat commented on a change in pull request #1592: Add properties alias for tenants in pulsar-admin URL: https://github.com/apache/incubator-pulsar/pull/1592#discussion_r181913252 ## File path: pulsar-client-tools/src/main/java/org/apache/pulsar/admin/cli/CmdTenants.java ##

[GitHub] zhaijack opened a new pull request #1593: PIP-17: index block for offload.

2018-04-16 Thread GitBox
zhaijack opened a new pull request #1593: PIP-17: index block for offload. URL: https://github.com/apache/incubator-pulsar/pull/1593 Offload index block utilities for PIP-17. - Offload index entry: for each mapping: messageID -> . - Offload index block: including the index block heade

[incubator-pulsar] branch master updated: Add properties alias for tenants in pulsar-admin (#1592)

2018-04-16 Thread mmerli
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pulsar.git The following commit(s) were added to refs/heads/master by this push: new 3121bec Add properties alias for tena

[GitHub] merlimat closed pull request #1592: Add properties alias for tenants in pulsar-admin

2018-04-16 Thread GitBox
merlimat closed pull request #1592: Add properties alias for tenants in pulsar-admin URL: https://github.com/apache/incubator-pulsar/pull/1592 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As th

[GitHub] ivankelly commented on issue #1579: Added option to create namespace on CLI passing list of clusters

2018-04-16 Thread GitBox
ivankelly commented on issue #1579: Added option to create namespace on CLI passing list of clusters URL: https://github.com/apache/incubator-pulsar/pull/1579#issuecomment-381796501 Would be nice to have some tests of the cli part, since that is user facing

[GitHub] lucperkins commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext

2018-04-16 Thread GitBox
lucperkins commented on a change in pull request #1587: [WIP] Add key/value operations in StateContext URL: https://github.com/apache/incubator-pulsar/pull/1587#discussion_r181928010 ## File path: pulsar-functions/instance/src/main/java/org/apache/pulsar/functions/instance/state/St

[GitHub] rdhabalia opened a new pull request #1594: Introduce pulsar-replicator and kinesis-provider with pulsar-function

2018-04-16 Thread GitBox
rdhabalia opened a new pull request #1594: Introduce pulsar-replicator and kinesis-provider with pulsar-function URL: https://github.com/apache/incubator-pulsar/pull/1594 ### Motivation Addressing : #1582 Pulsar already supports geo-replication that persists messages across m

[GitHub] merlimat opened a new pull request #1595: When new cluster is setup, public/default namespace should be extended there

2018-04-16 Thread GitBox
merlimat opened a new pull request #1595: When new cluster is setup, public/default namespace should be extended there URL: https://github.com/apache/incubator-pulsar/pull/1595 ### Motivation When we setup a new cluster, we need to add the new cluster in the allowed clusters section

[GitHub] ivankelly opened a new pull request #1596: Compaction commands for pulsar-admin

2018-04-16 Thread GitBox
ivankelly opened a new pull request #1596: Compaction commands for pulsar-admin URL: https://github.com/apache/incubator-pulsar/pull/1596 Adds an compact and compaction-status command in the persistent subcommand of pulsar-admin. This command differs from the compact-topic CLI (par

[GitHub] jerrypeng commented on issue #1594: Introduce pulsar-replicator and kinesis-provider with pulsar-function

2018-04-16 Thread GitBox
jerrypeng commented on issue #1594: Introduce pulsar-replicator and kinesis-provider with pulsar-function URL: https://github.com/apache/incubator-pulsar/pull/1594#issuecomment-381804795 @rdhabalia thanks for working on this. This is a very large PR. Perhaps we can break this up i

[GitHub] jerrypeng commented on issue #1594: Introduce pulsar-replicator and kinesis-provider with pulsar-function

2018-04-16 Thread GitBox
jerrypeng commented on issue #1594: Introduce pulsar-replicator and kinesis-provider with pulsar-function URL: https://github.com/apache/incubator-pulsar/pull/1594#issuecomment-381804795 @rdhabalia thanks for working on this. This is an awesome feature! Just a overall comments: Th

[GitHub] merlimat closed pull request #1595: When new cluster is setup, public/default namespace should be extended there

2018-04-16 Thread GitBox
merlimat closed pull request #1595: When new cluster is setup, public/default namespace should be extended there URL: https://github.com/apache/incubator-pulsar/pull/1595 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for th

[incubator-pulsar] branch master updated: When new cluster is setup, public/default namespace should be extended there (#1595)

2018-04-16 Thread mmerli
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pulsar.git The following commit(s) were added to refs/heads/master by this push: new b7fe671 When new cluster is setup, pu

[incubator-pulsar] branch master updated: Fix: deadlock while closing non-shared consumer (#1591)

2018-04-16 Thread mmerli
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pulsar.git The following commit(s) were added to refs/heads/master by this push: new 39112f4 Fix: deadlock while closing n

[GitHub] merlimat closed pull request #1591: Fix: deadlock while closing non-shared consumer

2018-04-16 Thread GitBox
merlimat closed pull request #1591: Fix: deadlock while closing non-shared consumer URL: https://github.com/apache/incubator-pulsar/pull/1591 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As thi

[incubator-pulsar] branch master updated: Reduce un-necessary work when doing bundle lookup for partitioned topic (#1527)

2018-04-16 Thread mmerli
This is an automated email from the ASF dual-hosted git repository. mmerli pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-pulsar.git The following commit(s) were added to refs/heads/master by this push: new e548aa2 Reduce un-necessary work when

[GitHub] merlimat closed pull request #1527: Reduce un-necessary work when doing bundle lookup for partitioned topic

2018-04-16 Thread GitBox
merlimat closed pull request #1527: Reduce un-necessary work when doing bundle lookup for partitioned topic URL: https://github.com/apache/incubator-pulsar/pull/1527 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sak

[GitHub] rdhabalia commented on issue #1594: Introduce pulsar-replicator and kinesis-provider with pulsar-function

2018-04-16 Thread GitBox
rdhabalia commented on issue #1594: Introduce pulsar-replicator and kinesis-provider with pulsar-function URL: https://github.com/apache/incubator-pulsar/pull/1594#issuecomment-381863958 > This is a very large PR. Perhaps we can break this up into multiple PRs to make reviewing easier?