srkukarni commented on a change in pull request #2426: Added cli commands to
get function cluster related information
URL: https://github.com/apache/incubator-pulsar/pull/2426#discussion_r212377268
##
File path:
srkukarni commented on a change in pull request #2426: Added cli commands to
get function cluster related information
URL: https://github.com/apache/incubator-pulsar/pull/2426#discussion_r212377386
##
File path:
srkukarni commented on a change in pull request #2424: Support heartbeat
function for worker
URL: https://github.com/apache/incubator-pulsar/pull/2424#discussion_r212389886
##
File path:
pulsar-functions/worker/src/main/java/org/apache/pulsar/functions/worker/WorkerConfig.java
bardock commented on issue #2431: Unable to consume messages, need to
re-subscribe client
URL:
https://github.com/apache/incubator-pulsar/issues/2431#issuecomment-415509377
Here they are:
[stats.zip](https://github.com/apache/incubator-pulsar/files/2315609/stats.zip)
Thanks!
bardock opened a new issue #2431: Unable to consume messages, need to
re-subscribe client
URL: https://github.com/apache/incubator-pulsar/issues/2431
This is similar to issue
[2013](https://github.com/apache/incubator-pulsar/issues/2013). We have several
shared subscriptions of
sijie commented on a change in pull request #2428: Package Presto with Pulsar
for SQL integration
URL: https://github.com/apache/incubator-pulsar/pull/2428#discussion_r212387727
##
File path: pulsar-sql/presto-server/src/resources/etc/catalog/pulsar.properties
##
@@ -0,0
sijie commented on a change in pull request #2428: Package Presto with Pulsar
for SQL integration
URL: https://github.com/apache/incubator-pulsar/pull/2428#discussion_r212387884
##
File path: pulsar-sql/presto-server/src/resources/etc/catalog/pulsar.properties
##
@@ -0,0
sijie commented on a change in pull request #2428: Package Presto with Pulsar
for SQL integration
URL: https://github.com/apache/incubator-pulsar/pull/2428#discussion_r212386472
##
File path: bin/pulsar
##
@@ -99,6 +103,24 @@ if [ ! -f "${PY_INSTANCE_FILE}" ]; then
srkukarni commented on issue #2426: Added cli commands to get function cluster
related information
URL: https://github.com/apache/incubator-pulsar/pull/2426#issuecomment-415505950
run integration tests
This is an automated
srkukarni commented on issue #2426: Added cli commands to get function cluster
related information
URL: https://github.com/apache/incubator-pulsar/pull/2426#issuecomment-415484255
@rdhabalia I've corrected the mistake of taking out functionsmetrics.
wrt having a seperate endpoint, I'm
bardock commented on issue #2013: Unable to consume messages from a partition
URL:
https://github.com/apache/incubator-pulsar/issues/2013#issuecomment-415487704
@sijie any thoughts?
We are now using version 4.7.1 and we are tracking almost every bookkeeper
metric.
What metrics do
ivankelly commented on issue #2401: Consumer often discards received messages
URL:
https://github.com/apache/incubator-pulsar/issues/2401#issuecomment-415495334
I have a local repro, will look into it more in the morning.
merlimat commented on issue #2431: Unable to consume messages, need to
re-subscribe client
URL:
https://github.com/apache/incubator-pulsar/issues/2431#issuecomment-415497842
@bardock Can you shared topics stats : `pulsar-admin persistent stats
$TOPIC` and internal stats `pulsar-admin
rdhabalia commented on a change in pull request #2424: Support heartbeat
function for worker
URL: https://github.com/apache/incubator-pulsar/pull/2424#discussion_r212406508
##
File path:
pulsar-functions/worker/src/main/java/org/apache/pulsar/functions/worker/WorkerConfig.java
rdhabalia closed pull request #2424: Support heartbeat function for worker
URL: https://github.com/apache/incubator-pulsar/pull/2424
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a
rdhabalia commented on a change in pull request #2400: PIP-22: Dead Letter Topic
URL: https://github.com/apache/incubator-pulsar/pull/2400#discussion_r212497283
##
File path:
jerrypeng commented on issue #2438: Fix: Function assignment can support large
number of topics
URL: https://github.com/apache/incubator-pulsar/pull/2438#issuecomment-415621190
@rdhabalia it would be nice to keep all the functions related topics in one
namespace, but i guess its not that
This is an automated email from the ASF dual-hosted git repository.
rdhabalia pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 672a167 Race condition
rdhabalia closed pull request #2437: Race condition function-runtime-manager
read old assignments
URL: https://github.com/apache/incubator-pulsar/pull/2437
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of
jiazhai opened a new pull request #2439: leak assign schema in MessageImpl
constructor
URL: https://github.com/apache/incubator-pulsar/pull/2439
schema was not assigned in MessageImpl constructor, this change try to fix
it.
jiazhai commented on a change in pull request #2400: PIP-22: Dead Letter Topic
URL: https://github.com/apache/incubator-pulsar/pull/2400#discussion_r212514520
##
File path:
This is an automated email from the ASF dual-hosted git repository.
sanjeevrk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 024d2e0 leak assign schema in
jiazhai commented on a change in pull request #2400: PIP-22: Dead Letter Topic
URL: https://github.com/apache/incubator-pulsar/pull/2400#discussion_r212514520
##
File path:
rdhabalia commented on issue #2438: Fix: Function assignment can support large
number of topics
URL: https://github.com/apache/incubator-pulsar/pull/2438#issuecomment-415615536
> we can also use topic compaction to delete old assignment messages
yes, with that we can address
rdhabalia commented on a change in pull request #2400: PIP-22: Dead Letter Topic
URL: https://github.com/apache/incubator-pulsar/pull/2400#discussion_r212497198
##
File path:
rdhabalia closed pull request #2436: Fix: failover sub keep sending invalid ack
URL: https://github.com/apache/incubator-pulsar/pull/2436
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is
massakam commented on issue #2401: Consumer often discards received messages
URL:
https://github.com/apache/incubator-pulsar/issues/2401#issuecomment-415634865
Sorry, OpenMessaging benchmark tool has not yet supported TLS...
We are using the tool modified to enable TLS.
jiazhai commented on a change in pull request #2400: PIP-22: Dead Letter Topic
URL: https://github.com/apache/incubator-pulsar/pull/2400#discussion_r212513063
##
File path:
codelipenghui commented on a change in pull request #2400: PIP-22: Dead Letter
Topic
URL: https://github.com/apache/incubator-pulsar/pull/2400#discussion_r212514391
##
File path:
codelipenghui commented on a change in pull request #2400: PIP-22: Dead Letter
Topic
URL: https://github.com/apache/incubator-pulsar/pull/2400#discussion_r212514262
##
File path:
srkukarni closed pull request #2439: leak assign schema in MessageImpl
constructor
URL: https://github.com/apache/incubator-pulsar/pull/2439
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As
jerrypeng commented on a change in pull request #2428: Package Presto with
Pulsar for SQL integration
URL: https://github.com/apache/incubator-pulsar/pull/2428#discussion_r212421574
##
File path: pulsar-sql/presto-server/src/resources/etc/catalog/pulsar.properties
##
@@
david-streamlio commented on a change in pull request #2409: Added HDFS Sink
URL: https://github.com/apache/incubator-pulsar/pull/2409#discussion_r212455521
##
File path:
pulsar-io/hdfs/src/main/java/org/apache/pulsar/io/hdfs/AbstractHdfsConfig.java
##
@@ -0,0 +1,172 @@
david-streamlio commented on a change in pull request #2409: Added HDFS Sink
URL: https://github.com/apache/incubator-pulsar/pull/2409#discussion_r212455382
##
File path:
pulsar-io/hdfs/src/main/java/org/apache/pulsar/io/hdfs/AbstractHdfsConfig.java
##
@@ -0,0 +1,172 @@
david-streamlio commented on a change in pull request #2409: Added HDFS Sink
URL: https://github.com/apache/incubator-pulsar/pull/2409#discussion_r212455416
##
File path:
pulsar-io/hdfs/src/main/java/org/apache/pulsar/io/hdfs/AbstractHdfsConfig.java
##
@@ -0,0 +1,172 @@
david-streamlio commented on a change in pull request #2409: Added HDFS Sink
URL: https://github.com/apache/incubator-pulsar/pull/2409#discussion_r212455487
##
File path:
pulsar-io/hdfs/src/main/java/org/apache/pulsar/io/hdfs/AbstractHdfsConfig.java
##
@@ -0,0 +1,172 @@
srkukarni closed pull request #2381: Make source and sink cli args format
consistent
URL: https://github.com/apache/incubator-pulsar/pull/2381
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As
srkukarni opened a new pull request #2432: Make all cli arguments follow
consistent - notation instead of camelcase
URL: https://github.com/apache/incubator-pulsar/pull/2432
### Motivation
Explain here the context, and why you're making that change.
What is the problem you're
srkukarni commented on issue #2381: Make source and sink cli args format
consistent
URL: https://github.com/apache/incubator-pulsar/pull/2381#issuecomment-415539137
This is superseded by https://github.com/apache/incubator-pulsar/pull/2432
srkukarni commented on issue #2426: Added cli commands to get function cluster
related information
URL: https://github.com/apache/incubator-pulsar/pull/2426#issuecomment-415541657
run integration tests
This is an automated
srkukarni commented on issue #2426: Added cli commands to get function cluster
related information
URL: https://github.com/apache/incubator-pulsar/pull/2426#issuecomment-415564305
run integration tests
This is an automated
srkukarni commented on issue #2432: Make all cli arguments follow consistent -
notation instead of camelcase
URL: https://github.com/apache/incubator-pulsar/pull/2432#issuecomment-415564129
run java8 tests
This is an
david-streamlio commented on a change in pull request #2409: Added HDFS Sink
URL: https://github.com/apache/incubator-pulsar/pull/2409#discussion_r212455767
##
File path:
pulsar-io/hdfs/src/test/java/org/apache/pulsar/io/hdfs/sink/HdfsSinkConfigTests.java
##
@@ -0,0
david-streamlio commented on a change in pull request #2409: Added HDFS Sink
URL: https://github.com/apache/incubator-pulsar/pull/2409#discussion_r212455850
##
File path:
tests/integration/src/test/java/org/apache/pulsar/tests/integration/containers/HdfsContainer.java
##
merlimat commented on issue #2431: Unable to consume messages, need to
re-subscribe client
URL:
https://github.com/apache/incubator-pulsar/issues/2431#issuecomment-415654048
@bardock From the stats, it seems all partitions have rate 0, and no backlog
accumulated. I couldn't see any stuck
rdhabalia opened a new pull request #2437: Race condition
function-runtime-manager read old assignments
URL: https://github.com/apache/incubator-pulsar/pull/2437
### Motivation
Right now, In function, schedulerManager tries to schedule assignments
before MemebershipManager receives
srkukarni commented on issue #2435: improve error message handling
URL: https://github.com/apache/incubator-pulsar/pull/2435#issuecomment-415607320
run integration tests
This is an automated message from the Apache Git
rdhabalia commented on issue #2426: Added cli commands to get function cluster
related information
URL: https://github.com/apache/incubator-pulsar/pull/2426#issuecomment-415610192
> wrt having a seperate endpoint, I'm not sure if its really needs to go in
/worker-stats?
actually,
rdhabalia opened a new pull request #2436: Fix: failover sub keep sending
invalid ack
URL: https://github.com/apache/incubator-pulsar/pull/2436
### Motivation
Consumer with FailOver-Subscription is not reseting `lastCumulativeAck` so,
ack-tracker task keeps sending invalid ack to
srkukarni closed pull request #2317: Make twitter source to emit records with
schema info
URL: https://github.com/apache/incubator-pulsar/pull/2317
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
srkukarni commented on issue #2317: Make twitter source to emit records with
schema info
URL: https://github.com/apache/incubator-pulsar/pull/2317#issuecomment-415577626
closing in favor of https://github.com/apache/incubator-pulsar/pull/2433
srkukarni opened a new pull request #2433: Made Twitter FireHose to emit
records containing schema information
URL: https://github.com/apache/incubator-pulsar/pull/2433
### Motivation
Explain here the context, and why you're making that change.
What is the problem you're trying
jerrypeng opened a new pull request #2435: improve error message handling
URL: https://github.com/apache/incubator-pulsar/pull/2435
### Motivation
Improve error message handling in presto pulsar connector
This is
This is an automated email from the ASF dual-hosted git repository.
sanjeevrk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new 225eeb7 Make all cli arguments
srkukarni closed pull request #2432: Make all cli arguments follow consistent -
notation instead of camelcase
URL: https://github.com/apache/incubator-pulsar/pull/2432
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the
srkukarni commented on issue #2426: Added cli commands to get function cluster
related information
URL: https://github.com/apache/incubator-pulsar/pull/2426#issuecomment-415611753
@rdhabalia Currently /workers doesn't redirect either. /functions might.
jerrypeng commented on issue #2438: Fix: Function assignment can support large
number of topics
URL: https://github.com/apache/incubator-pulsar/pull/2438#issuecomment-415613914
@rdhabalia we can also use topic compaction to delete old assignment messages
jerrypeng commented on issue #2437: Race condition function-runtime-manager
read old assignments
URL: https://github.com/apache/incubator-pulsar/pull/2437#issuecomment-415613741
@rdhabalia gotcha thanks for explanation
This
aahmed-se opened a new pull request #2434: Add pulsar flink connectors
URL: https://github.com/apache/incubator-pulsar/pull/2434
We Introduce a module for simple pulsar connectors for flink.
This is an automated message from
srkukarni commented on issue #2432: Make all cli arguments follow consistent -
notation instead of camelcase
URL: https://github.com/apache/incubator-pulsar/pull/2432#issuecomment-415585124
run java8 tests
This is an
srkukarni closed pull request #2433: Made Twitter FireHose to emit records
containing schema information
URL: https://github.com/apache/incubator-pulsar/pull/2433
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake
This is an automated email from the ASF dual-hosted git repository.
sanjeevrk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pulsar.git
The following commit(s) were added to refs/heads/master by this push:
new d6a0ce0 Made Twitter FireHose to
rdhabalia opened a new pull request #2438: Fix: Function assignment can support
large number of topics
URL: https://github.com/apache/incubator-pulsar/pull/2438
### Motivation:
Pulsar function assignment has scalability and performance issue.
Right now,
jerrypeng commented on issue #2437: Race condition function-runtime-manager
read old assignments
URL: https://github.com/apache/incubator-pulsar/pull/2437#issuecomment-415611324
@rdhabalia I am a little confused on how the schedule manager can schedule
something before membership manager
rdhabalia commented on issue #2437: Race condition function-runtime-manager
read old assignments
URL: https://github.com/apache/incubator-pulsar/pull/2437#issuecomment-415612533
> In the scheduleManager, we have a check before invoking actual scheduling:
yes, exactly
sijie opened a new issue #2429: delete inactive topics should not delete topics
that have retention set
URL: https://github.com/apache/incubator-pulsar/issues/2429
*Problem*
If a topic has retention set, brokerDeleteInactiveTopicsEnabled should not
delete those topics.
sijie commented on issue #2430: Namespaces admin commands should be able to
distinguish v1 and v2 namespace format
URL:
https://github.com/apache/incubator-pulsar/issues/2430#issuecomment-415353663
the problem is namespace admin commands don't distinguish v1 and v2 format.
so
sijie closed issue #2429: delete inactive topics should not delete topics that
have retention set
URL: https://github.com/apache/incubator-pulsar/issues/2429
This is an automated message from the Apache Git Service.
To
sijie commented on issue #2429: delete inactive topics should not delete topics
that have retention set
URL:
https://github.com/apache/incubator-pulsar/issues/2429#issuecomment-415351488
sorry I think this is a false alarm. closing the issue.
sijie opened a new issue #2430: Namespaces admin commands should be able to
distinguish v1 and v2 namespace format
URL: https://github.com/apache/incubator-pulsar/issues/2430
Expected behavior
- setup a 2.0.0 cluster
- enable backlog : set-backlog-quotas
ivankelly commented on issue #2401: Consumer often discards received messages
URL:
https://github.com/apache/incubator-pulsar/issues/2401#issuecomment-415368815
What rate are messages arriving at the topic in question?
Is the client processing messages for just this topic, or other
ivankelly commented on issue #2401: Consumer often discards received messages
URL:
https://github.com/apache/incubator-pulsar/issues/2401#issuecomment-415368282
Looks like a bytebuf issue. When reading a bytebuf, we often do things like
reading the size from the packet and setting the
massakam commented on issue #2401: Consumer often discards received messages
URL:
https://github.com/apache/incubator-pulsar/issues/2401#issuecomment-415382210
@ivankelly
> Do you have a reliable repro, or do you just see it happening regularly in
production?
In our environment,
73 matches
Mail list logo
