yanlin-Lynn commented on issue #81: [BAHIR-192]add jdbc sink for structured
streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-478870350
Hi, @pushpendra-jaiswal-90, just to make sure, when you say `merged in
2.4.0-snapshot`, do you mean using dependecy of spark-2.4
yanlin-Lynn edited a comment on issue #81: [BAHIR-192]add jdbc sink for
structured streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-478870350
Hi, @pushpendra-jaiswal-90, just to make sure, when you say `merged in
2.4.0-snapshot`, do you mean using dependecy of spark
pushpendra-jaiswal-90 edited a comment on issue #81: [BAHIR-192]add jdbc sink
for structured streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-478892369
Please merge it to master. That will do.
Current POM.xml of bahir has version 2.4.0-SNAPSHOT
```
pushpendra-jaiswal-90 commented on issue #81: [BAHIR-192]add jdbc sink for
structured streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-478892369
Current POM.xml of bahir has version
```
org.apache.bahir
bahir-parent_2.12
2.4.0-SNAPSHOT
yanlin-Lynn commented on issue #81: [BAHIR-192]add jdbc sink for structured
streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-478893631
OK. Now I got it. Thanks.
This is an automated message from the
yanlin-Lynn edited a comment on issue #81: [BAHIR-192]add jdbc sink for
structured streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-478893631
OK. Now I get it. Thanks.
This is an automated message from
pushpendra-jaiswal-90 commented on issue #81: [BAHIR-192]add jdbc sink for
structured streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-478875828
I meant bahir's 2.4.0 release. Does it depend on spark version.
yanlin-Lynn commented on issue #81: [BAHIR-192]add jdbc sink for structured
streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-478891018
> I meant bahir's 2.4.0 release. Does it depend on spark version.
what do you mean by `bahir's 2.4.0 release`. Not quite
yanlin-Lynn commented on issue #81: [BAHIR-192]add jdbc sink for structured
streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-479454380
> is it possible to add jdbc sink for structured streaming just with a jar,
without changing spark?
Any more details? I do not
ronflomin commented on issue #81: [BAHIR-192]add jdbc sink for structured
streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-479454755
I am using pyspark 2.3, how can I use jdbc sink with structured streaming?
yanlin-Lynn commented on issue #81: [BAHIR-192]add jdbc sink for structured
streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-479461811
> I am using pyspark 2.3, how can I use jdbc sink with structured streaming?
You can compile the bahir project get the jar file
eskabetxe commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268603328
##
File path:
SuXingLee commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268602094
##
File path:
eskabetxe commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268600273
##
File path:
eskabetxe commented on issue #50: [BAHIR-202] Improve KuduSink throughput by
using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#issuecomment-476163665
@lresende LGTM
This is an automated message from
SuXingLee commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268602094
##
File path:
SuXingLee commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268609055
##
File path:
eskabetxe commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268535809
##
File path:
eskabetxe commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268613593
##
File path:
SuXingLee commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268616991
##
File path:
SuXingLee edited a comment on issue #50: [BAHIR-202] Improve KuduSink
throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#issuecomment-47562
@eskabetxe Could you check this
This is an
lresende commented on issue #83: [BAHIR-60] Script to merge pull requests
URL: https://github.com/apache/bahir/pull/83#issuecomment-479611782
Thanks for this @lukasz-antoniak. I really would have hoped you didn't start
from scratch but did small modifications on an existing merge script
asfgit closed pull request #75: [BAHIR-186] Reduce size of sql-cloudant test
database
URL: https://github.com/apache/bahir/pull/75
This is an automated message from the Apache Git Service.
To respond to the message, please
asfgit closed pull request #53: [BAHIR-141] Added support for passing json cred
file as byte array
URL: https://github.com/apache/bahir/pull/53
This is an automated message from the Apache Git Service.
To respond to the
yanlin-Lynn commented on issue #81: [BAHIR-192]add jdbc sink for structured
streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-479725278
> Thank you.
> After I do it, what should I do with the jars? Just load them, and then
use jdbc format in the writer?
>
>
ronflomin commented on issue #81: [BAHIR-192]add jdbc sink for structured
streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-479462390
How can I do it? Im sorry bothering you.
I need to build the whole spark? how can I get only the jdbc sink jar?
yanlin-Lynn commented on issue #81: [BAHIR-192]add jdbc sink for structured
streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-479464401
> How can I do it? Im sorry bothering you.
>
> I need to build the whole spark? how can I get only the jdbc sink jar?
As
ronflomin commented on issue #81: [BAHIR-192]add jdbc sink for structured
streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-479468541
Thank you.
After I do it, what should I do with the jars? Just load them, and then use
jdbc format in the writer?
Why do I
lukasz-antoniak opened a new pull request #84: [BAHIR-183] [WIP] HDFS based
MQTT client persistence
URL: https://github.com/apache/bahir/pull/84
As discussed in the JIRA ticket
(https://issues.apache.org/jira/browse/BAHIR-183), revisited version of HDFS
persistence of MQTT messages,
Wosin opened a new pull request #51: [BAHIR-177] Fixed state recovery for Flink
and fixed size of the reco…
URL: https://github.com/apache/bahir-flink/pull/51
Two issues are meant to be fixed in this PR:
1) As described in BAHIR-177 currently the state recovery of Bahir operators
eskabetxe commented on issue #40: [BAHIR-180] changes to improve eventual
consistence
URL: https://github.com/apache/bahir-flink/pull/40#issuecomment-469342224
@lresende could you check this
This is an automated message from
pushpendra-jaiswal-90 commented on issue #81: [BAHIR-192]add jdbc sink for
structured streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-465106924
Hi
Is there a possibility of this pull request to be merged in 2.4.0-snapshot
?
lresende commented on issue #40: [BAHIR-180] changes to improve eventual
consistence
URL: https://github.com/apache/bahir-flink/pull/40#issuecomment-469479251
@eskabetxe there is still a pom change related to scala versions, other then
that is looking good...
eskabetxe commented on issue #40: [BAHIR-180] changes to improve eventual
consistence
URL: https://github.com/apache/bahir-flink/pull/40#issuecomment-469579944
@lresende its changed
This is an automated message from the
yanlin-Lynn commented on issue #81: [BAHIR-192]add jdbc sink for structured
streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-468194685
> Hi
> Is there a possibility of this pull request to be merged in 2.4.0-snapshot
?
OK, I will do it later in a few days.
pushpendra-jaiswal-90 commented on issue #81: [BAHIR-192]add jdbc sink for
structured streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-473567087
Thank you so much for the update.
This is an automated
pushpendra-jaiswal-90 commented on issue #81: [BAHIR-192]add jdbc sink for
structured streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-472743696
Hi Yanlin
Can you please let me know when is the plan to merge this.
Thanks you
pushpendra-jaiswal-90 edited a comment on issue #81: [BAHIR-192]add jdbc sink
for structured streaming.
URL: https://github.com/apache/bahir/pull/81#issuecomment-472743696
Hi Yanlin
Can you please let me know when is the plan to merge this.
Thanks
eskabetxe opened a new pull request #46: BAHIR-196: update added scala 2.12 and
updated plugins
URL: https://github.com/apache/bahir-flink/pull/46
@lresende could you check this..
its a partial commit of https://jira.apache.org/jira/browse/BAHIR-193
eskabetxe commented on issue #42: Enhanced create RpcClient and FlumeSink
URL: https://github.com/apache/bahir-flink/pull/42#issuecomment-470615388
@lresende LGTM
This is an automated message from the Apache Git Service.
To
asfgit closed pull request #47: [BAHIR-198]: bump flink version to 1.7.2
URL: https://github.com/apache/bahir-flink/pull/47
This is an automated message from the Apache Git Service.
To respond to the message, please log on
asfgit closed pull request #46: BAHIR-196: added scala 2.12 and updated plugins
URL: https://github.com/apache/bahir-flink/pull/46
This is an automated message from the Apache Git Service.
To respond to the message, please
lresende commented on a change in pull request #42: Enhanced create RpcClient
and FlumeSink
URL: https://github.com/apache/bahir-flink/pull/42#discussion_r263544517
##
File path:
flink-connector-flume/src/main/java/org/apache/flink/streaming/connectors/flume/FlumeSink.java
asfgit closed pull request #40: [BAHIR-180] changes to improve eventual
consistence
URL: https://github.com/apache/bahir-flink/pull/40
This is an automated message from the Apache Git Service.
To respond to the message,
asfgit closed pull request #48: [BAHIR-199]: bump kudu version to 1.9.0
URL: https://github.com/apache/bahir-flink/pull/48
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
eskabetxe opened a new pull request #49: [BAHIR-200] change test from docker to
kudu-test-utils
URL: https://github.com/apache/bahir-flink/pull/49
@lresende could you check
This is an automated message from the Apache Git
eskabetxe opened a new pull request #47: [BAHIR-198]: bump flink version to
1.7.2
URL: https://github.com/apache/bahir-flink/pull/47
@lresende could you check
This is an automated message from the Apache Git Service.
To
asfgit closed pull request #42: Enhanced create RpcClient and FlumeSink
URL: https://github.com/apache/bahir-flink/pull/42
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
ambition119 commented on a change in pull request #42: Enhanced create
RpcClient and FlumeSink
URL: https://github.com/apache/bahir-flink/pull/42#discussion_r263636011
##
File path:
flink-connector-flume/src/main/java/org/apache/flink/streaming/connectors/flume/FlumeSink.java
SuXingLee commented on issue #50: [BAHIR-202] Improve KuduSink throughput by
using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#issuecomment-47562
@eskabetxe clould you check this
This is an
eskabetxe commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268150471
##
File path:
SuXingLee opened a new pull request #50: [BAHIR-202] Improve KuduSink
throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50
change is that:
1. Default , KuduSink processing message one by one without checkpoint.
2. when we enable checkpoint , We
eskabetxe commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268246211
##
File path:
SuXingLee commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268253026
##
File path:
SuXingLee commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268224745
##
File path:
SuXingLee commented on issue #50: [BAHIR-202] Improve KuduSink throughput by
using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#issuecomment-475672752
> @SuXingLee you have 12 Checkstyle violations, could you check this
have been fixed
SuXingLee commented on a change in pull request #50: [BAHIR-202] Improve
KuduSink throughput by using async FlushMode
URL: https://github.com/apache/bahir-flink/pull/50#discussion_r268228468
##
File path:
lukasz-antoniak commented on issue #83: [BAHIR-60] Script to merge pull requests
URL: https://github.com/apache/bahir/pull/83#issuecomment-461205259
I have just pushed little more changes (validations, Git account
configuration). Please let me know what you think and if direction is
lukasz-antoniak opened a new pull request #83: [BAHIR-60] Script to merge pull
requests
URL: https://github.com/apache/bahir/pull/83
JIRA ticket: https://issues.apache.org/jira/browse/BAHIR-60
Sample output:
```
$ ./merge-pr.sh 3
Commits to be merged:
8b307bd
ambition119 commented on issue #42: Enhanced create RpcClient and FlumeSink
URL: https://github.com/apache/bahir-flink/pull/42#issuecomment-464568304
@eskabetxe @lresende I improved the existing FlumeSink and removed the code
content of v2.
The improvements are:
Richly create the
ambition119 edited a comment on issue #42: Enhanced create RpcClient and
FlumeSink
URL: https://github.com/apache/bahir-flink/pull/42#issuecomment-464568304
@eskabetxe @lresende I improved the existing FlumeSink and removed the code
content of v2.
The improvements are:
Richly
ambition119 edited a comment on issue #42: Enhanced create RpcClient and
FlumeSink
URL: https://github.com/apache/bahir-flink/pull/42#issuecomment-464568304
@eskabetxe @lresende I improved the existing FlumeSink and removed the code
content of v2.
The improvements are:
Richly
asfgit closed pull request #41: [BAHIR-191] updated flume version to 1.9.0
URL: https://github.com/apache/bahir-flink/pull/41
This is an automated message from the Apache Git Service.
To respond to the message, please log
eskabetxe opened a new pull request #45: BAHIR-195: bump flink version to 1.7.1
URL: https://github.com/apache/bahir-flink/pull/45
@lresende
This is an automated message from the Apache Git Service.
To respond to the
lresende commented on issue #43: BAHIR-193: facilitate scala version change
URL: https://github.com/apache/bahir-flink/pull/43#issuecomment-462163044
With your proposed change, how do you build different versions of Scala?
Also, for a downstream consumer, how will it use 2.11 versus 2.12
eskabetxe commented on issue #43: BAHIR-193: facilitate scala version change
URL: https://github.com/apache/bahir-flink/pull/43#issuecomment-462183259
hi @lresende, this approach its the same as flink and other projects
the parent really is for compilation, if you change de scala version
eskabetxe commented on issue #40: [BAHIR-180] changes to improve eventual
consistence
URL: https://github.com/apache/bahir-flink/pull/40#issuecomment-462184810
@lresende downgrade versions.. i will create new PR for that
lresende commented on issue #43: BAHIR-193: facilitate scala version change
URL: https://github.com/apache/bahir-flink/pull/43#issuecomment-462211901
Flink seems to use something similar, but most of other projects I have
worked before (e.g. Apache Spark) use the current approach used in
lresende edited a comment on issue #43: BAHIR-193: facilitate scala version
change
URL: https://github.com/apache/bahir-flink/pull/43#issuecomment-462211901
Flink seems to use something similar, but most of the other projects I have
worked before (e.g. Apache Spark) use the current
eskabetxe commented on issue #43: BAHIR-193: facilitate scala version change
URL: https://github.com/apache/bahir-flink/pull/43#issuecomment-462261931
The artifacts will have de correctly _2.11 or _2.12 as you activate the
right profile , and the dependencies will be created with the right
FResende opened a new pull request #15: Update repository links to gitbox
URL: https://github.com/apache/bahir-website/pull/15
This is an automated message from the Apache Git Service.
To respond to the message, please log
ckadner commented on issue #75: [BAHIR-186] Reduce size of sql-cloudant test
database
URL: https://github.com/apache/bahir/pull/75#issuecomment-460471642
@emlaver -- your changes look good and help speeding up the test execution
I do have an issue that predates your changes
ckadner edited a comment on issue #75: [BAHIR-186] Reduce size of sql-cloudant
test database
URL: https://github.com/apache/bahir/pull/75#issuecomment-460471642
@emlaver -- your changes look good and help speeding up the test execution
I do have an issue that may predate your
eskabetxe opened a new pull request #43: BAHIR-193: change project to
facilitate scala version change
URL: https://github.com/apache/bahir-flink/pull/43
@lresende can you check this change
This is an automated message from
eskabetxe commented on issue #42: Enhanced create RpcClient and FlumeSink
URL: https://github.com/apache/bahir-flink/pull/42#issuecomment-460652537
thanks for the PR, its a great improvement of flume connector.
but, why have you created a new sink instead of improving the existing one?
lukasz-antoniak opened a new pull request #85: [BAHIR-203] Manual acknowledge
PubSub messages
URL: https://github.com/apache/bahir/pull/85
JIRA ticket: https://issues.apache.org/jira/browse/BAHIR-203
This is an automated
yanlin-Lynn commented on issue #84: [BAHIR-183] [WIP] HDFS based MQTT client
persistence
URL: https://github.com/apache/bahir/pull/84#issuecomment-481153409
Sorry to keep you wait, I will review this PR in a few days.
This
rmetzger commented on issue #52: [BAHIR-204] [activemq] ActiveMQ Source only
emits previously unproce…
URL: https://github.com/apache/bahir-flink/pull/52#issuecomment-483036265
Merging this change ...
This is an automated
rmetzger merged pull request #52: [BAHIR-204] [activemq] ActiveMQ Source only
emits previously unproce…
URL: https://github.com/apache/bahir-flink/pull/52
This is an automated message from the Apache Git Service.
To respond
rmetzger commented on issue #52: [BAHIR-204] [activemq] ActiveMQ Source only
emits previously unproce…
URL: https://github.com/apache/bahir-flink/pull/52#issuecomment-483036390
Thank you!
This is an automated message from
soymo opened a new pull request #86: [MINOR] Handle case when no messages from
pubsub
URL: https://github.com/apache/bahir/pull/86
Method getReceivedMessages returns NULL when there is no message in
a subscription. Store for processing in Spark and prepare the ACK request
only when,
asfgit closed pull request #54: [BAHIR-206] bump flink version to 1.8.0
URL: https://github.com/apache/bahir-flink/pull/54
This is an automated message from the Apache Git Service.
To respond to the message, please log on to
lresende commented on issue #54: [BAHIR-206] bump flink version to 1.8.0
URL: https://github.com/apache/bahir-flink/pull/54#issuecomment-493604796
Looks like I went too aggressive on approving the PR based on the Travis ci
build status. This PR needs to update Travis to see that Flink
asfgit closed pull request #51: [BAHIR-177] Fixed state recovery for Flink and
fixed size of the reco…
URL: https://github.com/apache/bahir-flink/pull/51
This is an automated message from the Apache Git Service.
To respond
asfgit closed pull request #53: [BAHIR-190] [activemq] Fixed premature exit on
empty queue
URL: https://github.com/apache/bahir-flink/pull/53
This is an automated message from the Apache Git Service.
To respond to the
eskabetxe opened a new pull request #54: [BAHIR-206] bump flink version to 1.8.0
URL: https://github.com/apache/bahir-flink/pull/54
bump flink version
This is an automated message from the Apache Git Service.
To respond to
liketic opened a new pull request #57: [BAHIR-205] Support configure password
for redis cluster
URL: https://github.com/apache/bahir-flink/pull/57
Upgrade jedis to 2.9.0 and add password for redis cluster sink.
This is an
lresende merged pull request #49: [BAHIR-200] change test from docker to
kudu-test-utils
URL: https://github.com/apache/bahir-flink/pull/49
This is an automated message from the Apache Git Service.
To respond to the
jacek-rzrz commented on issue #76: [BAHIR-107] Upgrade to Scala 2.12 and Spark
2.4.0
URL: https://github.com/apache/bahir/pull/76#issuecomment-497775256
I cannot find the Scala 2.12 / Spark 2.4 version of spark-streaming-pubsub
in Maven central yet. Is there a chance it will be released
eskabetxe opened a new pull request #59: [BAHIR-207] added tests for scala 2.12
on travis
URL: https://github.com/apache/bahir-flink/pull/59
This is an automated message from the Apache Git Service.
To respond to the
eskabetxe closed pull request #58: [BAHIR-207] added tests for scala 2.12 on
travis
URL: https://github.com/apache/bahir-flink/pull/58
This is an automated message from the Apache Git Service.
To respond to the message,
eskabetxe commented on issue #58: [BAHIR-207] added tests for scala 2.12 on
travis
URL: https://github.com/apache/bahir-flink/pull/58#issuecomment-499870536
@lresende could you check
This is an automated message from the
eskabetxe commented on a change in pull request #57: [BAHIR-205] Support
configure password for redis cluster
URL: https://github.com/apache/bahir-flink/pull/57#discussion_r291568219
##
File path:
liketic commented on a change in pull request #57: [BAHIR-205] Support
configure password for redis cluster
URL: https://github.com/apache/bahir-flink/pull/57#discussion_r291611667
##
File path:
eskabetxe commented on issue #57: [BAHIR-205] Support configure password for
redis cluster
URL: https://github.com/apache/bahir-flink/pull/57#issuecomment-499937632
@lresende LGTM
This is an automated message from the Apache
lresende commented on issue #53: [BAHIR-190] [activemq] Fixed premature exit on
empty queue
URL: https://github.com/apache/bahir-flink/pull/53#issuecomment-497126213
@Krystex Nothing wrong, your PR has been merged (manually) and you can see
the info above: `asfgit closed this in e5b1cae
lresende merged pull request #81: [BAHIR-192]add jdbc sink for structured
streaming.
URL: https://github.com/apache/bahir/pull/81
This is an automated message from the Apache Git Service.
To respond to the message, please
lresende opened a new pull request #89: Fix Build warnings
URL: https://github.com/apache/bahir/pull/89
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
emlaver opened a new pull request #90: Updated sql-cloudant dependencies
URL: https://github.com/apache/bahir/pull/90
_What_
Updated sql-cloudant dependencies
_How_
- Bumped java-cloudant to 2.17.0 and okhttp to 3.12.2
_Test_
- Updated exception message in failing
lresende merged pull request #90: Updated sql-cloudant dependencies
URL: https://github.com/apache/bahir/pull/90
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub
1 - 100 of 798 matches
Mail list logo