[jira] [Updated] (BAHIR-274) Add Flink InfluxDBv2.0 Connector
[ https://issues.apache.org/jira/browse/BAHIR-274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated BAHIR-274: - Description: https://github.com/apache/bahir-flink/pull/114 > Add Flink InfluxDBv2.0 Connector > > > Key: BAHIR-274 > URL: https://issues.apache.org/jira/browse/BAHIR-274 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Reporter: Robert Metzger >Priority: Major > > https://github.com/apache/bahir-flink/pull/114 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (BAHIR-274) Add Flink InfluxDBv2.0 Connector
Robert Metzger created BAHIR-274: Summary: Add Flink InfluxDBv2.0 Connector Key: BAHIR-274 URL: https://issues.apache.org/jira/browse/BAHIR-274 Project: Bahir Issue Type: New Feature Components: Flink Streaming Connectors Reporter: Robert Metzger -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Closed] (BAHIR-274) Add Flink InfluxDBv2.0 Connector
[ https://issues.apache.org/jira/browse/BAHIR-274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger closed BAHIR-274. Fix Version/s: Flink-Next Resolution: Fixed > Add Flink InfluxDBv2.0 Connector > > > Key: BAHIR-274 > URL: https://issues.apache.org/jira/browse/BAHIR-274 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Reporter: Robert Metzger >Priority: Major > Fix For: Flink-Next > > > https://github.com/apache/bahir-flink/pull/114 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (BAHIR-279) Publish lastest flink-connector-redis
[ https://issues.apache.org/jira/browse/BAHIR-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17400802#comment-17400802 ] Robert Metzger commented on BAHIR-279: -- Thanks for bringing this up. I'll start a discussion in the community about releasing bahir-flink 1.1 > Publish lastest flink-connector-redis > - > > Key: BAHIR-279 > URL: https://issues.apache.org/jira/browse/BAHIR-279 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Hongbo Miao >Priority: Minor > > Dear Sir/Madam, > > It would be great to publish the lastest *flink-connector-redis*. > I recently asked a question about how to set TTL to make Redis keys expire in > *flink-connector-redis* at > [https://stackoverflow.com/questions/68795044/how-to-set-ttl-to-make-redis-keys-expire-in-flink-connector-redis] > Then I realized the TTL related code already got merged about 2 years ago, > but the new package *flink-connector-redis* never got released. > > It would be great to release the lastest *flink-connector-redis*, thanks! > > Best > Hongbo -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (BAHIR-280) Could not transfer artifact org.quartz-scheduler.wso2:quartz:pom:2.1.1.wso2v1
Robert Metzger created BAHIR-280:
Summary: Could not transfer artifact
org.quartz-scheduler.wso2:quartz:pom:2.1.1.wso2v1
Key: BAHIR-280
URL: https://issues.apache.org/jira/browse/BAHIR-280
Project: Bahir
Issue Type: Bug
Components: Flink Streaming Connectors
Reporter: Robert Metzger
It seems that the build is currently failing with this error
{code}
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 02:08 min
[INFO] Finished at: 2021-08-19T10:22:16+02:00
[INFO]
[ERROR] Failed to execute goal on project flink-library-siddhi_2.11: Could not
resolve dependencies for project
org.apache.bahir:flink-library-siddhi_2.11:jar:1.1-SNAPSHOT: Failed to collect
dependencies at org.wso2.siddhi:siddhi-core:jar:4.3.14 ->
org.quartz-scheduler.wso2:quartz:jar:2.1.1.wso2v1: Failed to read artifact
descriptor for org.quartz-scheduler.wso2:quartz:jar:2.1.1.wso2v1: Could not
transfer artifact org.quartz-scheduler.wso2:quartz:pom:2.1.1.wso2v1 from/to
maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for repositories:
[wso2-nexus (http://maven.wso2.org/nexus/content/groups/wso2-public/, default,
releases+snapshots), wso2.releases
(http://maven.wso2.org/nexus/content/repositories/releases/, default,
releases+snapshots), wso2.snapshots
(http://maven.wso2.org/nexus/content/repositories/snapshots/, default,
snapshots), central (http://repo1.maven.org/maven2, default, releases)] ->
[Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please
read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn -rf :flink-library-siddhi_2.11
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (BAHIR-280) Could not transfer artifact org.quartz-scheduler.wso2:quartz:pom:2.1.1.wso2v1
[
https://issues.apache.org/jira/browse/BAHIR-280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414474#comment-17414474
]
Robert Metzger commented on BAHIR-280:
--
It seems the first version where this is fixed in siddhi is "v5.1.13":
https://github.com/siddhi-io/siddhi/commit/fdae8bc1fd5dc53d93e847465205e11d2f2634a1
> Could not transfer artifact org.quartz-scheduler.wso2:quartz:pom:2.1.1.wso2v1
> -
>
> Key: BAHIR-280
> URL: https://issues.apache.org/jira/browse/BAHIR-280
> Project: Bahir
> Issue Type: Bug
> Components: Flink Streaming Connectors
>Reporter: Robert Metzger
>Priority: Blocker
>
> It seems that the build is currently failing with this error
> {code}
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 02:08 min
> [INFO] Finished at: 2021-08-19T10:22:16+02:00
> [INFO]
>
> [ERROR] Failed to execute goal on project flink-library-siddhi_2.11: Could
> not resolve dependencies for project
> org.apache.bahir:flink-library-siddhi_2.11:jar:1.1-SNAPSHOT: Failed to
> collect dependencies at org.wso2.siddhi:siddhi-core:jar:4.3.14 ->
> org.quartz-scheduler.wso2:quartz:jar:2.1.1.wso2v1: Failed to read artifact
> descriptor for org.quartz-scheduler.wso2:quartz:jar:2.1.1.wso2v1: Could not
> transfer artifact org.quartz-scheduler.wso2:quartz:pom:2.1.1.wso2v1 from/to
> maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for
> repositories: [wso2-nexus
> (http://maven.wso2.org/nexus/content/groups/wso2-public/, default,
> releases+snapshots), wso2.releases
> (http://maven.wso2.org/nexus/content/repositories/releases/, default,
> releases+snapshots), wso2.snapshots
> (http://maven.wso2.org/nexus/content/repositories/snapshots/, default,
> snapshots), central (http://repo1.maven.org/maven2, default, releases)] ->
> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn -rf :flink-library-siddhi_2.11
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (BAHIR-280) Could not transfer artifact org.quartz-scheduler.wso2:quartz:pom:2.1.1.wso2v1
[
https://issues.apache.org/jira/browse/BAHIR-280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17414482#comment-17414482
]
Robert Metzger commented on BAHIR-280:
--
The repo currently referenced by bahir only contains versions up until "4.5.9":
https://maven.wso2.org/nexus/content/repositories/releases/org/wso2/siddhi/siddhi-core/
Upgrading to 5.1.13 would require changing a lot in the code:
https://search.maven.org/artifact/io.siddhi/siddhi-core/5.1.13/bundle.
To facilitate a fast release, I propose to remove the siddhi library from the
build.
> Could not transfer artifact org.quartz-scheduler.wso2:quartz:pom:2.1.1.wso2v1
> -
>
> Key: BAHIR-280
> URL: https://issues.apache.org/jira/browse/BAHIR-280
> Project: Bahir
> Issue Type: Bug
> Components: Flink Streaming Connectors
>Reporter: Robert Metzger
>Priority: Blocker
>
> It seems that the build is currently failing with this error
> {code}
> [INFO] BUILD FAILURE
> [INFO]
>
> [INFO] Total time: 02:08 min
> [INFO] Finished at: 2021-08-19T10:22:16+02:00
> [INFO]
>
> [ERROR] Failed to execute goal on project flink-library-siddhi_2.11: Could
> not resolve dependencies for project
> org.apache.bahir:flink-library-siddhi_2.11:jar:1.1-SNAPSHOT: Failed to
> collect dependencies at org.wso2.siddhi:siddhi-core:jar:4.3.14 ->
> org.quartz-scheduler.wso2:quartz:jar:2.1.1.wso2v1: Failed to read artifact
> descriptor for org.quartz-scheduler.wso2:quartz:jar:2.1.1.wso2v1: Could not
> transfer artifact org.quartz-scheduler.wso2:quartz:pom:2.1.1.wso2v1 from/to
> maven-default-http-blocker (http://0.0.0.0/): Blocked mirror for
> repositories: [wso2-nexus
> (http://maven.wso2.org/nexus/content/groups/wso2-public/, default,
> releases+snapshots), wso2.releases
> (http://maven.wso2.org/nexus/content/repositories/releases/, default,
> releases+snapshots), wso2.snapshots
> (http://maven.wso2.org/nexus/content/repositories/snapshots/, default,
> snapshots), central (http://repo1.maven.org/maven2, default, releases)] ->
> [Help 1]
> [ERROR]
> [ERROR] To see the full stack trace of the errors, re-run Maven with the -e
> switch.
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions, please
> read the following articles:
> [ERROR] [Help 1]
> http://cwiki.apache.org/confluence/display/MAVEN/DependencyResolutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR] mvn -rf :flink-library-siddhi_2.11
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Updated] (BAHIR-54) Create initial directory structure in bahir-flink.git
[ https://issues.apache.org/jira/browse/BAHIR-54?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated BAHIR-54: Summary: Create initial directory structure in bahir-flink.git (was: Create initial directory structure in bahir-flink) > Create initial directory structure in bahir-flink.git > - > > Key: BAHIR-54 > URL: https://issues.apache.org/jira/browse/BAHIR-54 > Project: Bahir > Issue Type: Task >Reporter: Robert Metzger > > As per INFRA-12440, the bahir-flink repository has been created. > We need to set up the initial directory structure in that repository (license > file, maven pom, ...) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (BAHIR-54) Create initial directory structure in bahir-flink
Robert Metzger created BAHIR-54: --- Summary: Create initial directory structure in bahir-flink Key: BAHIR-54 URL: https://issues.apache.org/jira/browse/BAHIR-54 Project: Bahir Issue Type: Task Reporter: Robert Metzger As per INFRA-12440, the bahir-flink repository has been created. We need to set up the initial directory structure in that repository (license file, maven pom, ...) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (BAHIR-54) Create initial directory structure in bahir-flink.git
[ https://issues.apache.org/jira/browse/BAHIR-54?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15427816#comment-15427816 ] Robert Metzger commented on BAHIR-54: - Thank you. Could you create a "Flink Streaming Connectors" component in JIRA? > Create initial directory structure in bahir-flink.git > - > > Key: BAHIR-54 > URL: https://issues.apache.org/jira/browse/BAHIR-54 > Project: Bahir > Issue Type: Task >Reporter: Robert Metzger > > As per INFRA-12440, the bahir-flink repository has been created. > We need to set up the initial directory structure in that repository (license > file, maven pom, ...) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (BAHIR-55) Move Redis Sink from Flink to Bahir
Robert Metzger created BAHIR-55: --- Summary: Move Redis Sink from Flink to Bahir Key: BAHIR-55 URL: https://issues.apache.org/jira/browse/BAHIR-55 Project: Bahir Issue Type: New Feature Reporter: Robert Metzger As per http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Move-Redis-and-Flume-connectors-to-Apache-Bahir-and-redirect-contributions-there-td13102.html, the Flink community agreed to move the Redis connector to Bahir. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (BAHIR-56) Add ActiveMQ streaming connector for Flink
Robert Metzger created BAHIR-56: --- Summary: Add ActiveMQ streaming connector for Flink Key: BAHIR-56 URL: https://issues.apache.org/jira/browse/BAHIR-56 Project: Bahir Issue Type: New Feature Components: Flink Streaming Connectors Reporter: Robert Metzger -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (BAHIR-56) Add ActiveMQ streaming connector for Flink
[ https://issues.apache.org/jira/browse/BAHIR-56?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15430435#comment-15430435 ] Robert Metzger commented on BAHIR-56: - There is already a pending pull request for an ActiveMQ connector in Flink, that I would like to merge to Bahir: https://github.com/apache/flink/pull/2314 > Add ActiveMQ streaming connector for Flink > -- > > Key: BAHIR-56 > URL: https://issues.apache.org/jira/browse/BAHIR-56 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Reporter: Robert Metzger > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (BAHIR-57) Add Flume sink from Flink to Bahir
Robert Metzger created BAHIR-57: --- Summary: Add Flume sink from Flink to Bahir Key: BAHIR-57 URL: https://issues.apache.org/jira/browse/BAHIR-57 Project: Bahir Issue Type: New Feature Components: Flink Streaming Connectors Reporter: Robert Metzger -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Assigned] (BAHIR-57) Add Flume sink from Flink to Bahir
[ https://issues.apache.org/jira/browse/BAHIR-57?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger reassigned BAHIR-57: --- Assignee: Robert Metzger > Add Flume sink from Flink to Bahir > -- > > Key: BAHIR-57 > URL: https://issues.apache.org/jira/browse/BAHIR-57 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Reporter: Robert Metzger >Assignee: Robert Metzger > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (BAHIR-58) Add ActiveMQ streaming connector to Bahir
Robert Metzger created BAHIR-58: --- Summary: Add ActiveMQ streaming connector to Bahir Key: BAHIR-58 URL: https://issues.apache.org/jira/browse/BAHIR-58 Project: Bahir Issue Type: New Feature Components: Flink Streaming Connectors Reporter: Robert Metzger Assignee: Robert Metzger There is a pending pull request for adding a ActiveMQ connector at the Flink project: https://github.com/apache/flink/pull/2314 The PR author agreed that I can move the connector to Bahir. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (BAHIR-59) Improve ActiveMQ Connector
Robert Metzger created BAHIR-59: --- Summary: Improve ActiveMQ Connector Key: BAHIR-59 URL: https://issues.apache.org/jira/browse/BAHIR-59 Project: Bahir Issue Type: Improvement Components: Flink Streaming Connectors Affects Versions: Flink-0.1 Reporter: Robert Metzger While trying out the ActiveMQ connector for Flink, I found some issues that I would like to address using this JIRA. - Make AMQSource constructor public - Improve error messages on wrong configuration -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (BAHIR-59) Improve ActiveMQ Connector
[
https://issues.apache.org/jira/browse/BAHIR-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15468438#comment-15468438
]
Robert Metzger commented on BAHIR-59:
-
[~ivan.mushketyk] I wonder if it is intended to close the {{AMQSource}} when a
{{null}} message is received.
I think in Flink, people want the connectors to be running all the time,
listening to new, incoming messages. Thoughts?
> Improve ActiveMQ Connector
> --
>
> Key: BAHIR-59
> URL: https://issues.apache.org/jira/browse/BAHIR-59
> Project: Bahir
> Issue Type: Improvement
> Components: Flink Streaming Connectors
>Affects Versions: Flink-0.1
>Reporter: Robert Metzger
>
> While trying out the ActiveMQ connector for Flink, I found some issues that I
> would like to address using this JIRA.
> - Make AMQSource constructor public
> - Improve error messages on wrong configuration
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Resolved] (BAHIR-56) Add ActiveMQ streaming connector for Flink
[ https://issues.apache.org/jira/browse/BAHIR-56?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved BAHIR-56. - Resolution: Fixed Assignee: Robert Metzger Fix Version/s: Flink-0.1 Resolved in https://github.com/apache/bahir-flink/commit/1f839d510d3b166afa0dfd80ef3cc5f7d02b4f1e > Add ActiveMQ streaming connector for Flink > -- > > Key: BAHIR-56 > URL: https://issues.apache.org/jira/browse/BAHIR-56 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Reporter: Robert Metzger >Assignee: Robert Metzger > Fix For: Flink-0.1 > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (BAHIR-72) support netty: pushed tcp/http connector
[ https://issues.apache.org/jira/browse/BAHIR-72?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved BAHIR-72. - Resolution: Resolved Assignee: shijinkui Fix Version/s: Flink-0.1 Resolved in https://github.com/apache/bahir-flink/commit/2d1225f9a3c5401c48267b5bcef49b19254ea3aa > support netty: pushed tcp/http connector > > > Key: BAHIR-72 > URL: https://issues.apache.org/jira/browse/BAHIR-72 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Reporter: shijinkui >Assignee: shijinkui > Fix For: Flink-0.1 > > > Also discuss from flink: https://issues.apache.org/jira/browse/FLINK-4630 > When source stream get start, listen a provided tcp port, receive stream data > from user data source. > This netty tcp source is keepping alive and end-to-end, that is from business > system to flink worker directly. > Such source service is needed in produce indeed. > describe the source in detail below: > 1.source run as a netty tcp and http server > 2.user provide a tcp port, if the port is in used, increace the port > number between 1024 to 65535. Source can parallel. > 3.callback the provided url to report the real port to listen > 4.user push streaming data to netty server, then collect the data to flink -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (BAHIR-90) Bahir website missing docs, source links, download for Flink extensions
[ https://issues.apache.org/jira/browse/BAHIR-90?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15889900#comment-15889900 ] Robert Metzger commented on BAHIR-90: - Can somebody give Gordon contributor permissions in this JIRA so that we can assign him to the issue? > Bahir website missing docs, source links, download for Flink extensions > --- > > Key: BAHIR-90 > URL: https://issues.apache.org/jira/browse/BAHIR-90 > Project: Bahir > Issue Type: Task > Components: Website >Affects Versions: Flink-0.1 >Reporter: Christian Kadner > > The [Apache Bahir website|http://bahir.apache.org/] is missing download link, > source repository links and documentation for the Apache Flink extensions. > There also is a typo on the landing page missing the letter L in "Flink". -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (BAHIR-93) Wrong version in README.md for several Apache Flink extensions
[
https://issues.apache.org/jira/browse/BAHIR-93?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Metzger resolved BAHIR-93.
-
Resolution: Fixed
Fix Version/s: Flink-0.1
> Wrong version in README.md for several Apache Flink extensions
> --
>
> Key: BAHIR-93
> URL: https://issues.apache.org/jira/browse/BAHIR-93
> Project: Bahir
> Issue Type: Bug
> Components: Flink Streaming Connectors
>Reporter: Tzu-Li (Gordon) Tai
> Fix For: Flink-0.1
>
>
> In several Apache Flink extensions (redis, activemq, netty, etc.), the
> current version is incorrectly {{1.0}} (missing "SNAPSHOT" tag).
> Also, in the akka extension, the version is {{1.0.0-SNAPSHOT}} (From the
> looks of https://www.mail-archive.com/dev@bahir.apache.org/msg00448.html, it
> seems like the agreed version format is "major-minor" for the {{bahir-flink}}
> module).
> Therefore, we should uniformly correct them to be {{1.0-SNAPSHOT}}. I think
> we should do this before creating the first {{bahir-flink}} release.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Resolved] (BAHIR-94) Apache Flink extension READMEs should include link to Flink's "Linking with Optional Modules" doc
[ https://issues.apache.org/jira/browse/BAHIR-94?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved BAHIR-94. - Resolution: Fixed Fix Version/s: Flink-0.1 > Apache Flink extension READMEs should include link to Flink's "Linking with > Optional Modules" doc > - > > Key: BAHIR-94 > URL: https://issues.apache.org/jira/browse/BAHIR-94 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Tzu-Li (Gordon) Tai > Fix For: Flink-0.1 > > > Without this link, Bahir users will most likely bump into questions when > trying to include the connector for Flink cluster execution. > We should also try to improve the overall doc quality of the Flink extensions > for the 1.0 release. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Resolved] (BAHIR-91) Upgrade bahir-flink to support Flink 1.2
[
https://issues.apache.org/jira/browse/BAHIR-91?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Metzger resolved BAHIR-91.
-
Resolution: Fixed
Resolved. Thank you Gordon!
> Upgrade bahir-flink to support Flink 1.2
>
>
> Key: BAHIR-91
> URL: https://issues.apache.org/jira/browse/BAHIR-91
> Project: Bahir
> Issue Type: New Feature
> Components: Flink Streaming Connectors
>Affects Versions: Flink-0.1
> Environment: Ubuntu Yakkety Yak
>Reporter: Markus Müller
>Assignee: Tzu-Li (Gordon) Tai
> Fix For: Flink-0.1
>
>
> After working around https://issues.apache.org/jira/browse/FLINK-4813 by
> specifying Flink version 1.3-SNAPSHOT instead of 1.2.0 in the bahir-flink pom
> file, I get the following compiler errors for the ActiveMQ connector:
> {code}
> ERROR]
> /home/markus/src/bahir-flink/flink-connector-activemq/src/test/java/org/apache/flink/streaming/connectors/activemq/ActiveMQConnectorITCase.java:[32,33]
> error: cannot find symbol
> [ERROR] symbol: class ForkableFlinkMiniCluster
> location: package org.apache.flink.test.util
> /home/markus/src/bahir-flink/flink-connector-activemq/src/test/java/org/apache/flink/streaming/connectors/activemq/ActiveMQConnectorITCase.java:[54,19]
> error: cannot find symbol
> [ERROR] symbol: class ForkableFlinkMiniCluster
> location: class ActiveMQConnectorITCase
> /home/markus/src/bahir-flink/flink-connector-activemq/src/test/java/org/apache/flink/streaming/connectors/activemq/ActiveMQConnectorITCase.java:[66,20]
> error: cannot find symbol
> [ERROR] symbol: class ForkableFlinkMiniCluster
> location: class ActiveMQConnectorITCase
> /home/markus/src/bahir-flink/flink-connector-activemq/src/test/java/org/apache/flink/streaming/connectors/activemq/ActiveMQConnectorITCase.java:[216,22]
> error: method snapshotState in class
> MessageAcknowledgingSourceBase cannot be applied to given types;
> [ERROR] required: FunctionSnapshotContext
> found: long,long
> reason: actual and formal argument lists differ in length
> where Type,UId are type-variables:
> Type extends Object declared in class MessageAcknowledgingSourceBase
> UId extends Object declared in class MessageAcknowledgingSourceBase
> /home/markus/src/bahir-flink/flink-connector-activemq/src/test/java/org/apache/flink/streaming/connectors/activemq/ActiveMQConnectorITCase.java:[229,4]
> error: ActiveMQConnectorITCase.TestSourceContext is not abstract and does
> not override abstract method markAsTemporarilyIdle() in SourceContext
> Excluding ActiveMQ from compilation leads to the next issue in the
> Akka-Connector:
> [ERROR]
> /home/markus/src/bahir-flink/flink-connector-akka/src/test/java/org/apache/flink/streaming/connectors/akka/AkkaSourceTest.java:[210,17]
> error: DummySourceContext is not abstract and does not override abstract
> method markAsTemporarilyIdle() in SourceContext
> [INFO] 1 error
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (BAHIR-85) Redis Sink Connector should allow update of command without reinstatiation
[ https://issues.apache.org/jira/browse/BAHIR-85?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15895734#comment-15895734 ] Robert Metzger commented on BAHIR-85: - [~atharvai] Thank you for opening a pull request. Before opening a pull request, I would like to discuss the implementation approach for solving the problem. > Redis Sink Connector should allow update of command without reinstatiation > --- > > Key: BAHIR-85 > URL: https://issues.apache.org/jira/browse/BAHIR-85 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Atharva Inamdar > > ref: FLINK-5478 > `getCommandDescription()` gets called when RedisSink is instantiated. This > happens only once and thus doesn't allow the command to be updated during run > time. > Use Case: > As a dev I want to store some data by day. So each key will have some date > specified. this will change over course of time. for example: > `counts_for_148426560` for 2017-01-13. This is not limited to any > particular command. > connector: > https://github.com/apache/bahir-flink/blob/master/flink-connector-redis/src/main/java/org/apache/flink/streaming/connectors/redis/RedisSink.java#L114 > I wish `getCommandDescription()` could be called in `invoke()` so that the > key can be updated without having to restart. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-95) Add ZREM to the Redis streaming connector in Flink
[ https://issues.apache.org/jira/browse/BAHIR-95?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15924157#comment-15924157 ] Robert Metzger commented on BAHIR-95: - [~ckadner] or [~luciano resende] Can you give Aris contributor permissions, assign him and close the JIRA? Is there a way to give me access to the "Admin" of this JIRA as well so that I can add contributors in the future? > Add ZREM to the Redis streaming connector in Flink > -- > > Key: BAHIR-95 > URL: https://issues.apache.org/jira/browse/BAHIR-95 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Reporter: Aris Koliopoulos >Priority: Minor > > It would be beneficial to add the ZREM command to the supported Redis commands -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (BAHIR-127) Move “flink-connector-wikiedits” from Flink to Bahir
[ https://issues.apache.org/jira/browse/BAHIR-127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16168419#comment-16168419 ] Robert Metzger commented on BAHIR-127: -- This is the corresponding Flink issue: https://issues.apache.org/jira/browse/FLINK-7510 > Move “flink-connector-wikiedits” from Flink to Bahir > > > Key: BAHIR-127 > URL: https://issues.apache.org/jira/browse/BAHIR-127 > Project: Bahir > Issue Type: Sub-task > Components: Flink Streaming Connectors >Reporter: Hai Zhou >Assignee: Hai Zhou > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BAHIR-134) Add InfluxDB Sink for Flink Streaming
[ https://issues.apache.org/jira/browse/BAHIR-134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved BAHIR-134. -- Resolution: Fixed Fix Version/s: Flink-Next Resolved in https://github.com/apache/bahir-flink/commit/f07276eef2babc52ffdb43c5fcb76f9d51b9153f > Add InfluxDB Sink for Flink Streaming > - > > Key: BAHIR-134 > URL: https://issues.apache.org/jira/browse/BAHIR-134 > Project: Bahir > Issue Type: Wish > Components: Flink Streaming Connectors >Reporter: Hai Zhou_UTC+8 >Assignee: Hai Zhou_UTC+8 > Fix For: Flink-Next > > > InfluxDBSink via implementation RichSinkFunction. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BAHIR-145) Flink Sink for Redis cannot perform PFADD
[
https://issues.apache.org/jira/browse/BAHIR-145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Metzger resolved BAHIR-145.
--
Resolution: Fixed
Fix Version/s: Flink-Next
> Flink Sink for Redis cannot perform PFADD
> -
>
> Key: BAHIR-145
> URL: https://issues.apache.org/jira/browse/BAHIR-145
> Project: Bahir
> Issue Type: Bug
> Components: Flink Streaming Connectors
>Reporter: O Phiradet
> Fix For: Flink-Next
>
>
> Hi All,
> I have been using the Flink streaming connector for Redis Cluster. I have
> found the connector cannot perform PFADD command correctly. The root cause is
> a typo in the method {{pfadd}} of
> {{org.apache.flink.streaming.connectors.redis.common.container.RedisClusterContainer}}.
> The method {{pfadd}} of {{jedisCluster}} should be called, not {{set}}.
> This bug will lead to an error when trying to retrieve value with {{PFCOUNT}}
> command in redis-cli, but {{GET}} works fine.
> {code:none}
> redis 127.0.0.1:7000> PFCOUNT hll-key
> (error) WRONGTYPE Key is not a valid HyperLogLog string value.
> redis 127.0.0.1:7000> GET hll-key
> "req_1"
> {code}
> Best regards,
> Phiradet
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Assigned] (BAHIR-144) Add Siddhi CEP integration with Flink streaming
[
https://issues.apache.org/jira/browse/BAHIR-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Metzger reassigned BAHIR-144:
Assignee: Hao Chen
> Add Siddhi CEP integration with Flink streaming
> ---
>
> Key: BAHIR-144
> URL: https://issues.apache.org/jira/browse/BAHIR-144
> Project: Bahir
> Issue Type: New Feature
> Components: Flink Streaming Connectors
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: Flink-Next
>
>
> Moved from:
> * https://issues.apache.org/jira/browse/FLINK-4520
> * https://github.com/apache/flink/pull/2487
> Siddhi CEP is a lightweight and easy-to-use Open Source Complex Event
> Processing Engine (CEP) released as a Java Library under `Apache Software
> License v2.0`. Siddhi CEP processes events which are generated by various
> event sources, analyses them and notifies appropriate complex events
> according to the user specified queries.
> **It would be very helpful for flink users (especially streaming application
> developer) to provide a library to run Siddhi CEP query directly in Flink
> streaming application.**
> # Features
> - Integrate Siddhi CEP as an stream operator (i.e.
> `TupleStreamSiddhiOperator`), supporting rich CEP features like
> - Filter
> - Join
> - Aggregation
> - Group by
> - Having
> - Window
> - Conditions and Expressions
> - Pattern processing
> - Sequence processing
> - Event Tables
> ...
> - Provide easy-to-use Siddhi CEP API to integrate Flink DataStream API (See
> `SiddhiCEP` and `SiddhiStream`)
> - Register Flink DataStream associating native type information with Siddhi
> Stream Schema, supporting POJO,Tuple, Primitive Type, etc.
> - Connect with single or multiple Flink DataStreams with Siddhi CEP
> Execution Plan
> - Return output stream as DataStream with type intelligently inferred from
> Siddhi Stream Schema
> - Integrate siddhi runtime state management with Flink state (See
> `AbstractSiddhiOperator`)
> - Support siddhi plugin management to extend CEP functions. (See
> `SiddhiCEP#registerExtension`)
> # Test Cases
> - [`org.apache.flink.contrib.siddhi.
> SiddhiCEPITCase`](https://github.com/haoch/flink/blob/FLINK-4520/flink-contrib/flink-siddhi/src/test/java/org/apache/flink/contrib/siddhi/SiddhiCEPITCase.java)
> # Example
> ```
> StreamExecutionEnvironment env =
> StreamExecutionEnvironment.getExecutionEnvironment();
> SiddhiCEP cep = SiddhiCEP.getSiddhiEnvironment(env);
> cep.registerExtension("custom:plus",CustomPlusFunctionExtension.class);
> cep.registerStream("inputStream1", input1, "id", "name",
> "price","timestamp");
> cep.registerStream("inputStream2", input2, "id", "name",
> "price","timestamp");
> DataStream> output = cep
> .from("inputStream1").union("inputStream2")
> .sql(
> "from every s1 = inputStream1[id == 2] "
> + " -> s2 = inputStream2[id == 3] "
> + "select s1.id as id_1, s1.name as name_1, s2.id as id_2, s2.name
> as name_2 , custom:plus(s1.price,s2.price) as price"
> + "insert into outputStream"
> )
> .returns("outputStream");
> env.execute();
> ```
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Resolved] (BAHIR-144) Add Siddhi CEP integration with Flink streaming
[
https://issues.apache.org/jira/browse/BAHIR-144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Metzger resolved BAHIR-144.
--
Resolution: Fixed
Fix Version/s: Flink-Next
> Add Siddhi CEP integration with Flink streaming
> ---
>
> Key: BAHIR-144
> URL: https://issues.apache.org/jira/browse/BAHIR-144
> Project: Bahir
> Issue Type: New Feature
> Components: Flink Streaming Connectors
>Reporter: Hao Chen
>Assignee: Hao Chen
> Fix For: Flink-Next
>
>
> Moved from:
> * https://issues.apache.org/jira/browse/FLINK-4520
> * https://github.com/apache/flink/pull/2487
> Siddhi CEP is a lightweight and easy-to-use Open Source Complex Event
> Processing Engine (CEP) released as a Java Library under `Apache Software
> License v2.0`. Siddhi CEP processes events which are generated by various
> event sources, analyses them and notifies appropriate complex events
> according to the user specified queries.
> **It would be very helpful for flink users (especially streaming application
> developer) to provide a library to run Siddhi CEP query directly in Flink
> streaming application.**
> # Features
> - Integrate Siddhi CEP as an stream operator (i.e.
> `TupleStreamSiddhiOperator`), supporting rich CEP features like
> - Filter
> - Join
> - Aggregation
> - Group by
> - Having
> - Window
> - Conditions and Expressions
> - Pattern processing
> - Sequence processing
> - Event Tables
> ...
> - Provide easy-to-use Siddhi CEP API to integrate Flink DataStream API (See
> `SiddhiCEP` and `SiddhiStream`)
> - Register Flink DataStream associating native type information with Siddhi
> Stream Schema, supporting POJO,Tuple, Primitive Type, etc.
> - Connect with single or multiple Flink DataStreams with Siddhi CEP
> Execution Plan
> - Return output stream as DataStream with type intelligently inferred from
> Siddhi Stream Schema
> - Integrate siddhi runtime state management with Flink state (See
> `AbstractSiddhiOperator`)
> - Support siddhi plugin management to extend CEP functions. (See
> `SiddhiCEP#registerExtension`)
> # Test Cases
> - [`org.apache.flink.contrib.siddhi.
> SiddhiCEPITCase`](https://github.com/haoch/flink/blob/FLINK-4520/flink-contrib/flink-siddhi/src/test/java/org/apache/flink/contrib/siddhi/SiddhiCEPITCase.java)
> # Example
> ```
> StreamExecutionEnvironment env =
> StreamExecutionEnvironment.getExecutionEnvironment();
> SiddhiCEP cep = SiddhiCEP.getSiddhiEnvironment(env);
> cep.registerExtension("custom:plus",CustomPlusFunctionExtension.class);
> cep.registerStream("inputStream1", input1, "id", "name",
> "price","timestamp");
> cep.registerStream("inputStream2", input2, "id", "name",
> "price","timestamp");
> DataStream> output = cep
> .from("inputStream1").union("inputStream2")
> .sql(
> "from every s1 = inputStream1[id == 2] "
> + " -> s2 = inputStream2[id == 3] "
> + "select s1.id as id_1, s1.name as name_1, s2.id as id_2, s2.name
> as name_2 , custom:plus(s1.price,s2.price) as price"
> + "insert into outputStream"
> )
> .returns("outputStream");
> env.execute();
> ```
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (BAHIR-156) Improve integration test stability for flink-library-siddhi
Robert Metzger created BAHIR-156: Summary: Improve integration test stability for flink-library-siddhi Key: BAHIR-156 URL: https://issues.apache.org/jira/browse/BAHIR-156 Project: Bahir Issue Type: Bug Components: Flink Streaming Connectors Affects Versions: Flink-1.0 Reporter: Robert Metzger -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Assigned] (BAHIR-156) Improve integration test stability for flink-library-siddhi
[ https://issues.apache.org/jira/browse/BAHIR-156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger reassigned BAHIR-156: Assignee: Alexander Chermenin > Improve integration test stability for flink-library-siddhi > --- > > Key: BAHIR-156 > URL: https://issues.apache.org/jira/browse/BAHIR-156 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: Robert Metzger >Assignee: Alexander Chermenin > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (BAHIR-156) Improve integration test stability for flink-library-siddhi
[ https://issues.apache.org/jira/browse/BAHIR-156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16303331#comment-16303331 ] Robert Metzger commented on BAHIR-156: -- [~chermenin] I gave you "Contributor" permissions in the Apache Bahir project. You can now assign JIRAs to yourself. Thanks a lot for fixing this problem! > Improve integration test stability for flink-library-siddhi > --- > > Key: BAHIR-156 > URL: https://issues.apache.org/jira/browse/BAHIR-156 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: Robert Metzger >Assignee: Alexander Chermenin > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Resolved] (BAHIR-156) Improve integration test stability for flink-library-siddhi
[ https://issues.apache.org/jira/browse/BAHIR-156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger resolved BAHIR-156. -- Resolution: Fixed Fix Version/s: Flink-Next > Improve integration test stability for flink-library-siddhi > --- > > Key: BAHIR-156 > URL: https://issues.apache.org/jira/browse/BAHIR-156 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: Robert Metzger >Assignee: Alexander Chermenin > Fix For: Flink-Next > > -- This message was sent by Atlassian JIRA (v6.4.14#64029)
