[jira] [Created] (BAHIR-325) flink influxdb sink connector may lose data
WPF created BAHIR-325: - Summary: flink influxdb sink connector may lose data Key: BAHIR-325 URL: https://issues.apache.org/jira/browse/BAHIR-325 Project: Bahir Issue Type: Improvement Components: Flink Streaming Connectors Affects Versions: Not Applicable Reporter: WPF Fix For: Not Applicable During the flink checkpoint, the influxdb connector did not clear the data in the buffer -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-322) Continuous Non-stop Kudu Connector for Flink
[ https://issues.apache.org/jira/browse/BAHIR-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17736870#comment-17736870 ] Wei Chen commented on BAHIR-322: Hi [~eskabetxe] I've created a PR: [https://github.com/apache/bahir-flink/pull/167] for this change. Please help to review and let me know your or others' comments. > Continuous Non-stop Kudu Connector for Flink > - > > Key: BAHIR-322 > URL: https://issues.apache.org/jira/browse/BAHIR-322 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Wei Chen >Priority: Minor > > Hi Team, > When I was using Bahir Kudu Connector for Flink to build data pipeline, I > found it didn't support continuously non-stop reading data in kudu tables. > Considering Kudu doesn't support CDC, it sounds like fair enough not to have > this. However, the idea in > [https://docs.confluent.io/kafka-connectors/kudu/current/source-connector/overview.html#incremental-query-modes] > inspired me to have a continuous, non-stop kudu connector for Flink, so I've > built one with the same idea in > [https://github.com/eBay/flink-kudu-streaming-connector] . > I'd like to see if any chances this feature is able to merged into one part > of Bahir Kudu Connector. :) > Let me know if you have any comments or suggestion. > > Best Regards -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-322) Continuous Non-stop Kudu Connector for Flink
[ https://issues.apache.org/jira/browse/BAHIR-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730364#comment-17730364 ] Wei Chen commented on BAHIR-322: Hi [~eskabetxe] Sure, happy to prepare the PR for that! > Continuous Non-stop Kudu Connector for Flink > - > > Key: BAHIR-322 > URL: https://issues.apache.org/jira/browse/BAHIR-322 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Wei Chen >Priority: Minor > > Hi Team, > When I was using Bahir Kudu Connector for Flink to build data pipeline, I > found it didn't support continuously non-stop reading data in kudu tables. > Considering Kudu doesn't support CDC, it sounds like fair enough not to have > this. However, the idea in > [https://docs.confluent.io/kafka-connectors/kudu/current/source-connector/overview.html#incremental-query-modes] > inspired me to have a continuous, non-stop kudu connector for Flink, so I've > built one with the same idea in > [https://github.com/eBay/flink-kudu-streaming-connector] . > I'd like to see if any chances this feature is able to merged into one part > of Bahir Kudu Connector. :) > Let me know if you have any comments or suggestion. > > Best Regards -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (BAHIR-283) InfluxDBWriter fails to write the final element in each element
[ https://issues.apache.org/jira/browse/BAHIR-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto resolved BAHIR-283. - Resolution: Fixed > InfluxDBWriter fails to write the final element in each element > --- > > Key: BAHIR-283 > URL: https://issues.apache.org/jira/browse/BAHIR-283 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: David Quigley >Assignee: David Quigley >Priority: Major > Fix For: Flink-1.2.0 > > Original Estimate: 2h > Remaining Estimate: 2h > > {{/** > * This method calls the InfluxDB write API whenever the element list > reaches the {@link > * #bufferSize}. It keeps track of the latest timestamp of each element. > It compares the latest > * timestamp with the context.timestamp() and takes the bigger (latest) > timestamp. > * > * @param in incoming data > * @param context current Flink context > * @see org.apache.flink.api.connector.sink.SinkWriter.Context > */ > @Override > public void write(final IN in, final Context context) throws IOException { > if (this.elements.size() == this.bufferSize) { > LOG.debug("Buffer size reached preparing to write the elements."); > this.writeCurrentElements(); > this.elements.clear(); > } else { > LOG.trace("Adding elements to buffer. Buffer size: {}", > this.elements.size()); > this.elements.add(this.schemaSerializer.serialize(in, context)); > if (context.timestamp() != null) { > this.lastTimestamp = Math.max(this.lastTimestamp, > context.timestamp()); > } > } > }}} > The bug is in this write method. If the number of elements in the buffer is > less than the configured buffer size, the current element is added to the > buffer. If the number of elements in the buffer is equal to the buffer size, > the buffer is flushed and the current element is not added to the next > buffer. This results in the current element being dropped. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (BAHIR-283) InfluxDBWriter fails to write the final element in each element
[ https://issues.apache.org/jira/browse/BAHIR-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto reassigned BAHIR-283: --- Assignee: David Quigley > InfluxDBWriter fails to write the final element in each element > --- > > Key: BAHIR-283 > URL: https://issues.apache.org/jira/browse/BAHIR-283 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: David Quigley >Assignee: David Quigley >Priority: Major > Fix For: Flink-1.2.0 > > Original Estimate: 2h > Remaining Estimate: 2h > > {{/** > * This method calls the InfluxDB write API whenever the element list > reaches the {@link > * #bufferSize}. It keeps track of the latest timestamp of each element. > It compares the latest > * timestamp with the context.timestamp() and takes the bigger (latest) > timestamp. > * > * @param in incoming data > * @param context current Flink context > * @see org.apache.flink.api.connector.sink.SinkWriter.Context > */ > @Override > public void write(final IN in, final Context context) throws IOException { > if (this.elements.size() == this.bufferSize) { > LOG.debug("Buffer size reached preparing to write the elements."); > this.writeCurrentElements(); > this.elements.clear(); > } else { > LOG.trace("Adding elements to buffer. Buffer size: {}", > this.elements.size()); > this.elements.add(this.schemaSerializer.serialize(in, context)); > if (context.timestamp() != null) { > this.lastTimestamp = Math.max(this.lastTimestamp, > context.timestamp()); > } > } > }}} > The bug is in this write method. If the number of elements in the buffer is > less than the configured buffer size, the current element is added to the > buffer. If the number of elements in the buffer is equal to the buffer size, > the buffer is flushed and the current element is not added to the next > buffer. This results in the current element being dropped. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (BAHIR-211) fix siddhi warning
[ https://issues.apache.org/jira/browse/BAHIR-211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto resolved BAHIR-211. - Fix Version/s: Flink-1.2.0 Resolution: Won't Fix > fix siddhi warning > -- > > Key: BAHIR-211 > URL: https://issues.apache.org/jira/browse/BAHIR-211 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > Fix For: Flink-1.2.0 > > > siddhi as to many warning and is causing travis to fail, as we exceed de 4mb > log limit -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-322) Continuous Non-stop Kudu Connector for Flink
[ https://issues.apache.org/jira/browse/BAHIR-322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17730016#comment-17730016 ] João Boto commented on BAHIR-322: - Hi [~sagitchen], having the option is a great idea.. will you contribute with the code? > Continuous Non-stop Kudu Connector for Flink > - > > Key: BAHIR-322 > URL: https://issues.apache.org/jira/browse/BAHIR-322 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Wei Chen >Priority: Minor > > Hi Team, > When I was using Bahir Kudu Connector for Flink to build data pipeline, I > found it didn't support continuously non-stop reading data in kudu tables. > Considering Kudu doesn't support CDC, it sounds like fair enough not to have > this. However, the idea in > [https://docs.confluent.io/kafka-connectors/kudu/current/source-connector/overview.html#incremental-query-modes] > inspired me to have a continuous, non-stop kudu connector for Flink, so I've > built one with the same idea in > [https://github.com/eBay/flink-kudu-streaming-connector] . > I'd like to see if any chances this feature is able to merged into one part > of Bahir Kudu Connector. :) > Let me know if you have any comments or suggestion. > > Best Regards -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-324) JobManager created a kuduReader that was not closed, resulting in an increase in server handles
[ https://issues.apache.org/jira/browse/BAHIR-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727616#comment-17727616 ] ASF subversion and git services commented on BAHIR-324: --- Commit 4a8f60f03f7caeb5421c7c88fa34a3ba419b61ee in bahir-flink's branch refs/heads/master from Shimin Huang [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=4a8f60f ] [BAHIR-324] Closing KuduReader at JobManager > JobManager created a kuduReader that was not closed, resulting in an increase > in server handles > > > Key: BAHIR-324 > URL: https://issues.apache.org/jira/browse/BAHIR-324 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.1.0 >Reporter: ShiminHuang >Assignee: ShiminHuang >Priority: Critical > Fix For: Flink-1.2.0 > > Attachments: image-2023-05-30-15-03-38-388.png, > image-2023-05-30-15-04-47-387.png, image-2023-05-30-15-05-33-472.png, > image-2023-05-30-15-06-16-063.png, image-2023-05-30-15-25-01-115.png > > Original Estimate: 1h > Remaining Estimate: 1h > > h1. Problem > {quote}When JobManager starts, the ExecutionJobVertex constructor calls the > AbstractKuduInputFormat#createInputSplits method, Causes the KuduReader > object to create the KuduClient and KuduSession objects, but > ExecutionJobVertex does not call the Kudureader #close() method with the > display, causing the Kudu-related handle to remain open after the Flink task > is closed. As a result, the number of server handles increases with the > number of Flink tasks. As a result, the entire server becomes > unavailable{quote} > h1. Code > *ExecutionJobVertex#constructor* > !image-2023-05-30-15-03-38-388.png! > {*}AbstractKuduInputFormat#createInputSplits{*}{*}{*} > *!image-2023-05-30-15-04-47-387.png!* > {*}AbstractKuduInputFormat{*}{*}#startKuduReader{*} > {*}!image-2023-05-30-15-06-16-063.png!{*}{*}{*} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (BAHIR-324) JobManager created a kuduReader that was not closed, resulting in an increase in server handles
[ https://issues.apache.org/jira/browse/BAHIR-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto reassigned BAHIR-324: --- Assignee: ShiminHuang > JobManager created a kuduReader that was not closed, resulting in an increase > in server handles > > > Key: BAHIR-324 > URL: https://issues.apache.org/jira/browse/BAHIR-324 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.1.0 >Reporter: ShiminHuang >Assignee: ShiminHuang >Priority: Critical > Fix For: Flink-1.2.0 > > Attachments: image-2023-05-30-15-03-38-388.png, > image-2023-05-30-15-04-47-387.png, image-2023-05-30-15-05-33-472.png, > image-2023-05-30-15-06-16-063.png, image-2023-05-30-15-25-01-115.png > > Original Estimate: 1h > Remaining Estimate: 1h > > h1. Problem > {quote}When JobManager starts, the ExecutionJobVertex constructor calls the > AbstractKuduInputFormat#createInputSplits method, Causes the KuduReader > object to create the KuduClient and KuduSession objects, but > ExecutionJobVertex does not call the Kudureader #close() method with the > display, causing the Kudu-related handle to remain open after the Flink task > is closed. As a result, the number of server handles increases with the > number of Flink tasks. As a result, the entire server becomes > unavailable{quote} > h1. Code > *ExecutionJobVertex#constructor* > !image-2023-05-30-15-03-38-388.png! > {*}AbstractKuduInputFormat#createInputSplits{*}{*}{*} > *!image-2023-05-30-15-04-47-387.png!* > {*}AbstractKuduInputFormat{*}{*}#startKuduReader{*} > {*}!image-2023-05-30-15-06-16-063.png!{*}{*}{*} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-285) flink-connector support SREM command
[ https://issues.apache.org/jira/browse/BAHIR-285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727611#comment-17727611 ] ASF subversion and git services commented on BAHIR-285: --- Commit 3744457437ef74696747911897bb746dc2dde6c9 in bahir-flink's branch refs/heads/master from Hyeonho Kim [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=3744457 ] [BAHIR-285] Redis: fix typo error in log message > flink-connector support SREM command > > > Key: BAHIR-285 > URL: https://issues.apache.org/jira/browse/BAHIR-285 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Ethan Wang >Assignee: Hyeonho Kim >Priority: Critical > Fix For: Flink-1.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (BAHIR-285) flink-connector support SREM command
[ https://issues.apache.org/jira/browse/BAHIR-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto reassigned BAHIR-285: --- Assignee: Hyeonho Kim > flink-connector support SREM command > > > Key: BAHIR-285 > URL: https://issues.apache.org/jira/browse/BAHIR-285 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Ethan Wang >Assignee: Hyeonho Kim >Priority: Critical > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (BAHIR-285) flink-connector support SREM command
[ https://issues.apache.org/jira/browse/BAHIR-285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto resolved BAHIR-285. - Fix Version/s: Flink-1.2.0 Resolution: Fixed > flink-connector support SREM command > > > Key: BAHIR-285 > URL: https://issues.apache.org/jira/browse/BAHIR-285 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Ethan Wang >Assignee: Hyeonho Kim >Priority: Critical > Fix For: Flink-1.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-285) flink-connector support SREM command
[ https://issues.apache.org/jira/browse/BAHIR-285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727609#comment-17727609 ] ASF subversion and git services commented on BAHIR-285: --- Commit cd8f61e2808d9e62650632e5e1ce5a38843ef346 in bahir-flink's branch refs/heads/master from Hyeonho Kim [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=cd8f61e ] [BAHIR-285] Redis: add srem command (#164) > flink-connector support SREM command > > > Key: BAHIR-285 > URL: https://issues.apache.org/jira/browse/BAHIR-285 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: Ethan Wang >Priority: Critical > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (BAHIR-201) Redis connector flink should support the HDEL command
[ https://issues.apache.org/jira/browse/BAHIR-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto updated BAHIR-201: Fix Version/s: Flink-1.2.0 > Redis connector flink should support the HDEL command > - > > Key: BAHIR-201 > URL: https://issues.apache.org/jira/browse/BAHIR-201 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: David Sharer >Assignee: Hyeonho Kim >Priority: Major > Fix For: Flink-1.2.0 > > Original Estimate: 3h > Remaining Estimate: 3h > > Right now the flink streaming connector for Redis supports the HSET command > for HASH data types, but it does not support the HDEL command. This > improvement would be adding support for performing HDEL operations on the > HASH. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (BAHIR-201) Redis connector flink should support the HDEL command
[ https://issues.apache.org/jira/browse/BAHIR-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto resolved BAHIR-201. - Resolution: Fixed > Redis connector flink should support the HDEL command > - > > Key: BAHIR-201 > URL: https://issues.apache.org/jira/browse/BAHIR-201 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: David Sharer >Assignee: Hyeonho Kim >Priority: Major > Fix For: Flink-1.2.0 > > Original Estimate: 3h > Remaining Estimate: 3h > > Right now the flink streaming connector for Redis supports the HSET command > for HASH data types, but it does not support the HDEL command. This > improvement would be adding support for performing HDEL operations on the > HASH. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (BAHIR-201) Redis connector flink should support the HDEL command
[ https://issues.apache.org/jira/browse/BAHIR-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto reassigned BAHIR-201: --- Assignee: Hyeonho Kim > Redis connector flink should support the HDEL command > - > > Key: BAHIR-201 > URL: https://issues.apache.org/jira/browse/BAHIR-201 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: David Sharer >Assignee: Hyeonho Kim >Priority: Major > Original Estimate: 3h > Remaining Estimate: 3h > > Right now the flink streaming connector for Redis supports the HSET command > for HASH data types, but it does not support the HDEL command. This > improvement would be adding support for performing HDEL operations on the > HASH. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-201) Redis connector flink should support the HDEL command
[ https://issues.apache.org/jira/browse/BAHIR-201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727608#comment-17727608 ] ASF subversion and git services commented on BAHIR-201: --- Commit a03fa8c1c9320ff5b729bf75c2717c0e832fa5f1 in bahir-flink's branch refs/heads/master from Hyeonho Kim [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=a03fa8c ] [BAHIR-201] Redis: add hdel command > Redis connector flink should support the HDEL command > - > > Key: BAHIR-201 > URL: https://issues.apache.org/jira/browse/BAHIR-201 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: David Sharer >Assignee: Hyeonho Kim >Priority: Major > Original Estimate: 3h > Remaining Estimate: 3h > > Right now the flink streaming connector for Redis supports the HSET command > for HASH data types, but it does not support the HDEL command. This > improvement would be adding support for performing HDEL operations on the > HASH. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (BAHIR-201) Redis connector flink should support the HDEL command
[ https://issues.apache.org/jira/browse/BAHIR-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto reassigned BAHIR-201: --- Assignee: (was: Hyeonho Kim) > Redis connector flink should support the HDEL command > - > > Key: BAHIR-201 > URL: https://issues.apache.org/jira/browse/BAHIR-201 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: David Sharer >Priority: Major > Original Estimate: 3h > Remaining Estimate: 3h > > Right now the flink streaming connector for Redis supports the HSET command > for HASH data types, but it does not support the HDEL command. This > improvement would be adding support for performing HDEL operations on the > HASH. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Assigned] (BAHIR-201) Redis connector flink should support the HDEL command
[ https://issues.apache.org/jira/browse/BAHIR-201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto reassigned BAHIR-201: --- Assignee: Hyeonho Kim > Redis connector flink should support the HDEL command > - > > Key: BAHIR-201 > URL: https://issues.apache.org/jira/browse/BAHIR-201 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: David Sharer >Assignee: Hyeonho Kim >Priority: Major > Original Estimate: 3h > Remaining Estimate: 3h > > Right now the flink streaming connector for Redis supports the HSET command > for HASH data types, but it does not support the HDEL command. This > improvement would be adding support for performing HDEL operations on the > HASH. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (BAHIR-324) JobManager created a kuduReader that was not closed, resulting in an increase in server handles
[ https://issues.apache.org/jira/browse/BAHIR-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto updated BAHIR-324: Fix Version/s: Flink-1.2.0 (was: Flink-1.1.0) > JobManager created a kuduReader that was not closed, resulting in an increase > in server handles > > > Key: BAHIR-324 > URL: https://issues.apache.org/jira/browse/BAHIR-324 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.1.0 >Reporter: ShiminHuang >Priority: Critical > Fix For: Flink-1.2.0 > > Attachments: image-2023-05-30-15-03-38-388.png, > image-2023-05-30-15-04-47-387.png, image-2023-05-30-15-05-33-472.png, > image-2023-05-30-15-06-16-063.png, image-2023-05-30-15-25-01-115.png > > Original Estimate: 1h > Remaining Estimate: 1h > > h1. Problem > {quote}When JobManager starts, the ExecutionJobVertex constructor calls the > AbstractKuduInputFormat#createInputSplits method, Causes the KuduReader > object to create the KuduClient and KuduSession objects, but > ExecutionJobVertex does not call the Kudureader #close() method with the > display, causing the Kudu-related handle to remain open after the Flink task > is closed. As a result, the number of server handles increases with the > number of Flink tasks. As a result, the entire server becomes > unavailable{quote} > h1. Code > *ExecutionJobVertex#constructor* > !image-2023-05-30-15-03-38-388.png! > {*}AbstractKuduInputFormat#createInputSplits{*}{*}{*} > *!image-2023-05-30-15-04-47-387.png!* > {*}AbstractKuduInputFormat{*}{*}#startKuduReader{*} > {*}!image-2023-05-30-15-06-16-063.png!{*}{*}{*} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (BAHIR-324) JobManager created a kuduReader that was not closed, resulting in an increase in server handles
[ https://issues.apache.org/jira/browse/BAHIR-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShiminHuang resolved BAHIR-324. --- Resolution: Fixed > JobManager created a kuduReader that was not closed, resulting in an increase > in server handles > > > Key: BAHIR-324 > URL: https://issues.apache.org/jira/browse/BAHIR-324 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.1.0 >Reporter: ShiminHuang >Priority: Critical > Fix For: Flink-1.1.0 > > Attachments: image-2023-05-30-15-03-38-388.png, > image-2023-05-30-15-04-47-387.png, image-2023-05-30-15-05-33-472.png, > image-2023-05-30-15-06-16-063.png, image-2023-05-30-15-25-01-115.png > > Original Estimate: 1h > Remaining Estimate: 1h > > h1. Problem > {quote}When JobManager starts, the ExecutionJobVertex constructor calls the > AbstractKuduInputFormat#createInputSplits method, Causes the KuduReader > object to create the KuduClient and KuduSession objects, but > ExecutionJobVertex does not call the Kudureader #close() method with the > display, causing the Kudu-related handle to remain open after the Flink task > is closed. As a result, the number of server handles increases with the > number of Flink tasks. As a result, the entire server becomes > unavailable{quote} > h1. Code > *ExecutionJobVertex#constructor* > !image-2023-05-30-15-03-38-388.png! > {*}AbstractKuduInputFormat#createInputSplits{*}{*}{*} > *!image-2023-05-30-15-04-47-387.png!* > {*}AbstractKuduInputFormat{*}{*}#startKuduReader{*} > {*}!image-2023-05-30-15-06-16-063.png!{*}{*}{*} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Comment Edited] (BAHIR-324) JobManager created a kuduReader that was not closed, resulting in an increase in server handles
[ https://issues.apache.org/jira/browse/BAHIR-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727366#comment-17727366 ] zhang junbo edited comment on BAHIR-324 at 5/30/23 7:25 AM: Yes, i also found this issue. and in jobmanager log ,id print the callstrack log as below: (just open ,not closed kudureader): !image-2023-05-30-15-25-01-115.png! was (Author: JIRAUSER300167): Yes, i also found this issue. and in jobmanager log ,id print the callstrack log as below: (just open ,not closed kudureader): !image-2023-05-30-15-25-01-115.png! > JobManager created a kuduReader that was not closed, resulting in an increase > in server handles > > > Key: BAHIR-324 > URL: https://issues.apache.org/jira/browse/BAHIR-324 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.1.0 >Reporter: ShiminHuang >Priority: Critical > Fix For: Flink-1.1.0 > > Attachments: image-2023-05-30-15-03-38-388.png, > image-2023-05-30-15-04-47-387.png, image-2023-05-30-15-05-33-472.png, > image-2023-05-30-15-06-16-063.png, image-2023-05-30-15-25-01-115.png > > Original Estimate: 1h > Remaining Estimate: 1h > > h1. Problem > {quote}When JobManager starts, the ExecutionJobVertex constructor calls the > AbstractKuduInputFormat#createInputSplits method, Causes the KuduReader > object to create the KuduClient and KuduSession objects, but > ExecutionJobVertex does not call the Kudureader #close() method with the > display, causing the Kudu-related handle to remain open after the Flink task > is closed. As a result, the number of server handles increases with the > number of Flink tasks. As a result, the entire server becomes > unavailable{quote} > h1. Code > *ExecutionJobVertex#constructor* > !image-2023-05-30-15-03-38-388.png! > {*}AbstractKuduInputFormat#createInputSplits{*}{*}{*} > *!image-2023-05-30-15-04-47-387.png!* > {*}AbstractKuduInputFormat{*}{*}#startKuduReader{*} > {*}!image-2023-05-30-15-06-16-063.png!{*}{*}{*} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-324) JobManager created a kuduReader that was not closed, resulting in an increase in server handles
[ https://issues.apache.org/jira/browse/BAHIR-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17727366#comment-17727366 ] zhang junbo commented on BAHIR-324: --- Yes, i also found this issue. and in jobmanager log ,id print the callstrack log as below: (just open ,not closed kudureader): !image-2023-05-30-15-25-01-115.png! > JobManager created a kuduReader that was not closed, resulting in an increase > in server handles > > > Key: BAHIR-324 > URL: https://issues.apache.org/jira/browse/BAHIR-324 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.1.0 >Reporter: ShiminHuang >Priority: Critical > Fix For: Flink-1.1.0 > > Attachments: image-2023-05-30-15-03-38-388.png, > image-2023-05-30-15-04-47-387.png, image-2023-05-30-15-05-33-472.png, > image-2023-05-30-15-06-16-063.png, image-2023-05-30-15-25-01-115.png > > Original Estimate: 1h > Remaining Estimate: 1h > > h1. Problem > {quote}When JobManager starts, the ExecutionJobVertex constructor calls the > AbstractKuduInputFormat#createInputSplits method, Causes the KuduReader > object to create the KuduClient and KuduSession objects, but > ExecutionJobVertex does not call the Kudureader #close() method with the > display, causing the Kudu-related handle to remain open after the Flink task > is closed. As a result, the number of server handles increases with the > number of Flink tasks. As a result, the entire server becomes > unavailable{quote} > h1. Code > *ExecutionJobVertex#constructor* > !image-2023-05-30-15-03-38-388.png! > {*}AbstractKuduInputFormat#createInputSplits{*}{*}{*} > *!image-2023-05-30-15-04-47-387.png!* > {*}AbstractKuduInputFormat{*}{*}#startKuduReader{*} > {*}!image-2023-05-30-15-06-16-063.png!{*}{*}{*} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (BAHIR-324) JobManager created a kuduReader that was not closed, resulting in an increase in server handles
[ https://issues.apache.org/jira/browse/BAHIR-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhang junbo updated BAHIR-324: -- Attachment: image-2023-05-30-15-25-01-115.png > JobManager created a kuduReader that was not closed, resulting in an increase > in server handles > > > Key: BAHIR-324 > URL: https://issues.apache.org/jira/browse/BAHIR-324 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.1.0 >Reporter: ShiminHuang >Priority: Critical > Fix For: Flink-1.1.0 > > Attachments: image-2023-05-30-15-03-38-388.png, > image-2023-05-30-15-04-47-387.png, image-2023-05-30-15-05-33-472.png, > image-2023-05-30-15-06-16-063.png, image-2023-05-30-15-25-01-115.png > > Original Estimate: 1h > Remaining Estimate: 1h > > h1. Problem > {quote}When JobManager starts, the ExecutionJobVertex constructor calls the > AbstractKuduInputFormat#createInputSplits method, Causes the KuduReader > object to create the KuduClient and KuduSession objects, but > ExecutionJobVertex does not call the Kudureader #close() method with the > display, causing the Kudu-related handle to remain open after the Flink task > is closed. As a result, the number of server handles increases with the > number of Flink tasks. As a result, the entire server becomes > unavailable{quote} > h1. Code > *ExecutionJobVertex#constructor* > !image-2023-05-30-15-03-38-388.png! > {*}AbstractKuduInputFormat#createInputSplits{*}{*}{*} > *!image-2023-05-30-15-04-47-387.png!* > {*}AbstractKuduInputFormat{*}{*}#startKuduReader{*} > {*}!image-2023-05-30-15-06-16-063.png!{*}{*}{*} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (BAHIR-324) BAHIR-322 JobManager created a kuduReader that was not closed, resulting in an increase in server handles
ShiminHuang created BAHIR-324: - Summary: BAHIR-322 JobManager created a kuduReader that was not closed, resulting in an increase in server handles Key: BAHIR-324 URL: https://issues.apache.org/jira/browse/BAHIR-324 Project: Bahir Issue Type: Bug Components: Flink Streaming Connectors Affects Versions: Flink-1.1.0 Reporter: ShiminHuang Fix For: Flink-1.1.0 Attachments: image-2023-05-30-15-03-38-388.png, image-2023-05-30-15-04-47-387.png, image-2023-05-30-15-05-33-472.png, image-2023-05-30-15-06-16-063.png h1. Problem {quote}When JobManager starts, the ExecutionJobVertex constructor calls the AbstractKuduInputFormat#createInputSplits method, Causes the KuduReader object to create the KuduClient and KuduSession objects, but ExecutionJobVertex does not call the Kudureader #close() method with the display, causing the Kudu-related handle to remain open after the Flink task is closed. As a result, the number of server handles increases with the number of Flink tasks. As a result, the entire server becomes unavailable{quote} h1. Code *ExecutionJobVertex#constructor* !image-2023-05-30-15-03-38-388.png! {*}AbstractKuduInputFormat#createInputSplits{*}{*}{*} *!image-2023-05-30-15-04-47-387.png!* {*}AbstractKuduInputFormat{*}{*}#startKuduReader{*} {*}!image-2023-05-30-15-06-16-063.png!{*}{*}{*} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (BAHIR-324) JobManager created a kuduReader that was not closed, resulting in an increase in server handles
[ https://issues.apache.org/jira/browse/BAHIR-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ShiminHuang updated BAHIR-324: -- Summary: JobManager created a kuduReader that was not closed, resulting in an increase in server handles (was: BAHIR-322 JobManager created a kuduReader that was not closed, resulting in an increase in server handles ) > JobManager created a kuduReader that was not closed, resulting in an increase > in server handles > > > Key: BAHIR-324 > URL: https://issues.apache.org/jira/browse/BAHIR-324 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.1.0 >Reporter: ShiminHuang >Priority: Critical > Fix For: Flink-1.1.0 > > Attachments: image-2023-05-30-15-03-38-388.png, > image-2023-05-30-15-04-47-387.png, image-2023-05-30-15-05-33-472.png, > image-2023-05-30-15-06-16-063.png > > Original Estimate: 1h > Remaining Estimate: 1h > > h1. Problem > {quote}When JobManager starts, the ExecutionJobVertex constructor calls the > AbstractKuduInputFormat#createInputSplits method, Causes the KuduReader > object to create the KuduClient and KuduSession objects, but > ExecutionJobVertex does not call the Kudureader #close() method with the > display, causing the Kudu-related handle to remain open after the Flink task > is closed. As a result, the number of server handles increases with the > number of Flink tasks. As a result, the entire server becomes > unavailable{quote} > h1. Code > *ExecutionJobVertex#constructor* > !image-2023-05-30-15-03-38-388.png! > {*}AbstractKuduInputFormat#createInputSplits{*}{*}{*} > *!image-2023-05-30-15-04-47-387.png!* > {*}AbstractKuduInputFormat{*}{*}#startKuduReader{*} > {*}!image-2023-05-30-15-06-16-063.png!{*}{*}{*} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto resolved BAHIR-308. - Fix Version/s: Flink-1.2.0 Resolution: Fixed > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > Fix For: Flink-1.2.0 > > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (BAHIR-308) Bump flink to 1.17
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] João Boto updated BAHIR-308: Summary: Bump flink to 1.17 (was: Bump flink to 1.15) > Bump flink to 1.17 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > Fix For: Flink-1.2.0 > > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720941#comment-17720941 ] ASF subversion and git services commented on BAHIR-308: --- Commit 06fe56a73540c100f8699d2af29e396330452d95 in bahir-flink's branch refs/heads/master from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=06fe56a ] [BAHIR-308] Bump flink version to 1.15.3 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720942#comment-17720942 ] ASF subversion and git services commented on BAHIR-308: --- Commit 5f287b9abe1025dae55d3e8179c34cebafdaccb6 in bahir-flink's branch refs/heads/master from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=5f287b9 ] [BAHIR-308] Bump flink version to 1.16.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720943#comment-17720943 ] ASF subversion and git services commented on BAHIR-308: --- Commit aa0f5b1f95d9312f23e4c17322dc179f58dc9e10 in bahir-flink's branch refs/heads/master from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=aa0f5b1 ] [BAHIR-308] Bump flink version to 1.17.0 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720944#comment-17720944 ] ASF subversion and git services commented on BAHIR-308: --- Commit 176242c9d10d8a67a0f773dc61235b96b26e3c44 in bahir-flink's branch refs/heads/master from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=176242c ] [BAHIR-308] Remove scala prefix where we can > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17720940#comment-17720940 ] ASF subversion and git services commented on BAHIR-308: --- Commit 017d4181987d1956b47f1dd56804c82a3e673d5b in bahir-flink's branch refs/heads/master from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=017d418 ] [BAHIR-308] Remove support for scala 2.11 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-323) support redis zremrangebyscore
[ https://issues.apache.org/jira/browse/BAHIR-323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17716358#comment-17716358 ] Hyeonho Kim commented on BAHIR-323: --- It's not appropriate to zremrangebyscore. so i close it > support redis zremrangebyscore > -- > > Key: BAHIR-323 > URL: https://issues.apache.org/jira/browse/BAHIR-323 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Reporter: Hyeonho Kim >Priority: Major > > support redis zremrangebyscore. > https://redis.io/commands/zremrangebyscore/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Closed] (BAHIR-323) support redis zremrangebyscore
[ https://issues.apache.org/jira/browse/BAHIR-323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyeonho Kim closed BAHIR-323. - Fix Version/s: Not Applicable Resolution: Invalid > support redis zremrangebyscore > -- > > Key: BAHIR-323 > URL: https://issues.apache.org/jira/browse/BAHIR-323 > Project: Bahir > Issue Type: New Feature > Components: Flink Streaming Connectors >Reporter: Hyeonho Kim >Priority: Major > Fix For: Not Applicable > > > support redis zremrangebyscore. > https://redis.io/commands/zremrangebyscore/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (BAHIR-323) support redis zremrangebyscore
Hyeonho Kim created BAHIR-323: - Summary: support redis zremrangebyscore Key: BAHIR-323 URL: https://issues.apache.org/jira/browse/BAHIR-323 Project: Bahir Issue Type: New Feature Components: Flink Streaming Connectors Reporter: Hyeonho Kim support redis zremrangebyscore. https://redis.io/commands/zremrangebyscore/ -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17707241#comment-17707241 ] ASF subversion and git services commented on BAHIR-308: --- Commit ab7b3569c2bc8829fc42bb468156aea48c2e1c67 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=ab7b356 ] [BAHIR-308] Remove scala prefix where we can > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706317#comment-17706317 ] ASF subversion and git services commented on BAHIR-308: --- Commit 871f10442e0a53cf5860ff873e1beba91cf457a7 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=871f104 ] [BAHIR-308] Bump flink version to 1.17.0 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706324#comment-17706324 ] ASF subversion and git services commented on BAHIR-308: --- Commit 2254ea09380e73b53fb8c15098018abb204c552f in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=2254ea0 ] [BAHIR-308] Remove support for scala 2.11 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706326#comment-17706326 ] ASF subversion and git services commented on BAHIR-308: --- Commit ac1cf6a234120b1ef9797b16c14c14fa46fe4ada in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=ac1cf6a ] [BAHIR-308] Bump flink version to 1.16.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706328#comment-17706328 ] ASF subversion and git services commented on BAHIR-308: --- Commit a84533e8ae0cce0e89608b041aedfebc2db5d619 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=a84533e ] [BAHIR-308] Remove scala prefix where we can > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706316#comment-17706316 ] ASF subversion and git services commented on BAHIR-308: --- Commit ac1cf6a234120b1ef9797b16c14c14fa46fe4ada in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=ac1cf6a ] [BAHIR-308] Bump flink version to 1.16.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706325#comment-17706325 ] ASF subversion and git services commented on BAHIR-308: --- Commit 380c746fa55292f11c2a397cc1fcb2a9c3c6ad96 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=380c746 ] [BAHIR-308] Bump flink version to 1.15.3 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706322#comment-17706322 ] ASF subversion and git services commented on BAHIR-308: --- Commit 871f10442e0a53cf5860ff873e1beba91cf457a7 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=871f104 ] [BAHIR-308] Bump flink version to 1.17.0 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706321#comment-17706321 ] ASF subversion and git services commented on BAHIR-308: --- Commit ac1cf6a234120b1ef9797b16c14c14fa46fe4ada in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=ac1cf6a ] [BAHIR-308] Bump flink version to 1.16.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706318#comment-17706318 ] ASF subversion and git services commented on BAHIR-308: --- Commit a84533e8ae0cce0e89608b041aedfebc2db5d619 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=a84533e ] [BAHIR-308] Remove scala prefix where we can > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706323#comment-17706323 ] ASF subversion and git services commented on BAHIR-308: --- Commit a84533e8ae0cce0e89608b041aedfebc2db5d619 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=a84533e ] [BAHIR-308] Remove scala prefix where we can > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706327#comment-17706327 ] ASF subversion and git services commented on BAHIR-308: --- Commit 871f10442e0a53cf5860ff873e1beba91cf457a7 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=871f104 ] [BAHIR-308] Bump flink version to 1.17.0 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706320#comment-17706320 ] ASF subversion and git services commented on BAHIR-308: --- Commit 380c746fa55292f11c2a397cc1fcb2a9c3c6ad96 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=380c746 ] [BAHIR-308] Bump flink version to 1.15.3 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706315#comment-17706315 ] ASF subversion and git services commented on BAHIR-308: --- Commit 380c746fa55292f11c2a397cc1fcb2a9c3c6ad96 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=380c746 ] [BAHIR-308] Bump flink version to 1.15.3 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706319#comment-17706319 ] ASF subversion and git services commented on BAHIR-308: --- Commit 2254ea09380e73b53fb8c15098018abb204c552f in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=2254ea0 ] [BAHIR-308] Remove support for scala 2.11 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706314#comment-17706314 ] ASF subversion and git services commented on BAHIR-308: --- Commit 2254ea09380e73b53fb8c15098018abb204c552f in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=2254ea0 ] [BAHIR-308] Remove support for scala 2.11 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (BAHIR-322) Continuous Non-stop Kudu Connector for Flink
Wei Chen created BAHIR-322: -- Summary: Continuous Non-stop Kudu Connector for Flink Key: BAHIR-322 URL: https://issues.apache.org/jira/browse/BAHIR-322 Project: Bahir Issue Type: Improvement Components: Flink Streaming Connectors Reporter: Wei Chen Hi Team, When I was using Bahir Kudu Connector for Flink to build data pipeline, I found it didn't support continuously non-stop reading data in kudu tables. Considering Kudu doesn't support CDC, it sounds like fair enough not to have this. However, the idea in [https://docs.confluent.io/kafka-connectors/kudu/current/source-connector/overview.html#incremental-query-modes] inspired me to have a continuous, non-stop kudu connector for Flink, so I've built one with the same idea in [https://github.com/eBay/flink-kudu-streaming-connector] . I'd like to see if any chances this feature is able to merged into one part of Bahir Kudu Connector. :) Let me know if you have any comments or suggestion. Best Regards -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704217#comment-17704217 ] ASF subversion and git services commented on BAHIR-308: --- Commit a84533e8ae0cce0e89608b041aedfebc2db5d619 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=a84533e ] [BAHIR-308] Remove scala prefix where we can > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704186#comment-17704186 ] ASF subversion and git services commented on BAHIR-308: --- Commit 35b6ff7455bcf84c9044935f46a2469505c44526 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=35b6ff7 ] [BAHIR-308] Remove scala prefix where we can > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704123#comment-17704123 ] ASF subversion and git services commented on BAHIR-308: --- Commit 380c746fa55292f11c2a397cc1fcb2a9c3c6ad96 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=380c746 ] [BAHIR-308] Bump flink version to 1.15.3 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704124#comment-17704124 ] ASF subversion and git services commented on BAHIR-308: --- Commit ac1cf6a234120b1ef9797b16c14c14fa46fe4ada in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=ac1cf6a ] [BAHIR-308] Bump flink version to 1.16.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704121#comment-17704121 ] ASF subversion and git services commented on BAHIR-308: --- Commit c52289ef46c119e9301d765146688e5382fafcde in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=c52289e ] [BAHIR-308] Remove scala prefix where we can > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704125#comment-17704125 ] ASF subversion and git services commented on BAHIR-308: --- Commit 871f10442e0a53cf5860ff873e1beba91cf457a7 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=871f104 ] [BAHIR-308] Bump flink version to 1.17.0 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704126#comment-17704126 ] ASF subversion and git services commented on BAHIR-308: --- Commit c52289ef46c119e9301d765146688e5382fafcde in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=c52289e ] [BAHIR-308] Remove scala prefix where we can > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704122#comment-17704122 ] ASF subversion and git services commented on BAHIR-308: --- Commit 2254ea09380e73b53fb8c15098018abb204c552f in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=2254ea0 ] [BAHIR-308] Remove support for scala 2.11 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17704033#comment-17704033 ] ASF subversion and git services commented on BAHIR-308: --- Commit 871f10442e0a53cf5860ff873e1beba91cf457a7 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=871f104 ] [BAHIR-308] Bump flink version to 1.17.0 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17703991#comment-17703991 ] ASF subversion and git services commented on BAHIR-308: --- Commit cba2beb5808589cd6bb11bc811742e3697b56ea2 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=cba2beb ] [BAHIR-308] Bump flink version to 1.17.0 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17701099#comment-17701099 ] ASF subversion and git services commented on BAHIR-308: --- Commit ac1cf6a234120b1ef9797b16c14c14fa46fe4ada in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=ac1cf6a ] [BAHIR-308] Bump flink version to 1.16.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697998#comment-17697998 ] ASF subversion and git services commented on BAHIR-308: --- Commit d23ffb9a05c3bad0b8b8703ca21dd22fc8f79b9a in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=d23ffb9 ] [BAHIR-308] Bump flink version to 1.16.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697997#comment-17697997 ] ASF subversion and git services commented on BAHIR-308: --- Commit bf1fb02ecd88c51f96893302915a93aca5cba9ec in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=bf1fb02 ] [BAHIR-308] Bump flink version to 1.16.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697993#comment-17697993 ] ASF subversion and git services commented on BAHIR-308: --- Commit 380c746fa55292f11c2a397cc1fcb2a9c3c6ad96 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=380c746 ] [BAHIR-308] Bump flink version to 1.15.3 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697992#comment-17697992 ] ASF subversion and git services commented on BAHIR-308: --- Commit 2254ea09380e73b53fb8c15098018abb204c552f in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=2254ea0 ] [BAHIR-308] Remove support for scala 2.11 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697994#comment-17697994 ] ASF subversion and git services commented on BAHIR-308: --- Commit d23ffb9a05c3bad0b8b8703ca21dd22fc8f79b9a in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=d23ffb9 ] [BAHIR-308] Bump flink version to 1.16.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697988#comment-17697988 ] ASF subversion and git services commented on BAHIR-308: --- Commit 380c746fa55292f11c2a397cc1fcb2a9c3c6ad96 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=380c746 ] [BAHIR-308] Bump flink version to 1.15.3 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-283) InfluxDBWriter fails to write the final element in each element
[ https://issues.apache.org/jira/browse/BAHIR-283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697474#comment-17697474 ] ASF subversion and git services commented on BAHIR-283: --- Commit c8b6f6122ae6411064a1ec55cf2c2fbc08d4979f in bahir-flink's branch refs/heads/BAHIR-308 from dave [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=c8b6f61 ] [BAHIR-283] Fix dropped elements on InfluxDbSink > InfluxDBWriter fails to write the final element in each element > --- > > Key: BAHIR-283 > URL: https://issues.apache.org/jira/browse/BAHIR-283 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: David Quigley >Priority: Major > Fix For: Flink-1.2.0 > > Original Estimate: 2h > Remaining Estimate: 2h > > {{/** > * This method calls the InfluxDB write API whenever the element list > reaches the {@link > * #bufferSize}. It keeps track of the latest timestamp of each element. > It compares the latest > * timestamp with the context.timestamp() and takes the bigger (latest) > timestamp. > * > * @param in incoming data > * @param context current Flink context > * @see org.apache.flink.api.connector.sink.SinkWriter.Context > */ > @Override > public void write(final IN in, final Context context) throws IOException { > if (this.elements.size() == this.bufferSize) { > LOG.debug("Buffer size reached preparing to write the elements."); > this.writeCurrentElements(); > this.elements.clear(); > } else { > LOG.trace("Adding elements to buffer. Buffer size: {}", > this.elements.size()); > this.elements.add(this.schemaSerializer.serialize(in, context)); > if (context.timestamp() != null) { > this.lastTimestamp = Math.max(this.lastTimestamp, > context.timestamp()); > } > } > }}} > The bug is in this write method. If the number of elements in the buffer is > less than the configured buffer size, the current element is added to the > buffer. If the number of elements in the buffer is equal to the buffer size, > the buffer is flushed and the current element is not added to the next > buffer. This results in the current element being dropped. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697475#comment-17697475 ] ASF subversion and git services commented on BAHIR-308: --- Commit 2254ea09380e73b53fb8c15098018abb204c552f in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=2254ea0 ] [BAHIR-308] Remove support for scala 2.11 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697477#comment-17697477 ] ASF subversion and git services commented on BAHIR-308: --- Commit 647ec12bc3c88ab758846c6283500473c4c87d24 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=647ec12 ] [BAHIR-308] InfluxDB changes > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697476#comment-17697476 ] ASF subversion and git services commented on BAHIR-308: --- Commit e2fd9cf78bdf2cdc5ef587386f9947a3a8053142 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=e2fd9cf ] [BAHIR-308] Bump flink version to 1.15.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-283) InfluxDBWriter fails to write the final element in each element
[ https://issues.apache.org/jira/browse/BAHIR-283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697472#comment-17697472 ] ASF subversion and git services commented on BAHIR-283: --- Commit c8b6f6122ae6411064a1ec55cf2c2fbc08d4979f in bahir-flink's branch refs/heads/master from dave [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=c8b6f61 ] [BAHIR-283] Fix dropped elements on InfluxDbSink > InfluxDBWriter fails to write the final element in each element > --- > > Key: BAHIR-283 > URL: https://issues.apache.org/jira/browse/BAHIR-283 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: David Quigley >Priority: Major > Fix For: Flink-1.2.0 > > Original Estimate: 2h > Remaining Estimate: 2h > > {{/** > * This method calls the InfluxDB write API whenever the element list > reaches the {@link > * #bufferSize}. It keeps track of the latest timestamp of each element. > It compares the latest > * timestamp with the context.timestamp() and takes the bigger (latest) > timestamp. > * > * @param in incoming data > * @param context current Flink context > * @see org.apache.flink.api.connector.sink.SinkWriter.Context > */ > @Override > public void write(final IN in, final Context context) throws IOException { > if (this.elements.size() == this.bufferSize) { > LOG.debug("Buffer size reached preparing to write the elements."); > this.writeCurrentElements(); > this.elements.clear(); > } else { > LOG.trace("Adding elements to buffer. Buffer size: {}", > this.elements.size()); > this.elements.add(this.schemaSerializer.serialize(in, context)); > if (context.timestamp() != null) { > this.lastTimestamp = Math.max(this.lastTimestamp, > context.timestamp()); > } > } > }}} > The bug is in this write method. If the number of elements in the buffer is > less than the configured buffer size, the current element is added to the > buffer. If the number of elements in the buffer is equal to the buffer size, > the buffer is flushed and the current element is not added to the next > buffer. This results in the current element being dropped. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697460#comment-17697460 ] ASF subversion and git services commented on BAHIR-308: --- Commit 536ac65b32e1d40d6fa91fda6256f346e30e422d in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=536ac65 ] [BAHIR-308] Remove support for scala 2.11 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697462#comment-17697462 ] ASF subversion and git services commented on BAHIR-308: --- Commit 23d90e3857dc0014b06debf9b5e72e641e0e03f9 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=23d90e3 ] [BAHIR-308] InfluxDB changes > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17697461#comment-17697461 ] ASF subversion and git services commented on BAHIR-308: --- Commit c9fa6d593012bb4d2e17f1d82ace24bd6e882e72 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=c9fa6d5 ] [BAHIR-308] Bump flink version to 1.15.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17684596#comment-17684596 ] ASF subversion and git services commented on BAHIR-308: --- Commit 65d29e289845a465dedba2c7409186800a247491 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=65d29e2 ] [BAHIR-308] InfluxDB changes > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17684594#comment-17684594 ] ASF subversion and git services commented on BAHIR-308: --- Commit 2f0d1374adf454557f1eda71a3bb653cc0d32211 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=2f0d137 ] [BAHIR-308] Remove support for scala 2.11 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-321) Kudu lookup join fails with String literal in WHERE clause
[ https://issues.apache.org/jira/browse/BAHIR-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17684593#comment-17684593 ] ASF subversion and git services commented on BAHIR-321: --- Commit 724e17c4481fb12c1ab14608dd04b974d6f5e090 in bahir-flink's branch refs/heads/BAHIR-308 from Balazs Varga [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=724e17c ] [BAHIR-321] Make KuduFilterInfo handle String literals > Kudu lookup join fails with String literal in WHERE clause > -- > > Key: BAHIR-321 > URL: https://issues.apache.org/jira/browse/BAHIR-321 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Reporter: Balazs Varga >Priority: Major > > When performing a (processing time) temporal table join with a Kudu table, > and using a String literal in the WHERE condition: > {code:java} > SELECT d.sensor_id, k.sensor_type, d.`value` > FROM datagen AS d > JOIN `kudu`.`default_database`.`default.sensors` FOR SYSTEM_TIME AS OF > d.proctime as k > ON k.sensor_id = d.sensor_id > WHERE sensor_type = 'pressure';{code} > We get the following error: > Caused by: java.lang.ClassCastException: > org.apache.flink.table.data.binary.BinaryStringData cannot be cast to > java.lang.Stringat > org.apache.flink.connectors.kudu.connector.KuduFilterInfo.predicateComparator(KuduFilterInfo.java:68) > This is because in KuduFilterInfo it tries to cast the literal, which is a > BinaryStringData, to a String. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17684595#comment-17684595 ] ASF subversion and git services commented on BAHIR-308: --- Commit 40a462ca77c993ca8dbf966cb2999f31197cfdf9 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=40a462c ] [BAHIR-308] Bump flink version to 1.15.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17684582#comment-17684582 ] ASF subversion and git services commented on BAHIR-308: --- Commit 1573b01031b16f18ce61670f9eb2806b09a0d699 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=1573b01 ] [BAHIR-308] Remove support for scala 2.11 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17684583#comment-17684583 ] ASF subversion and git services commented on BAHIR-308: --- Commit 2a7925ce4fcaa9096fc6c149f552550f8014ee0c in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=2a7925c ] [BAHIR-308] Bump flink version to 1.15.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-315) Redis connector: add Support for SSL connections for cluster
[ https://issues.apache.org/jira/browse/BAHIR-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17684581#comment-17684581 ] ASF subversion and git services commented on BAHIR-315: --- Commit 510a2b18ea8ad42932a37604b57ad5d47fb62a03 in bahir-flink's branch refs/heads/BAHIR-308 from Sebastian Ramirez [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=510a2b1 ] [BAHIR-315] Move SSL config to FlinkJedisConfigBase This allows us to support SSL connections in non-cluster configurations. JedisSentinelPool currently doesn't support SSL connections. > Redis connector: add Support for SSL connections for cluster > - > > Key: BAHIR-315 > URL: https://issues.apache.org/jira/browse/BAHIR-315 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: Kostas Netsiporenko >Assignee: João Boto >Priority: Major > Fix For: Flink-1.2.0 > > > Add support for SSL connections for clusters connections > * Upgrade the redis/jedis dependency to support SSL connections for clusters > (SSL support for cluster was added on 3.1.0. > [https://github.com/redis/jedis/releases/tag/jedis-3.1.0] ) > * FlinkJedisClusterConfig should allow you to set a flag. > * When creating a JedisCluster pass the SSL flag. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17684584#comment-17684584 ] ASF subversion and git services commented on BAHIR-308: --- Commit e8dff35854f68dc861cf6e39919b8ad5b2ce206d in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=e8dff35 ] [BAHIR-308] InfluxDB changes > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-321) Kudu lookup join fails with String literal in WHERE clause
[ https://issues.apache.org/jira/browse/BAHIR-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17683463#comment-17683463 ] ASF subversion and git services commented on BAHIR-321: --- Commit 724e17c4481fb12c1ab14608dd04b974d6f5e090 in bahir-flink's branch refs/heads/master from Balazs Varga [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=724e17c ] [BAHIR-321] Make KuduFilterInfo handle String literals > Kudu lookup join fails with String literal in WHERE clause > -- > > Key: BAHIR-321 > URL: https://issues.apache.org/jira/browse/BAHIR-321 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Reporter: Balazs Varga >Priority: Major > > When performing a (processing time) temporal table join with a Kudu table, > and using a String literal in the WHERE condition: > {code:java} > SELECT d.sensor_id, k.sensor_type, d.`value` > FROM datagen AS d > JOIN `kudu`.`default_database`.`default.sensors` FOR SYSTEM_TIME AS OF > d.proctime as k > ON k.sensor_id = d.sensor_id > WHERE sensor_type = 'pressure';{code} > We get the following error: > Caused by: java.lang.ClassCastException: > org.apache.flink.table.data.binary.BinaryStringData cannot be cast to > java.lang.Stringat > org.apache.flink.connectors.kudu.connector.KuduFilterInfo.predicateComparator(KuduFilterInfo.java:68) > This is because in KuduFilterInfo it tries to cast the literal, which is a > BinaryStringData, to a String. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-321) Kudu lookup join fails with String literal in WHERE clause
[ https://issues.apache.org/jira/browse/BAHIR-321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17654109#comment-17654109 ] Balazs Varga commented on BAHIR-321: I have a proposed solution: https://github.com/apache/bahir-flink/pull/161 > Kudu lookup join fails with String literal in WHERE clause > -- > > Key: BAHIR-321 > URL: https://issues.apache.org/jira/browse/BAHIR-321 > Project: Bahir > Issue Type: Bug > Components: Flink Streaming Connectors >Reporter: Balazs Varga >Priority: Major > > When performing a (processing time) temporal table join with a Kudu table, > and using a String literal in the WHERE condition: > {code:java} > SELECT d.sensor_id, k.sensor_type, d.`value` > FROM datagen AS d > JOIN `kudu`.`default_database`.`default.sensors` FOR SYSTEM_TIME AS OF > d.proctime as k > ON k.sensor_id = d.sensor_id > WHERE sensor_type = 'pressure';{code} > We get the following error: > Caused by: java.lang.ClassCastException: > org.apache.flink.table.data.binary.BinaryStringData cannot be cast to > java.lang.Stringat > org.apache.flink.connectors.kudu.connector.KuduFilterInfo.predicateComparator(KuduFilterInfo.java:68) > This is because in KuduFilterInfo it tries to cast the literal, which is a > BinaryStringData, to a String. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (BAHIR-321) Kudu lookup join fails with String literal in WHERE clause
Balazs Varga created BAHIR-321: -- Summary: Kudu lookup join fails with String literal in WHERE clause Key: BAHIR-321 URL: https://issues.apache.org/jira/browse/BAHIR-321 Project: Bahir Issue Type: Bug Components: Flink Streaming Connectors Reporter: Balazs Varga When performing a (processing time) temporal table join with a Kudu table, and using a String literal in the WHERE condition: {code:java} SELECT d.sensor_id, k.sensor_type, d.`value` FROM datagen AS d JOIN `kudu`.`default_database`.`default.sensors` FOR SYSTEM_TIME AS OF d.proctime as k ON k.sensor_id = d.sensor_id WHERE sensor_type = 'pressure';{code} We get the following error: Caused by: java.lang.ClassCastException: org.apache.flink.table.data.binary.BinaryStringData cannot be cast to java.lang.Stringat org.apache.flink.connectors.kudu.connector.KuduFilterInfo.predicateComparator(KuduFilterInfo.java:68) This is because in KuduFilterInfo it tries to cast the literal, which is a BinaryStringData, to a String. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-315) Redis connector: add Support for SSL connections for cluster
[ https://issues.apache.org/jira/browse/BAHIR-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17636708#comment-17636708 ] ASF subversion and git services commented on BAHIR-315: --- Commit 510a2b18ea8ad42932a37604b57ad5d47fb62a03 in bahir-flink's branch refs/heads/master from Sebastian Ramirez [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=510a2b1 ] [BAHIR-315] Move SSL config to FlinkJedisConfigBase This allows us to support SSL connections in non-cluster configurations. JedisSentinelPool currently doesn't support SSL connections. > Redis connector: add Support for SSL connections for cluster > - > > Key: BAHIR-315 > URL: https://issues.apache.org/jira/browse/BAHIR-315 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: Kostas Netsiporenko >Assignee: João Boto >Priority: Major > Fix For: Flink-1.2.0 > > > Add support for SSL connections for clusters connections > * Upgrade the redis/jedis dependency to support SSL connections for clusters > (SSL support for cluster was added on 3.1.0. > [https://github.com/redis/jedis/releases/tag/jedis-3.1.0] ) > * FlinkJedisClusterConfig should allow you to set a flag. > * When creating a JedisCluster pass the SSL flag. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-319) Remove travis from bahir-flink
[ https://issues.apache.org/jira/browse/BAHIR-319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629097#comment-17629097 ] ASF subversion and git services commented on BAHIR-319: --- Commit c031420c237462dfcd37a4d22a4d852833d6d2f3 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=c031420 ] [BAHIR-319] Remove travis support > Remove travis from bahir-flink > -- > > Key: BAHIR-319 > URL: https://issues.apache.org/jira/browse/BAHIR-319 > Project: Bahir > Issue Type: Sub-task > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > Fix For: Flink-1.2.0 > > > travis is already moved to GitHub actions > the only thing needed is to remove travis file -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629099#comment-17629099 ] ASF subversion and git services commented on BAHIR-308: --- Commit beb6766b5bf9daa73abfd81d0ee038b0fcd988bb in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=beb6766 ] [BAHIR-308] Bump flink version to 1.15.1 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629098#comment-17629098 ] ASF subversion and git services commented on BAHIR-308: --- Commit 86cbac9dddafcc1ae45e32918b9f9cb60ff3dcb8 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=86cbac9 ] [BAHIR-308] Remove support for scala 2.11 > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-317) Bump flink to 1.14.6
[ https://issues.apache.org/jira/browse/BAHIR-317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629094#comment-17629094 ] ASF subversion and git services commented on BAHIR-317: --- Commit f3b096ef71b05fc2f482881a1d706fcc1d4c79b1 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=f3b096e ] [BAHIR-317] Fix distribution parent version > Bump flink to 1.14.6 > > > Key: BAHIR-317 > URL: https://issues.apache.org/jira/browse/BAHIR-317 > Project: Bahir > Issue Type: Improvement >Reporter: João Boto >Assignee: João Boto >Priority: Major > Fix For: Flink-1.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-315) Redis connector: add Support for SSL connections for cluster
[ https://issues.apache.org/jira/browse/BAHIR-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629093#comment-17629093 ] ASF subversion and git services commented on BAHIR-315: --- Commit 522624f481eaf8fdaced084bf166b0e84c664b68 in bahir-flink's branch refs/heads/BAHIR-308 from netsi [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=522624f ] [BAHIR-315] add support for SSL connection > Redis connector: add Support for SSL connections for cluster > - > > Key: BAHIR-315 > URL: https://issues.apache.org/jira/browse/BAHIR-315 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: Kostas Netsiporenko >Assignee: João Boto >Priority: Major > Fix For: Flink-1.2.0 > > > Add support for SSL connections for clusters connections > * Upgrade the redis/jedis dependency to support SSL connections for clusters > (SSL support for cluster was added on 3.1.0. > [https://github.com/redis/jedis/releases/tag/jedis-3.1.0] ) > * FlinkJedisClusterConfig should allow you to set a flag. > * When creating a JedisCluster pass the SSL flag. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-315) Redis connector: add Support for SSL connections for cluster
[ https://issues.apache.org/jira/browse/BAHIR-315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629092#comment-17629092 ] ASF subversion and git services commented on BAHIR-315: --- Commit ef3d18b07ca5ab2d4b653171777122ae257e747c in bahir-flink's branch refs/heads/BAHIR-308 from netsi [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=ef3d18b ] [BAHIR-315] update jedis dependency to 4.3.0 > Redis connector: add Support for SSL connections for cluster > - > > Key: BAHIR-315 > URL: https://issues.apache.org/jira/browse/BAHIR-315 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Affects Versions: Flink-1.0 >Reporter: Kostas Netsiporenko >Assignee: João Boto >Priority: Major > Fix For: Flink-1.2.0 > > > Add support for SSL connections for clusters connections > * Upgrade the redis/jedis dependency to support SSL connections for clusters > (SSL support for cluster was added on 3.1.0. > [https://github.com/redis/jedis/releases/tag/jedis-3.1.0] ) > * FlinkJedisClusterConfig should allow you to set a flag. > * When creating a JedisCluster pass the SSL flag. > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-308) Bump flink to 1.15
[ https://issues.apache.org/jira/browse/BAHIR-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629100#comment-17629100 ] ASF subversion and git services commented on BAHIR-308: --- Commit c128a2a6d4f1315c7e7bcf2fad11bbe49986fa3b in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=c128a2a ] [BAHIR-308] InfluxDB changes > Bump flink to 1.15 > -- > > Key: BAHIR-308 > URL: https://issues.apache.org/jira/browse/BAHIR-308 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Reporter: João Boto >Assignee: João Boto >Priority: Major > > Failing tests: > influxdb2 > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-312) Add Apache License header to readme.md
[ https://issues.apache.org/jira/browse/BAHIR-312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629091#comment-17629091 ] ASF subversion and git services commented on BAHIR-312: --- Commit efd9520a8234c9be632e4691a1b0dda553a74518 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=efd9520 ] [BAHIR-312] Add license header to README.md files > Add Apache License header to readme.md > -- > > Key: BAHIR-312 > URL: https://issues.apache.org/jira/browse/BAHIR-312 > Project: Bahir > Issue Type: Improvement > Components: Flink Streaming Connectors >Affects Versions: Flink-1.1.0 >Reporter: João Boto >Assignee: João Boto >Priority: Major > Fix For: Flink-1.2.0 > > > add license to md files > {code:java} > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-317) Bump flink to 1.14.6
[ https://issues.apache.org/jira/browse/BAHIR-317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629095#comment-17629095 ] ASF subversion and git services commented on BAHIR-317: --- Commit 5c0017c28b6863c2636c9f83ad5ea9a9cc8c8b00 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=5c0017c ] [BAHIR-317] Bump flink version to 1.14.6 > Bump flink to 1.14.6 > > > Key: BAHIR-317 > URL: https://issues.apache.org/jira/browse/BAHIR-317 > Project: Bahir > Issue Type: Improvement >Reporter: João Boto >Assignee: João Boto >Priority: Major > Fix For: Flink-1.2.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (BAHIR-304) Fix dev scripts
[ https://issues.apache.org/jira/browse/BAHIR-304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17629096#comment-17629096 ] ASF subversion and git services commented on BAHIR-304: --- Commit ffb413f0ae625800d2e13e1425728065b162f3b9 in bahir-flink's branch refs/heads/BAHIR-308 from Joao Boto [ https://gitbox.apache.org/repos/asf?p=bahir-flink.git;h=ffb413f ] [BAHIR-304] Add gitBranch option to release script > Fix dev scripts > --- > > Key: BAHIR-304 > URL: https://issues.apache.org/jira/browse/BAHIR-304 > Project: Bahir > Issue Type: Improvement >Reporter: João Boto >Assignee: João Boto >Priority: Major > Fix For: Flink-1.1.0 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)