[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2022-01-20 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479481#comment-17479481 ] Martijn Visser commented on FLINK-11838: [~galenwarren] That's no dumb question :) It's just a

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2022-01-20 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479454#comment-17479454 ] Galen Warren commented on FLINK-11838: -- [~MartijnVisser] I'd say let's handle documentation and

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2022-01-19 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479153#comment-17479153 ] Martijn Visser commented on FLINK-11838: Thanks for taking of this [~galenwarren]  We should

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-08-28 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406351#comment-17406351 ] Xintong Song commented on FLINK-11838: -- [~laughingman7743] Unfortunately, this feature is not

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-08-28 Thread Tomoyuki NAKAMURA (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406216#comment-17406216 ] Tomoyuki NAKAMURA commented on FLINK-11838: --- Is there any progress on this ticket, it looks

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-08-12 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17398108#comment-17398108 ] Galen Warren commented on FLINK-11838: -- I know this has taken a long time. I'll have the code in

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-04-21 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326990#comment-17326990 ] Galen Warren commented on FLINK-11838: -- PR is still active. > Create RecoverableWriter for GCS >

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-04-21 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17326986#comment-17326986 ] Flink Jira Bot commented on FLINK-11838: This issue is assigned but has not received an update

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-04-13 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320638#comment-17320638 ] Xintong Song commented on FLINK-11838: -- Thanks [~galenwarren]. I'll try to take a look asap. Just

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-04-13 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17320363#comment-17320363 ] Galen Warren commented on FLINK-11838: -- [~xintongsong], PR created:

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-04-07 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316376#comment-17316376 ] Galen Warren commented on FLINK-11838: -- Working on the new PR now ... coming soon. > Create

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-04-02 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314161#comment-17314161 ] Xintong Song commented on FLINK-11838: -- Thanks for the update, [~galenwarren]. Either updating the

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-04-02 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314079#comment-17314079 ] Galen Warren commented on FLINK-11838: -- [~xintongsong] – actually, is that the right thing to do,

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-04-02 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17314067#comment-17314067 ] Galen Warren commented on FLINK-11838: -- Hi [~xintongsong] – sorry for the long delay. I plan to

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-04-02 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17313642#comment-17313642 ] Xintong Song commented on FLINK-11838: -- Hi [~galenwarren], any updates on this ticket? I'd like to

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-03-17 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303537#comment-17303537 ] Galen Warren commented on FLINK-11838: -- Not that I'm aware of. Writing checkpoints/savepoints and

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-03-16 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17302382#comment-17302382 ] Berkay Öztürk commented on FLINK-11838: --- Are there any other way of writing streaming data into a

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-03-12 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300332#comment-17300332 ] Galen Warren commented on FLINK-11838: -- [~BerkayOzturk] No, it's not in a working state. Since that

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-03-12 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300157#comment-17300157 ] Berkay Öztürk commented on FLINK-11838: --- Hello [~galenwarren], I currently need a GCS connector

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-03-12 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17300156#comment-17300156 ] Berkay Öztürk commented on FLINK-11838: --- Hello [~galenwarren], I currently need a GCS connector

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-03-04 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295702#comment-17295702 ] Xintong Song commented on FLINK-11838: -- Thanks for the update, [~galenwarren]. No worries. Good

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-03-04 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17295384#comment-17295384 ] Galen Warren commented on FLINK-11838: -- I just wanted to add an update here so this doesn't go

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-22 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288764#comment-17288764 ] Xintong Song commented on FLINK-11838: -- Thanks for the updates, [~galenwarren]. No worries, take

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-22 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288419#comment-17288419 ] Galen Warren commented on FLINK-11838: -- Hey, I just wanted to check in here. Sorry for the delay,

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-15 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284896#comment-17284896 ] Galen Warren commented on FLINK-11838: -- Ah, OK – I see. It will take me a couple of days to get

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-15 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284771#comment-17284771 ] Xintong Song commented on FLINK-11838: -- [~galenwarren], What makes the original PR not easy to

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-15 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284751#comment-17284751 ] Galen Warren commented on FLINK-11838: -- That's fine on "compose on persist", I'll leave it out for

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-14 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284518#comment-17284518 ] Xintong Song commented on FLINK-11838: -- Thanks [~galenwarren], I think we are good to move forward

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-14 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284476#comment-17284476 ] Galen Warren commented on FLINK-11838: -- {quote}Maybe for the first step, it's good enough to simply

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-13 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17284339#comment-17284339 ] Xintong Song commented on FLINK-11838: -- bq. perhaps we expose this chunk size as a Flink option to

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-12 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283950#comment-17283950 ] Galen Warren commented on FLINK-11838: -- One more thought/question. While we can potentially compose

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-12 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17283747#comment-17283747 ] Galen Warren commented on FLINK-11838: -- Hi [~xintongsong], sorry for the delay here, I had some

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-09 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282195#comment-17282195 ] Xintong Song commented on FLINK-11838: -- Well, I guess I see the divergence here. So switching to

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-09 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282191#comment-17282191 ] Xintong Song commented on FLINK-11838: -- Thanks [~galenwarren], h4. Java Serialization According

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-09 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281769#comment-17281769 ] Galen Warren commented on FLINK-11838: -- Hi [~xintongsong] – a couple more thoughts here. I think I

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-08 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281488#comment-17281488 ] Xintong Song commented on FLINK-11838: -- Thanks for the information. FYI, the Chinese New Year

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-08 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281481#comment-17281481 ] Galen Warren commented on FLINK-11838: -- Thanks, that all sounds reasonable. I'll take a look at the

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-07 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280730#comment-17280730 ] Xintong Song commented on FLINK-11838: -- Thanks [~galenwarren]. Your plans regarding the temporary

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-07 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280587#comment-17280587 ] Galen Warren commented on FLINK-11838: -- Thanks. All of your initial assumptions are correct, though

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-07 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280454#comment-17280454 ] Xintong Song commented on FLINK-11838: -- [~galenwarren], Thanks for explaining the design details.

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-05 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279694#comment-17279694 ] Galen Warren commented on FLINK-11838: -- Thanks [~xtsong]! I really appreciate your help on this.

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-04 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279299#comment-17279299 ] Xintong Song commented on FLINK-11838: -- Hi [~galenwarren], Thanks for offering the contribution. I

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2021-02-04 Thread Galen Warren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279023#comment-17279023 ] Galen Warren commented on FLINK-11838: -- I have submitted a new

[jira] [Commented] (FLINK-11838) Create RecoverableWriter for GCS

2020-06-06 Thread Tomoyuki NAKAMURA (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17127324#comment-17127324 ] Tomoyuki NAKAMURA commented on FLINK-11838: --- Is there any progress on this ticket? > Create