[jira] [Commented] (FLINK-31135) ConfigMap DataSize went > 1 MB and cluster stopped working

2023-03-09 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17698330#comment-17698330 ] ramkrishna.s.vasudevan commented on FLINK-31135: So are we adding all the checkpoints

[jira] [Created] (FLINK-31376) CSVReader for streaming does not support splittable

2023-03-08 Thread ramkrishna.s.vasudevan (Jira)
ramkrishna.s.vasudevan created FLINK-31376: -- Summary: CSVReader for streaming does not support splittable Key: FLINK-31376 URL: https://issues.apache.org/jira/browse/FLINK-31376 Project:

[jira] [Closed] (FLINK-30127) Correct the packaging of HadoopRecoverableWriter and related issues

2023-01-09 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan closed FLINK-30127. -- Release Note: Fixed as part of

[jira] [Updated] (FLINK-30588) Improvement in truncate code in the new ABFSOutputstream

2023-01-06 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-30588: --- Description: There are few TODOs in the new ABFSOutputstream.  1)

[jira] [Created] (FLINK-30588) Improvement in truncate code in the new ABFSOutputstream

2023-01-06 Thread ramkrishna.s.vasudevan (Jira)
ramkrishna.s.vasudevan created FLINK-30588: -- Summary: Improvement in truncate code in the new ABFSOutputstream Key: FLINK-30588 URL: https://issues.apache.org/jira/browse/FLINK-30588

[jira] [Commented] (FLINK-18568) Add Support for Azure Data Lake Store Gen 2 in File Sink

2022-12-15 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648354#comment-17648354 ] ramkrishna.s.vasudevan commented on FLINK-18568: [~psrinivasulu]  - can you take a look

[jira] [Updated] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-12-13 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-30128: --- Attachment: (was: Flink_ABFS_support_1.pdf) > Introduce Azure Data Lake

[jira] [Comment Edited] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-12-05 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17643653#comment-17643653 ] ramkrishna.s.vasudevan edited comment on FLINK-30128 at 12/6/22 4:36 AM:

[jira] [Commented] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-12-05 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17643653#comment-17643653 ] ramkrishna.s.vasudevan commented on FLINK-30128: Trying to add tests for Azure fs, seems

[jira] [Updated] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-12-01 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-30128: --- Attachment: Flink_ABFS_support_1.pdf > Introduce Azure Data Lake Gen2 APIs

[jira] [Updated] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-12-01 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-30128: --- Attachment: (was: Flink_ABFS_support.pdf) > Introduce Azure Data Lake

[jira] [Commented] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-12-01 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642287#comment-17642287 ] ramkrishna.s.vasudevan commented on FLINK-30128: Attaching a simple diagram that talks

[jira] [Updated] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-12-01 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-30128: --- Attachment: Flink_ABFS_support.pdf > Introduce Azure Data Lake Gen2 APIs in

[jira] [Created] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-11-21 Thread ramkrishna.s.vasudevan (Jira)
ramkrishna.s.vasudevan created FLINK-30128: -- Summary: Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path Key: FLINK-30128 URL: https://issues.apache.org/jira/browse/FLINK-30128

[jira] [Created] (FLINK-30127) Correct the packaging of HadoopRecoverableWriter and related issues

2022-11-21 Thread ramkrishna.s.vasudevan (Jira)
ramkrishna.s.vasudevan created FLINK-30127: -- Summary: Correct the packaging of HadoopRecoverableWriter and related issues Key: FLINK-30127 URL: https://issues.apache.org/jira/browse/FLINK-30127

[jira] [Commented] (FLINK-18568) Add Support for Azure Data Lake Store Gen 2 in Streaming File Sink

2022-11-21 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17636992#comment-17636992 ] ramkrishna.s.vasudevan commented on FLINK-18568: [~jinq0123] Yes. I am working on it.

[jira] [Updated] (FLINK-18568) Add Support for Azure Data Lake Store Gen 2 in Streaming File Sink

2022-11-04 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-18568: --- Labels: auto-deprioritized-major (was: auto-deprioritized-major

[jira] [Commented] (FLINK-18568) Add Support for Azure Data Lake Store Gen 2 in Streaming File Sink

2022-10-31 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17626521#comment-17626521 ] ramkrishna.s.vasudevan commented on FLINK-18568: [~psrinivasulu] - I would like to take

[jira] [Commented] (FLINK-14295) Nightly flink-runtime failed with java 11

2019-10-04 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944456#comment-16944456 ] ramkrishna.s.vasudevan commented on FLINK-14295: I see. Thanks. Let me see if I get any

[jira] [Commented] (FLINK-14295) Nightly flink-runtime failed with java 11

2019-10-04 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944370#comment-16944370 ] ramkrishna.s.vasudevan commented on FLINK-14295: [~chesnay] -thanks for the comment. I

[jira] [Commented] (FLINK-14295) Nightly flink-runtime failed with java 11

2019-10-02 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943315#comment-16943315 ] ramkrishna.s.vasudevan commented on FLINK-14295: [~chesnay], [~liyu] I can help to solve

[jira] [Commented] (FLINK-4808) Allow skipping failed checkpoints

2017-10-12 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202221#comment-16202221 ] ramkrishna.s.vasudevan commented on FLINK-4808: --- I can try working on it next week? I raised

[jira] [Commented] (FLINK-4808) Allow skipping failed checkpoints

2017-10-12 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16202223#comment-16202223 ] ramkrishna.s.vasudevan commented on FLINK-4808: --- Thanks once again. > Allow skipping failed

[jira] [Commented] (FLINK-6284) Incorrect sorting of completed checkpoints in ZooKeeperCompletedCheckpointStore

2017-05-11 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16007657#comment-16007657 ] ramkrishna.s.vasudevan commented on FLINK-6284: --- I can try to do this by end of today IST.

[jira] [Commented] (FLINK-5960) Make CheckpointCoordinator less blocking

2017-05-09 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004100#comment-16004100 ] ramkrishna.s.vasudevan commented on FLINK-5960: --- I can work on this too, if no one else is

[jira] [Commented] (FLINK-6284) Incorrect sorting of completed checkpoints in ZooKeeperCompletedCheckpointStore

2017-05-09 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004090#comment-16004090 ] ramkrishna.s.vasudevan commented on FLINK-6284: --- Can I take this up, if some one is not

[jira] [Commented] (FLINK-4810) Checkpoint Coordinator should fail ExecutionGraph after "n" unsuccessful checkpoints

2017-05-09 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16004086#comment-16004086 ] ramkrishna.s.vasudevan commented on FLINK-4810: --- [~StephanEwen] Can I rebase this PR with

[jira] [Commented] (FLINK-5752) Support push down projections for HBaseTableSource

2017-04-16 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15970592#comment-15970592 ] ramkrishna.s.vasudevan commented on FLINK-5752: --- I completed the patch related work but I

[jira] [Commented] (FLINK-5752) Support push down projections for HBaseTableSource

2017-04-05 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956498#comment-15956498 ] ramkrishna.s.vasudevan commented on FLINK-5752: --- Started working on this. Will submit a PR

[jira] [Commented] (FLINK-5752) Support push down projections for HBaseTableSource

2017-03-27 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15942695#comment-15942695 ] ramkrishna.s.vasudevan commented on FLINK-5752: --- Wil start working on this some time this

[jira] [Commented] (FLINK-5698) Add NestedFieldsProjectableTableSource interface

2017-03-24 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15941590#comment-15941590 ] ramkrishna.s.vasudevan commented on FLINK-5698: --- Once this is integrated will work on

[jira] [Commented] (FLINK-5698) Add NestedFieldsProjectableTableSource interface

2017-03-15 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15925872#comment-15925872 ] ramkrishna.s.vasudevan commented on FLINK-5698: --- [~tonycox] Are you still actively working

[jira] [Commented] (FLINK-5962) Cancel checkpoint canceller tasks in CheckpointCoordinator

2017-03-06 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896972#comment-15896972 ] ramkrishna.s.vasudevan commented on FLINK-5962: --- I can work on this [~till.rohrmann] - if

[jira] [Commented] (FLINK-4816) Executions failed from "DEPLOYING" should retain restored checkpoint information

2017-03-05 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15896781#comment-15896781 ] ramkrishna.s.vasudevan commented on FLINK-4816: --- [~tonywei] I would like to continue with

[jira] [Commented] (FLINK-4816) Executions failed from "DEPLOYING" should retain restored checkpoint information

2017-02-28 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887850#comment-15887850 ] ramkrishna.s.vasudevan commented on FLINK-4816: --- Going through the code, will it better that

[jira] [Updated] (FLINK-5752) Support push down projections for HBaseTableSource

2017-02-27 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-5752: -- Description: This is after the discussion to create

[jira] [Commented] (FLINK-5752) Support push down projections for HBaseTableSource

2017-02-13 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863265#comment-15863265 ] ramkrishna.s.vasudevan commented on FLINK-5752: --- Yes. I know that. the only thing I wanted

[jira] [Commented] (FLINK-5752) Support push down projections for HBaseTableSource

2017-02-09 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15859357#comment-15859357 ] ramkrishna.s.vasudevan commented on FLINK-5752: --- Since FLINK-5698 is in progress I thnk my

[jira] [Commented] (FLINK-5698) Add NestedFieldsProjectableTableSource interface

2017-02-09 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15859353#comment-15859353 ] ramkrishna.s.vasudevan commented on FLINK-5698: --- Thanks for the PR. I think I get the idea

[jira] [Created] (FLINK-5752) Support push down projections for HBaseTableSource

2017-02-09 Thread ramkrishna.s.vasudevan (JIRA)
ramkrishna.s.vasudevan created FLINK-5752: - Summary: Support push down projections for HBaseTableSource Key: FLINK-5752 URL: https://issues.apache.org/jira/browse/FLINK-5752 Project: Flink

[jira] (FLINK-4810) Checkpoint Coordinator should fail ExecutionGraph after "n" unsuccessful checkpoints

2017-01-31 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15847206#comment-15847206 ] ramkrishna.s.vasudevan commented on FLINK-4810: --- bq.numUnsuccessfulCheckpointsTriggers

[jira] (FLINK-4810) Checkpoint Coordinator should fail ExecutionGraph after "n" unsuccessful checkpoints

2017-01-30 Thread ramkrishna.s.vasudevan (JIRA)
Title: Message Title ramkrishna.s.vasudevan commented on FLINK-4810

[jira] (FLINK-4808) Allow skipping failed checkpoints

2017-01-30 Thread ramkrishna.s.vasudevan (JIRA)
Title: Message Title ramkrishna.s.vasudevan commented on FLINK-4808

[jira] (FLINK-4461) Ensure all the classes are tagged with suitable annotations

2017-01-30 Thread ramkrishna.s.vasudevan (JIRA)
Title: Message Title ramkrishna.s.vasudevan commented on FLINK-4461

[jira] [Commented] (FLINK-5554) Add sql operator to table api for getting columns from HBase

2017-01-18 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829453#comment-15829453 ] ramkrishna.s.vasudevan commented on FLINK-5554: --- Thanks for starting this thread via JIRA

[jira] [Commented] (FLINK-2168) Add HBaseTableSource

2017-01-16 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825551#comment-15825551 ] ramkrishna.s.vasudevan commented on FLINK-2168: --- Trying your suggestions bq.Since the code

[jira] [Commented] (FLINK-2168) Add HBaseTableSource

2017-01-16 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15824291#comment-15824291 ] ramkrishna.s.vasudevan commented on FLINK-2168: --- bq.However, I think we would need a custom

[jira] [Commented] (FLINK-2168) Add HBaseTableSource

2017-01-16 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15823811#comment-15823811 ] ramkrishna.s.vasudevan commented on FLINK-2168: --- Few questions on the package structure

[jira] [Commented] (FLINK-2168) Add HBaseTableSource

2017-01-11 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15818486#comment-15818486 ] ramkrishna.s.vasudevan commented on FLINK-2168: --- One suggestion is that, though we are going

[jira] [Commented] (FLINK-2168) Add HBaseTableSource

2017-01-10 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15814976#comment-15814976 ] ramkrishna.s.vasudevan commented on FLINK-2168: --- Thanks for the info. Am reading this and

[jira] [Commented] (FLINK-2168) Add HBaseTableSource

2017-01-10 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15814435#comment-15814435 ] ramkrishna.s.vasudevan commented on FLINK-2168: --- The timing was perfect. I was reading thro

[jira] [Commented] (FLINK-2168) Add HBaseTableSource

2017-01-09 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15811535#comment-15811535 ] ramkrishna.s.vasudevan commented on FLINK-2168: --- Thanks [~fhueske]. I was going thro the

[jira] [Commented] (FLINK-2168) Add HBaseTableSource

2017-01-06 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15804049#comment-15804049 ] ramkrishna.s.vasudevan commented on FLINK-2168: --- [~fhueske] Can I work on this now? I can

[jira] [Commented] (FLINK-4815) Automatic fallback to earlier checkpoints when checkpoint restore fails

2017-01-04 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798138#comment-15798138 ] ramkrishna.s.vasudevan commented on FLINK-4815: --- Can i take up one of the sub-tasks if no

[jira] [Commented] (FLINK-4808) Allow skipping failed checkpoints

2017-01-04 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15798136#comment-15798136 ] ramkrishna.s.vasudevan commented on FLINK-4808: --- Seems some sub-tasks are unassigned. Can i

[jira] [Assigned] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-13 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan reassigned FLINK-3322: - Assignee: ramkrishna.s.vasudevan > MemoryManager creates too much GC

[jira] [Created] (FLINK-4615) Reusing the memory allocated for the drivers and iterators

2016-09-13 Thread ramkrishna.s.vasudevan (JIRA)
ramkrishna.s.vasudevan created FLINK-4615: - Summary: Reusing the memory allocated for the drivers and iterators Key: FLINK-4615 URL: https://issues.apache.org/jira/browse/FLINK-4615 Project:

[jira] [Updated] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-13 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-3322: -- Attachment: FLINK-3322_reusingmemoryfordrivers.docx Attaching a doc with two

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-13 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15487192#comment-15487192 ] ramkrishna.s.vasudevan commented on FLINK-3322: --- [~ggevay] I think I was able to make the

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-12 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15484571#comment-15484571 ] ramkrishna.s.vasudevan commented on FLINK-3322: --- To go forward with this, I think as

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-12 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15484104#comment-15484104 ] ramkrishna.s.vasudevan commented on FLINK-3322: --- I did try changing the code to ensure that

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-12 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15483225#comment-15483225 ] ramkrishna.s.vasudevan commented on FLINK-3322: --- [~ggevay] I agree with you. But in my test

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-09 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15476131#comment-15476131 ] ramkrishna.s.vasudevan commented on FLINK-3322: --- [~ggevay] I once again checked your

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-08 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15475975#comment-15475975 ] ramkrishna.s.vasudevan commented on FLINK-3322: --- [~ggevay] Thanks for the inputs. Let me see

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-07 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15470419#comment-15470419 ] ramkrishna.s.vasudevan commented on FLINK-3322: --- I am able to handle cases for the iterative

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-01 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15456065#comment-15456065 ] ramkrishna.s.vasudevan commented on FLINK-3322: --- Reading the code I think I need to update

[jira] [Updated] (FLINK-4461) Ensure all the classes are tagged with suitable annotations

2016-09-01 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-4461: -- Attachment: FLINK_annotations.xlsx Just attaching a list of public classes and

[jira] [Updated] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-09-01 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-3322: -- Attachment: FLINK-3322.docx A simple doc explaining how we can approach this

[jira] [Commented] (FLINK-4484) FLIP-10: Unify Savepoints and Checkpoints

2016-08-29 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15448004#comment-15448004 ] ramkrishna.s.vasudevan commented on FLINK-4484: --- I can help out in the sub tasks too,

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-08-25 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15438412#comment-15438412 ] ramkrishna.s.vasudevan commented on FLINK-3322: --- [~StephanEwen] I thought of working on

[jira] [Commented] (FLINK-4367) Offer separate API for watermark generation and timestamp extraction

2016-08-24 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436334#comment-15436334 ] ramkrishna.s.vasudevan commented on FLINK-4367: --- So it is better to remove the

[jira] [Commented] (FLINK-3322) MemoryManager creates too much GC pressure with iterative jobs

2016-08-24 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15436212#comment-15436212 ] ramkrishna.s.vasudevan commented on FLINK-3322: --- I can work on this and come up with a

[jira] [Created] (FLINK-4462) Add RUN_TIME retention policy for all the flink annotations

2016-08-24 Thread ramkrishna.s.vasudevan (JIRA)
ramkrishna.s.vasudevan created FLINK-4462: - Summary: Add RUN_TIME retention policy for all the flink annotations Key: FLINK-4462 URL: https://issues.apache.org/jira/browse/FLINK-4462 Project:

[jira] [Created] (FLINK-4461) Ensure all the classes are tagged with suitable annotations

2016-08-24 Thread ramkrishna.s.vasudevan (JIRA)
ramkrishna.s.vasudevan created FLINK-4461: - Summary: Ensure all the classes are tagged with suitable annotations Key: FLINK-4461 URL: https://issues.apache.org/jira/browse/FLINK-4461 Project:

[jira] [Assigned] (FLINK-4461) Ensure all the classes are tagged with suitable annotations

2016-08-24 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan reassigned FLINK-4461: - Assignee: ramkrishna.s.vasudevan > Ensure all the classes are tagged

[jira] [Commented] (FLINK-4437) Lock evasion around lastTriggeredCheckpoint may lead to lost updates to related fields

2016-08-23 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433273#comment-15433273 ] ramkrishna.s.vasudevan commented on FLINK-4437: --- bq.I wonder whether we should just simply

[jira] [Assigned] (FLINK-4417) Checkpoints should be subsumed by CheckpointID not, by timestamp

2016-08-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan reassigned FLINK-4417: - Assignee: ramkrishna.s.vasudevan > Checkpoints should be subsumed by

[jira] [Commented] (FLINK-4417) Checkpoints should be subsumed by CheckpointID not, by timestamp

2016-08-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428450#comment-15428450 ] ramkrishna.s.vasudevan commented on FLINK-4417: --- Thank you. Will start with this early next

[jira] [Commented] (FLINK-4417) Checkpoints should be subsumed by CheckpointID not, by timestamp

2016-08-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15427688#comment-15427688 ] ramkrishna.s.vasudevan commented on FLINK-4417: --- [~StephanEwen] Is it ok if I can take this

[jira] [Commented] (FLINK-4388) Race condition during initialization of MemorySegmentFactory

2016-08-13 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15419861#comment-15419861 ] ramkrishna.s.vasudevan commented on FLINK-4388: --- [~StephanEwen] I think it happened because

[jira] [Commented] (FLINK-4388) Race condition during initialization of MemorySegmentFactory

2016-08-12 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418777#comment-15418777 ] ramkrishna.s.vasudevan commented on FLINK-4388: --- When I commented there I saw it as

[jira] [Commented] (FLINK-4388) Race condition during initialization of MemorySegmentFactory

2016-08-12 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15418752#comment-15418752 ] ramkrishna.s.vasudevan commented on FLINK-4388: --- I can take this up and come up with a patch

[jira] [Commented] (FLINK-4322) Unify CheckpointCoordinator and SavepointCoordinator

2016-08-06 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15410662#comment-15410662 ] ramkrishna.s.vasudevan commented on FLINK-4322: --- Ok, got it. I understand. Thanks. > Unify

[jira] [Commented] (FLINK-4322) Unify CheckpointCoordinator and SavepointCoordinator

2016-08-05 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409799#comment-15409799 ] ramkrishna.s.vasudevan commented on FLINK-4322: --- bq.jobs should be able to resume from

[jira] [Assigned] (FLINK-4253) Rename "recovery.mode" config key to "high-availability"

2016-08-05 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan reassigned FLINK-4253: - Assignee: ramkrishna.s.vasudevan > Rename "recovery.mode" config key to

[jira] [Commented] (FLINK-4253) Rename "recovery.mode" config key to "high-availability"

2016-08-05 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409453#comment-15409453 ] ramkrishna.s.vasudevan commented on FLINK-4253: --- I can take this up. > Rename

[jira] [Commented] (FLINK-4094) Off heap memory deallocation might not properly work

2016-08-05 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409350#comment-15409350 ] ramkrishna.s.vasudevan commented on FLINK-4094: --- Updated the PR. Pls check. [~StephanEwen]

[jira] [Commented] (FLINK-4094) Off heap memory deallocation might not properly work

2016-08-04 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15408274#comment-15408274 ] ramkrishna.s.vasudevan commented on FLINK-4094: --- I created the log related msg and the doc.

[jira] [Commented] (FLINK-4094) Off heap memory deallocation might not properly work

2016-08-02 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404384#comment-15404384 ] ramkrishna.s.vasudevan commented on FLINK-4094: --- I can do this Log update and document

[jira] [Commented] (FLINK-4094) Off heap memory deallocation might not properly work

2016-08-02 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15404378#comment-15404378 ] ramkrishna.s.vasudevan commented on FLINK-4094: --- bq. We cannot really manually release the

[jira] [Commented] (FLINK-4094) Off heap memory deallocation might not properly work

2016-08-02 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403843#comment-15403843 ] ramkrishna.s.vasudevan commented on FLINK-4094: --- Ok. bq.If we use pooling, I think we should

[jira] [Commented] (FLINK-4094) Off heap memory deallocation might not properly work

2016-08-02 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15403533#comment-15403533 ] ramkrishna.s.vasudevan commented on FLINK-4094: --- bq.So, another option to fix this would be

[jira] [Commented] (FLINK-3674) Add an interface for EventTime aware User Function

2016-07-29 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400422#comment-15400422 ] ramkrishna.s.vasudevan commented on FLINK-3674: --- Thanks for the comments/feedback. I could

[jira] [Commented] (FLINK-4094) Off heap memory deallocation might not properly work

2016-07-29 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15399085#comment-15399085 ] ramkrishna.s.vasudevan commented on FLINK-4094: --- [~mxm] Thanks for the comment. My comment

[jira] [Assigned] (FLINK-4094) Off heap memory deallocation might not properly work

2016-07-28 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan reassigned FLINK-4094: - Assignee: ramkrishna.s.vasudevan > Off heap memory deallocation might

[jira] [Commented] (FLINK-4094) Off heap memory deallocation might not properly work

2016-07-28 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397634#comment-15397634 ] ramkrishna.s.vasudevan commented on FLINK-4094: --- Can I work on this? I saw the code - if

[jira] [Commented] (FLINK-3674) Add an interface for EventTime aware User Function

2016-07-28 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397018#comment-15397018 ] ramkrishna.s.vasudevan commented on FLINK-3674: --- [~aljoscha] Any feed back/suggestions here?

[jira] [Commented] (FLINK-3397) Failed streaming jobs should fall back to the most recent checkpoint/savepoint

2016-07-24 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15391103#comment-15391103 ] ramkrishna.s.vasudevan commented on FLINK-3397: --- [~uce] bq.I fear though that these changes

[jira] [Commented] (FLINK-3397) Failed streaming jobs should fall back to the most recent checkpoint/savepoint

2016-07-22 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389062#comment-15389062 ] ramkrishna.s.vasudevan commented on FLINK-3397: --- [~uce] A gentle ping !!! :) > Failed

[jira] [Assigned] (FLINK-3674) Add an interface for EventTime aware User Function

2016-07-19 Thread ramkrishna.s.vasudevan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan reassigned FLINK-3674: - Assignee: ramkrishna.s.vasudevan > Add an interface for EventTime aware

  1   2   >