[jira] [Closed] (FLINK-9597) Flink application does not scale as expected

2018-06-16 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy closed FLINK-9597. -- Resolution: Later > Flink application does not scale as expected > > >

[jira] [Comment Edited] (FLINK-9597) Flink application does not scale as expected

2018-06-16 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514727#comment-16514727 ] swy edited comment on FLINK-9597 at 6/16/18 9:27 AM: - Hi [~fhueske] Do you mind to

[jira] [Commented] (FLINK-9597) Flink application does not scale as expected

2018-06-16 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514727#comment-16514727 ] swy commented on FLINK-9597: Hi [~fhueske] Do you mind to share your experience any other reason the

[jira] [Updated] (FLINK-9597) Flink application does not scale as expected

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Description: Hi, we found that our Flink application with simple logic, which using process function is not

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Attachment: sample.png > Flink fail to scale! > > > Key: FLINK-9597 >

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Description: Hi, we found that our Flink application with simple logic, which using process function is not

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Description: Hi, we found that our Flink application with simple logic, which using process function is not

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Description: Hi, we found that our Flink application with simple logic, which using process function is not

[jira] [Commented] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513963#comment-16513963 ] swy commented on FLINK-9597: Hi [~fhueske], information updated. > Flink fail to scale! >

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Attachment: TM.png > Flink fail to scale! > > > Key: FLINK-9597 >

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Attachment: JM.png > Flink fail to scale! > > > Key: FLINK-9597 >

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Description: Hi, we found that our Flink application with simple logic, which using process function is not

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Attachment: (was: TM.png) > Flink fail to scale! > > > Key: FLINK-9597 >

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Attachment: TM.png > Flink fail to scale! > > > Key: FLINK-9597 >

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Description: Hi, we found that our Flink application with simple logic, which using process function is not

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Attachment: (was: JM.png) > Flink fail to scale! > > > Key: FLINK-9597 >

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Attachment: JM.png > Flink fail to scale! > > > Key: FLINK-9597 >

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Description: Hi, we found that our Flink application with simple logic, which using process function is not

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Description: Hi, we found that our Flink application with simple logic, which using process function is not

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Description: Hi, we found that our Flink application with simple logic, which using process function is not

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Description: Hi, we found that our Flink application with simple logic, which using process function is not

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Attachment: flink_app_parser_git.zip > Flink fail to scale! > > > Key:

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Description: Hi, we found that our Flink application with simple logic, which using process function is not

[jira] [Updated] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9597: --- Attachment: scaleNotWork.png > Flink fail to scale! > > > Key: FLINK-9597 >

[jira] [Created] (FLINK-9597) Flink fail to scale!

2018-06-15 Thread swy (JIRA)
swy created FLINK-9597: -- Summary: Flink fail to scale! Key: FLINK-9597 URL: https://issues.apache.org/jira/browse/FLINK-9597 Project: Flink Issue Type: Bug Components: Core Affects

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-13 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510872#comment-16510872 ] swy commented on FLINK-9506: no problem an email also sent to ML. > Flink ReducingState.add causing more

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-13 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510864#comment-16510864 ] swy commented on FLINK-9506: Hi [~sihuazhou] I just sent an email to your personal mail box. Let's continue

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-13 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510789#comment-16510789 ] swy commented on FLINK-9506: Hi [~sihuazhou] an email is sent to "u...@flink.apache.org" with title "Flink

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-13 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510752#comment-16510752 ] swy commented on FLINK-9506: Alright i am ok to close the ticket. Do you mind to share me the information on

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-13 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510746#comment-16510746 ] swy commented on FLINK-9506: Hi [~sihuazhou] it surprise me as well. Please advice if something wrong in the

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-13 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510715#comment-16510715 ] swy commented on FLINK-9506: Hi [~sihuazhou] please download source from

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-13 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510704#comment-16510704 ] swy commented on FLINK-9506: Hi [~sihuazhou] the picture is captured without any line being commented-out.

[jira] [Updated] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-12 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9506: --- Attachment: input_stop_when_timer_run.png > Flink ReducingState.add causing more than 100% performance drop >

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-12 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510632#comment-16510632 ] swy commented on FLINK-9506: Hi [~sihuazhou] to your questions, 1. Checkpoint is disable at the moment. But

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-12 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510575#comment-16510575 ] swy commented on FLINK-9506: Hi [~sihuazhou] you are right. Fluctuation only happened when "keyby" with

[jira] [Comment Edited] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-12 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509808#comment-16509808 ] swy edited comment on FLINK-9506 at 6/12/18 4:10 PM: - Hi [~sihuazhou] I hope to close

[jira] [Updated] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-12 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9506: --- Attachment: keyby.png > Flink ReducingState.add causing more than 100% performance drop >

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-12 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16509808#comment-16509808 ] swy commented on FLINK-9506: Hi [~sihuazhou] I hope to close the ticket too but the problem still persists

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-07 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504820#comment-16504820 ] swy commented on FLINK-9506: thank for response [~sihuazhou], the key length is around 50 chars. We will

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-07 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16504675#comment-16504675 ] swy commented on FLINK-9506: [~sihuazhou] your idea is brilliant, but the first test result is not show too

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-06 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503426#comment-16503426 ] swy commented on FLINK-9506: [~kkrugler] please don't close the ticket yet. Because the performance

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-06 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503284#comment-16503284 ] swy commented on FLINK-9506: [~srichter] Thanks for tips, after implement Rocksdb the performance seems much

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-04 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16500211#comment-16500211 ] swy commented on FLINK-9506: [~srichter] Really appreciated your help. To your points, *[First, when using

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-04 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499972#comment-16499972 ] swy commented on FLINK-9506: [~srichter] thanks for good explanation. We have no choice but need to store

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-04 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499869#comment-16499869 ] swy commented on FLINK-9506: Any workaround would be appreciated, do you think using rocksdb help in such

[jira] [Comment Edited] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-04 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499859#comment-16499859 ] swy edited comment on FLINK-9506 at 6/4/18 8:03 AM: [~sihuazhou] Your tricks quite

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-04 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499859#comment-16499859 ] swy commented on FLINK-9506: [~sihuazhou] Your tricks quite promising as the performance has been improved

[jira] [Updated] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-04 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9506: --- Attachment: KeyNoHash_VS_KeyHash.png > Flink ReducingState.add causing more than 100% performance drop >

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-03 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499667#comment-16499667 ] swy commented on FLINK-9506: Thanks for pointing out, this is a mistake in the sample. In real application

[jira] [Comment Edited] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-03 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499445#comment-16499445 ] swy edited comment on FLINK-9506 at 6/3/18 3:04 PM: what we want to know is: Is this

[jira] [Comment Edited] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-03 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499445#comment-16499445 ] swy edited comment on FLINK-9506 at 6/3/18 3:03 PM: what we want to know is: Is this

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-03 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499445#comment-16499445 ] swy commented on FLINK-9506: what we want to know is: Is this something expected or something wrong in our

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-03 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499412#comment-16499412 ] swy commented on FLINK-9506: Hi [~sihuazhou] the keyby is comes from one of the private member in POJO.

[jira] [Issue Comment Deleted] (FLINK-9442) Flink Scaling not working

2018-06-03 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9442: --- Comment: was deleted (was: ok will post to mailing list as well. thanks. by the way once we change to

[jira] [Commented] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-03 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16499393#comment-16499393 ] swy commented on FLINK-9506: Hi Fabian, 1. Yes. 2. Yes. The state is suppose to store in Task Manager's

[jira] [Updated] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-03 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9506: --- Attachment: flink.png > Flink ReducingState.add causing more than 100% performance drop >

[jira] [Created] (FLINK-9506) Flink ReducingState.add causing more than 100% performance drop

2018-06-03 Thread swy (JIRA)
swy created FLINK-9506: -- Summary: Flink ReducingState.add causing more than 100% performance drop Key: FLINK-9506 URL: https://issues.apache.org/jira/browse/FLINK-9506 Project: Flink Issue Type:

[jira] [Commented] (FLINK-9442) Flink Scaling not working

2018-05-26 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491720#comment-16491720 ] swy commented on FLINK-9442: ok will post to mailing list as well. thanks. by the way once we change to

[jira] [Updated] (FLINK-9442) Flink Scaling not working

2018-05-26 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9442: --- Affects Version/s: 1.4.2 > Flink Scaling not working > - > > Key: FLINK-9442

[jira] [Updated] (FLINK-9442) Flink Scaling not working

2018-05-26 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9442: --- Description: Hi,   We are in the middle of testing scaling ability of Flink. But we found that scaling not

[jira] [Updated] (FLINK-9442) Flink Scaling not working

2018-05-26 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9442: --- Description: Hi,   We are in the middle of testing scaling ability of Flink. But we found that scaling not

[jira] [Updated] (FLINK-9442) Flink Scaling not working

2018-05-26 Thread swy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] swy updated FLINK-9442: --- Description: Hi,   We are in the middle of testing scaling ability of Flink. But we found that scaling not