[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17174162#comment-17174162
]
Nico Kruber commented on FLINK-7289:
[~itsharshonly] maybe the user mailing list is a better place
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173355#comment-17173355
]
Harsh Singh commented on FLINK-7289:
[~yunta] By the way, I am facing the other issue similar to what
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173351#comment-17173351
]
Harsh Singh commented on FLINK-7289:
[~yunta] Yes managed to figure it out. It was just to experiment
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173320#comment-17173320
]
Yun Tang commented on FLINK-7289:
-
[~itsharshonly], you could call
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173178#comment-17173178
]
Harsh Singh commented on FLINK-7289:
Hi, this doesnt seem to address the issue Vinay pointed out, on
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164117#comment-17164117
]
Harsh Singh commented on FLINK-7289:
Hi [~liyu] is there also a way to enable Direct IO
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979029#comment-16979029
]
Yu Li commented on FLINK-7289:
--
Here is a quick update on progress of the work:
Overall we need below
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16961652#comment-16961652
]
shengjk1 commented on FLINK-7289:
-
Thanks [~yunta] and [~mikekap]. I have solved it. As Mike Kaplinskiy
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958725#comment-16958725
]
shengjk1 commented on FLINK-7289:
-
[~yunta] I don't know how to get the LOG file rockdb,
this is my code
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956841#comment-16956841
]
Yun Tang commented on FLINK-7289:
-
[~shengjk1] I think you have tried the frocksDB jar package I built
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16956749#comment-16956749
]
shengjk1 commented on FLINK-7289:
-
I also rebuild flink and use writeBufferManager. For one specific job
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932200#comment-16932200
]
Truong Duc Kien commented on FLINK-7289:
In my experience, using jemalloc can reduce RocksDB
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905473#comment-16905473
]
Mike Kaplinskiy commented on FLINK-7289:
[~aiyangar] I was testing on an unreleased build of 1.9
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902614#comment-16902614
]
Akshay Iyangar commented on FLINK-7289:
---
[~mikekap] - We too have the same issue when running Flink
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874752#comment-16874752
]
Yu Li commented on FLINK-7289:
--
Thanks for the note [~srichter], I agree this is a great suggestion (thanks
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874318#comment-16874318
]
Stefan Richter commented on FLINK-7289:
---
[~mikekap] I think that is a very good suggestion and
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874305#comment-16874305
]
Mike Kaplinskiy commented on FLINK-7289:
I've been battling the RocksDB memory usage on my
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16445353#comment-16445353
]
Sihua Zhou commented on FLINK-7289:
---
Hi [~srichter], I think it's quite hard to tell what is the best
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110363#comment-16110363
]
Vinay commented on FLINK-7289:
--
Hi Stephan,
I am not saying that we should use the same approach of dropping
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109411#comment-16109411
]
Stefan Richter commented on FLINK-7289:
---
Hi,
I understand that cache memory is not freed, and this
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109261#comment-16109261
]
Vinay commented on FLINK-7289:
--
Hi Stephan,
I agree with what you are saying, But I am saying this from the
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107244#comment-16107244
]
Stefan Richter commented on FLINK-7289:
---
Cache memory is usually not reclaimed by applications, it
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107165#comment-16107165
]
Vinay commented on FLINK-7289:
--
You are right about this "the memory pages will be replaced eventually when
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107105#comment-16107105
]
Vinay commented on FLINK-7289:
--
Actually, I was expecting that the memory will be reclaimed when the job is
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107037#comment-16107037
]
Stefan Richter commented on FLINK-7289:
---
Thanks for the input. I have one question about the last
[
https://issues.apache.org/jira/browse/FLINK-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106133#comment-16106133
]
Vinay commented on FLINK-7289:
--
Hi Stefan,
I have mainly used RocksDB on EMR backed up by SSD's and 122GB
26 matches
Mail list logo
