Hi,
I think we can split the task 1~3 as sub-tasks in JIRA.
And, I recommend to learn how Cassandra manages memory (in package:
org.apache.cassandra.utils.memory) and then design our strategy.
Best,
---
Xiangdong Huang
School of Software, Tsinghua University
Good summary, I would like to make some minor supplements.
1. I think the data of one series can be discarded as soon as its corresponding
Chunk is generated, so you do not need to bother redesigning it, a simple
optimization may do the trick.
2. Yeah, as long as you can estimate how much
kangrong created IOTDB-84:
-
Summary: Out-of-Memory bug
Key: IOTDB-84
URL: https://issues.apache.org/jira/browse/IOTDB-84
Project: Apache IoTDB
Issue Type: Bug
Reporter: kangrong
Hi all:
Sorry forthe text format, the follows are reorganized:
1. Flushing to disk may double the memory cost: A storage group maintains a
list of ChunkGroups in memory and will be flushed to disk when its occupied
memory exceeding the threshold (128MB by default).
In the current implementation,
Sounds cool!
Hope that more and more users submitting their requirements here :D
And, do not forget to maintain the License dependency.
Best,
---
Xiangdong Huang
School of Software, Tsinghua University
黄向东
清华大学 软件学院
徐毅 于2019年4月21日周日 下午10:04写道：
> Hi,
>
>
> I
Hi,
I have create an pull request at [1].
Now, import script has a process bar to indicate how many lines have been
imported and how many line remains. Export script will print how many lines
have been written to output file(It is difficult to add process bar since I
don't know many lines
Hi,
For import script, it is easy to count how many rows are currently imported,
and how many rows remain. So a process bar is easy to implement.
However, for export script, it is difficult to count how many rows will be
imported for a given sql since data is continuously increasing. Now we
XuYi created IOTDB-83:
-
Summary: Add process bar for import/export srcipt
Key: IOTDB-83
URL: https://issues.apache.org/jira/browse/IOTDB-83
Project: Apache IoTDB
Issue Type: Improvement
