Hi,
In the earliest version, we use thrift to serialization/deserialization
metadata object. However, we can not deserialize part of a object if we use
thrift.
For example, we have a Metdata class which has a timestamp and a big Object.
class Metdata{
int timestamp
BigObject object
}
In most case, we only want to know what timestamp is. If we use thrift to
deserialize from disk, BigObject will also be deserialized which is
time-cost. So we decide to implement serialization/deserialization function by
ourself.
So what do you think about this scenario?
Thanks
在2019年4月2日 17:13，Julian Feinauer<[email protected]> 写道：
Hi,
first, I think this is very cool!
To avoid this kind of problems (and make further implementations more easy)
could we use something like protobuf or Avro or so as Serialization layer for
the metadata objects?
This would help us to keep all drivers in sync...
What do you think?
Julian
Am 02.04.19, 11:11 schrieb "Lyndon Dong5 Li" <[email protected]>:
Hi,
After investigation, I found the tsfile format of go version is almost the same
with the latest TsFile format of java version, but unfortunately there are some
differences between them: They have almost the same meta objects structures,
but there are several attributes are not exactly the same.
Maybe we can eliminate these differences together if necessary.
-----邮件原件-----
发件人: Xiangdong Huang <[email protected]>
发送时间: 2019年4月1日 23:03
收件人: [email protected]
主题: [External] Re: Commit tsfile-go
Hi,
Glad to see that Lenovo makes this module open sourced.
I want to confirm that Is this go version follow the latest TsFile format?
see https://cwiki.apache.org/confluence/display/IOTDB/TsFile+Format
Best,
-----------------------------------
Xiangdong Huang
School of Software, Tsinghua University
黄向东
清华大学 软件学院
Lyndon Dong5 Li <[email protected]> 于2019年4月1日周一 下午7:33写道：
Hi,
I'm Lidong from Lenovo, I've just created a pull request to commit
project 'tsfile-go' to branch 'master'.
Tsfile-go is a Golang version of tsfile(based on branch 'thanos'),
which was developed by Lenovo & TsingHua. we implemented all of
features in 'tsfile', including:
1. Writing ts data to a tsfile
2. Reading/querying ts data from an existing file 3. Encoding/decoding
with RLE/TS_2DIFF/GORILLA/PLAIN 4. Compression/decompression with
snappy
Now we have applied tsfile-go to Lenovo IOT platform, for purpose of
caching & compressing ts data on edge devices.
Best regards
-----------------------------------
Lidong
LCIG Big Data BU, Lenovo
