Re: Parquet Article / Tutorial

2015-05-11 Thread Flavio Pompermaier
Hi Felix, I was looking at your code and I don't see any parquet.block.size settings. Do you think it is safe to keep defaults? On Fri, Apr 24, 2015 at 11:19 PM, Flavio Pompermaier pomperma...@okkam.it wrote: Thanks Felix, Thanks fir the response! I'm looking forward to use it! On Apr 24,

Re: Parquet Article / Tutorial

2015-05-11 Thread Felix Neutatz
Hi Flavio, changing the block size may help. But I haven't played around with it yet. Best regards, Felix Am 11.05.2015 12:23 nachm. schrieb Flavio Pompermaier pomperma...@okkam.it: Hi Felix, I was looking at your code and I don't see any parquet.block.size settings. Do you think it is safe

Re: Parquet Article / Tutorial

2015-04-24 Thread Flavio Pompermaier
I was looking at this great example and I'd like to ask you which serialization framework is the best if I have to serialize Tuple3String,String,byte[] with Parquet. The syntax I like the most is the Thrift one but I can't see all the pros and cons of using it and I'd like to hear your opinion

Re: Parquet Article / Tutorial

2015-04-24 Thread Felix Neutatz
Hi Flavio, in Thrift you can try: struct FlavioTuple { 1: optional string f1; 2: optional string f2; 3: optional listbyte f3; } See: http://diwakergupta.github.io/thrift-missing-guide/ I like Thrift the most, because the API for Thrift in Parquet is the easiest. Have fun with

Re: Parquet Article / Tutorial

2015-04-07 Thread Fabian Hueske
Very nice article! How about adding the full article to the wiki and having a shorter version as a blog post (with a link to the wiki)? Adding the code to contrib would be great! 2015-04-07 12:45 GMT+02:00 Kostas Tzoumas ktzou...@apache.org: Looks very nice! Would love to see a blog post on