parqet-cpp

2017-08-15 Thread Jörg Anders
Hi all I tried to compile parqut-cpp as decribed here: https://tutorials.technology/tutorials/21-how-to-compile-and-install-arrow-from-source-code.html on "Debian GNU/Linux 8 (jessie)" It works but at the last step it says: /usr/bin/ld:

columnar writer with Java

2017-08-08 Thread Jörg Anders
Hi all! I program in Java and I use PARQUET with HADOOP because I need to write/read to/from hdfs.  I'm a bit confused because of the contradiction between the columnar nature of PARQUET and the ParquetReader/Writer in version 1.9.0 of  parquet-hadoop  from org.apache.parquetand version 1.6.0 of 

Re: columnar writer with Java

2017-08-08 Thread Jörg Anders
11:35 PM, Jörg Anders <jrg.and...@ymail.com.invalid> wrote: > Hi all! > I program in Java and I use PARQUET with HADOOP because I need to > write/read to/from hdfs.  I'm a bit confused because of the contradiction > between the columnar nature of PARQUET and the ParquetReader/W

why line by line

2017-08-07 Thread Jörg Anders
Hi all! I have a general question concerning PARQUET. PARQUET is a columnar store. But the typical Apache PARQUET Writer/Reader loops use a row by row strategy: Iterator itr = theValues.iterator(); while (itr.hasNext()) {     writer.write(groupFromValue(itr.next())); } writer.close();

where are the images

2017-09-09 Thread Jörg Anders
Hi all! Does anybody know why the images are deleted at https://parquet.apache.org/documentation/latest/ after headline "File format" and "Metadata"? Joerg

PARQUET forma

2017-08-28 Thread Jörg Anders
Hi all! For some reason I haev to know much more about the parquet format. Meanwhile I know the column chunk can be found at FileMetaData.row_groups[x].columns[x].file_offsetIf I compreheded all right at  file_offset starts the repetition level array followed by the definition leve array

Error compiling parquet-mr

2017-08-29 Thread Jörg Anders
Hello! I tried to compile apache-mr from source. Got lot of errors of this sort:   /home/hduser/PARQUET/src/parquet-mr/parquet-protobuf/target/generated-test-sources/java/org/apache/parquet/proto/test/TestProto3.java:[12496,20] no suitable method found for