[GitHub] orc issue #268: ORC-363 Enable zstd decompression in ORC Java reader

2018-08-10 Thread t3rmin4t0r 
Github user t3rmin4t0r commented on the issue:

https://github.com/apache/orc/pull/268
  
I'm in favour of using the org.apache.hadoop.io.compress.ZStandardCodec if 
it is available from Hadoop.


---

[GitHub] orc issue #268: ORC-363 Enable zstd decompression in ORC Java reader

2018-08-10 Thread xndai 
Github user xndai commented on the issue:

https://github.com/apache/orc/pull/268
  
Hi all, I'd like to bring this up again. It's almost another three months, 
and we haven't seen the zstd java library yet. I would suggest we move forward 
to add zstd support in C++ reader/writer. And at the same time, enable Java 
reader by this change. 


---

[GitHub] orc issue #268: ORC-363 Enable zstd decompression in ORC Java reader

2018-05-17 Thread xndai 
Github user xndai commented on the issue:

https://github.com/apache/orc/pull/268
  
The current solution is not perfect. But at least it gives us some ability 
to read zstd Orc files, which I believe is important from the compatibility 
perspective - our in-house system has zstd Orc that would like to be consumed 
by Hive, Spark, etc. I am not sure when the zstd compressor will be available. 
It's probably another 6 months or a year.

If we enable zstd on C++ reader/writer first. Then we enable Java reader to 
consume zstd Orc from C++ writer. Would you consider that as end-to-end test?


---

[GitHub] orc issue #268: ORC-363 Enable zstd decompression in ORC Java reader

2018-05-16 Thread omalley 
Github user omalley commented on the issue:

https://github.com/apache/orc/pull/268
  
I'd rather hold off on this until we can do an end-to-end test.


---