Rob Ambalu created ARROW-15208:
----------------------------------
Summary: parquet StreamWriter nanosecond timestamp support
Key: ARROW-15208
URL: https://issues.apache.org/jira/browse/ARROW-15208
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Rob Ambalu
I'm trying to use the parquet StreamWriter interface for convenience. It works
great, except it doesnt seem to have support for nanoseconds. There are stream
operators for std::chrono:milliseconds and std::chrono::microseconds but not
std::chrono:nanoseconds.
Adding an overload would probably be simplest if that sounds reasonable.
I also tried to derive from StreamWriter myself in order to introduce the
operator locally to get around this, but I hit a linker error on the constexpr
variables defined in the base ( not really sure why honestly )
{code:java}
Python-3.6.4/lib/python3.6/site-packages/pyarrow/libparquet.a(stream_writer.cc.o):(.rodata+0x78):
multiple definition of `parquet::StreamWriter::kRepLevelZero';
binutils-2.31/bin/ld: DWARF error: can't find .debug_ranges section.
mktdata_playback.dir/ParquetWriter.cpp.o:(.rodata._ZN7parquet12StreamWriter13kRepLevelZeroE[_ZN7parquet12StreamWriter13kRepLevelZeroE]+0x0):
first defined here
binutils-2.31/bin/ld:
Python-3.6.4/lib/python3.6/site-packages/pyarrow/libparquet.a(stream_writer.cc.o):(.rodata+0x7a):
multiple definition of `parquet::StreamWriter::kDefLevelOne';
mktdata_playback.dir/ParquetWriter.cpp.o:(.rodata._ZN7parquet12StreamWriter12kDefLevelOneE[_ZN7parquet12StreamWriter12kDefLevelOneE]+0x0):
first defined here
{code}
I cant find any other way around this
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
