[
https://issues.apache.org/jira/browse/ARROW-15208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rob Ambalu updated ARROW-15208:
-------------------------------
Description:
I'm trying to use the parquet StreamWriter interface for convenience. It works
great, except it doesnt seem to have support for nanoseconds. There are stream
operators for std::chrono:milliseconds and std::chrono::microseconds but not
std::chrono:nanoseconds.
Adding an overload would probably be simplest if that sounds reasonable.
was:
I'm trying to use the parquet StreamWriter interface for convenience. It works
great, except it doesnt seem to have support for nanoseconds. There are stream
operators for std::chrono:milliseconds and std::chrono::microseconds but not
std::chrono:nanoseconds.
Adding an overload would probably be simplest if that sounds reasonable.
I also tried to derive from StreamWriter myself in order to introduce the
operator locally to get around this, but I hit a linker error on the constexpr
variables defined in the base ( not really sure why honestly )
{code:java}
Python-3.6.4/lib/python3.6/site-packages/pyarrow/libparquet.a(stream_writer.cc.o):(.rodata+0x78):
multiple definition of `parquet::StreamWriter::kRepLevelZero';
binutils-2.31/bin/ld: DWARF error: can't find .debug_ranges section.
mktdata_playback.dir/ParquetWriter.cpp.o:(.rodata._ZN7parquet12StreamWriter13kRepLevelZeroE[_ZN7parquet12StreamWriter13kRepLevelZeroE]+0x0):
first defined here
binutils-2.31/bin/ld:
Python-3.6.4/lib/python3.6/site-packages/pyarrow/libparquet.a(stream_writer.cc.o):(.rodata+0x7a):
multiple definition of `parquet::StreamWriter::kDefLevelOne';
mktdata_playback.dir/ParquetWriter.cpp.o:(.rodata._ZN7parquet12StreamWriter12kDefLevelOneE[_ZN7parquet12StreamWriter12kDefLevelOneE]+0x0):
first defined here
{code}
I cant find any other way around this
> parquet StreamWriter nanosecond timestamp support
> -------------------------------------------------
>
> Key: ARROW-15208
> URL: https://issues.apache.org/jira/browse/ARROW-15208
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++
> Reporter: Rob Ambalu
> Priority: Major
>
> I'm trying to use the parquet StreamWriter interface for convenience. It
> works great, except it doesnt seem to have support for nanoseconds. There
> are stream operators for std::chrono:milliseconds and
> std::chrono::microseconds but not std::chrono:nanoseconds.
> Adding an overload would probably be simplest if that sounds reasonable.
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
