Hi,
Not sure if my fix is a correct or permanent solution, depending on your
plan regarding backwards compatibility, etc. Someone with a deeper
understanding of how the code works or is supposed to work should probably
have a look at it.
A temporary workaround is to inherit from StreamWriter and define your own
ostream overloads for logical types that are not supported. Example for
date 32:
class StreamWriterEx : public StreamWriter {
void WriteDate32Raw(int32_t d) {
CheckColumn(Type::INT32, ConvertedType::DATE);
Write<Int32Writer>(d);
}
};
To determine the expected ConvertedType, run the code once and look at the
error message before inheriting, or just do without the CheckColumn() call.
//A
On Mon, Dec 28, 2020 at 4:55 PM Wes McKinney <wesmck...@gmail.com> wrote:
> hi Anders, would you like to open a Jira issue and submit a PR (with
> unit test)?
>
> On Mon, Dec 28, 2020 at 9:51 AM anders johansson
> <anders.johans...@tickup.se> wrote:
> >
> > Hi,
> >
> > When writing to a primitive node of a logical type not supported by
> > converted_type (such as parquet::LogicalType::TimeUnit::NANOS), the error
> > "Column converted type mismatch" is thrown. As I understand it, the
> > converted_type logic is legacy. The problem is solved by removing
> >
> > if (converted_type != node->converted_type()) {
> > throw ParquetException("Column converted type mismatch. Column '" +
> > node->name() +
> > "' has converted type[" +
> > ConvertedTypeToString(node->converted_type())
> +
> > "] not '" +
> > ConvertedTypeToString(converted_type) + "'");
> > }
> >
> > from StreamWriter::CheckColumn() in src/parquet/stream_writer.cc
> >
> > BR,
> > //Anders
>
