clintropolis commented on issue #5787: Adding additional datatypes support for Parquet extension URL: https://github.com/apache/incubator-druid/pull/5787#issuecomment-425599467 Hi @sathishsri88, I have a related PR open, #6360, which in addition to introducing an alternate way to parse parquet files (e.g. an alternative to converting to avro), adds support for the [FlattenSpec](http://druid.io/docs/latest/ingestion/flatten-json) that some indexing formats (including the avro extension itself) currently support. My PR was originally intended to resolve a different issue related to an inability of parquet-avro conversion to handle `INT96` columns, but I think the addition of `flattenSpec` that both the `parquet` and `parquet-avro` parsers of my PR support, may solve some or all of the problem this PR is trying to solve. That said, if there are some gaps in the `flattenSpec` based approach of my PR and the functionality introduced here, I believe our changes could be made to co-exist in some manner, we would just need to distinguish between my `parquet-avro` parse spec with it's `flattenSpec`, and this PR's with it's `parser`. What do you think?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
