Alex Rodoni has posted comments on this change. ( http://gerrit.cloudera.org:8080/14340 )
Change subject: IMPALA-8988: [DOCS] DATE type is supported AVRO tables ...................................................................... Patch Set 1: (2 comments) http://gerrit.cloudera.org:8080/#/c/14340/1/docs/topics/impala_date.xml File docs/topics/impala_date.xml: http://gerrit.cloudera.org:8080/#/c/14340/1/docs/topics/impala_date.xml@53 PS1, Line 53: 0000-01-01 > Note that we are in the midst of changing the valid range for DATE values t I will update this now, assuming that patch will be approved. http://gerrit.cloudera.org:8080/#/c/14340/1/docs/topics/impala_date.xml@69 PS1, Line 69: <p> Parquet uses <codeph>DATE</codeph> logical type for dates. The : <codeph>DATE</codeph> logical type annotates an <codeph>INT32</codeph> : that stores the number of days from the Unix epoch, January 1, 1970. This : representation introduces a Parquet interoperability issue between Impala : and older versions of Hive: </p> : : <p> If Hive versions lower than 3.1 wrote dates earlier than 1582-10-15 to a : Parquet table, those dates would be read back incorrectly by Impala and : vice versa. In Hive 3.1 and higher, this is no longer an issue. </p> > Avro has the same issue since avro too stores DATE logical type as a number Done -- To view, visit http://gerrit.cloudera.org:8080/14340 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I95f37accddadcba436676498d5cbb34cda281846 Gerrit-Change-Number: 14340 Gerrit-PatchSet: 1 Gerrit-Owner: Alex Rodoni <[email protected]> Gerrit-Reviewer: Alex Rodoni <[email protected]> Gerrit-Reviewer: Attila Jeges <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Comment-Date: Wed, 02 Oct 2019 18:33:47 +0000 Gerrit-HasComments: Yes
