Attila Bukor has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/19026 )
Change subject: KUDU-3401 Fix table creation with HMS Integration ...................................................................... KUDU-3401 Fix table creation with HMS Integration Hive queries on Kudu Tables were failing with the following stack trace: ERROR : Failed org.apache.hadoop.hive.metastore.api.MetaException: java.lang.ClassNotFoundException Class not found at org.apache.hadoop.hive.metastore.HiveMetaStoreUtils.getDeserializer(HiveMetaStoreUtils.java:98) at org.apache.hadoop.hive.metastore.HiveMetaStoreUtils.getDeserializer(HiveMetaStoreUtils.java:77) at org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:331) The issue was due to the Kudu HMS Client not sending the fields required by Hive, namely the Input/Outputformat and Serialization library for the created table when making a create table request. Thus, running queries through Hive on Kudu tables would fail due to these fields missing in the HMS Backend Database. This patch adds the missing Input/Output formats and Serialization library to table creation with Kudu HMS Integration.The patch also extends the current test cases to cover the added fields. Manually tested on a seperate cluster by creating a Kudu table with several columns via "stored as kudu", confirmed the missing data is sent by checking the parameters of the create_table request in Hive log files, and checked that the data is written to the HMS Backend Database by going through the SDS table for INPUT_FORMAT, OUTPUT_FORMAT and SERDES table for SLIB to see if the data was filled for the newly created kudu table. Ran a few Hive queries on the created Kudu tables and confirmed that no errors are present. Change-Id: Ia1b53b55005e2899d8575b0fb7250351d914afb4 Reviewed-on: http://gerrit.cloudera.org:8080/19026 Reviewed-by: Alexey Serbin <[email protected]> Reviewed-by: Zoltan Chovan <[email protected]> Tested-by: Attila Bukor <[email protected]> Reviewed-by: Attila Bukor <[email protected]> --- M src/kudu/hms/hms_catalog-test.cc M src/kudu/hms/hms_catalog.cc M src/kudu/hms/hms_client-test.cc M src/kudu/hms/hms_client.cc M src/kudu/hms/hms_client.h M src/kudu/integration-tests/hms_itest-base.cc 6 files changed, 32 insertions(+), 2 deletions(-) Approvals: Alexey Serbin: Looks good to me, but someone else must approve Zoltan Chovan: Looks good to me, but someone else must approve Attila Bukor: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/19026 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: kudu Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Ia1b53b55005e2899d8575b0fb7250351d914afb4 Gerrit-Change-Number: 19026 Gerrit-PatchSet: 7 Gerrit-Owner: Khazar Mammadli <[email protected]> Gerrit-Reviewer: Abhishek Chennaka <[email protected]> Gerrit-Reviewer: Alexey Serbin <[email protected]> Gerrit-Reviewer: Attila Bukor <[email protected]> Gerrit-Reviewer: Khazar Mammadli <[email protected]> Gerrit-Reviewer: Kudu Jenkins (120) Gerrit-Reviewer: Zoltan Chovan <[email protected]>
