[jira] [Commented] (SPARK-15817) Spark client picking hive 1.2.1 by default which failed to alter a table name
[ https://issues.apache.org/jira/browse/SPARK-15817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15395261#comment-15395261 ] fengchaoge commented on SPARK-15817: spark.sql.hive.metastore.jars /your_path/spark_assembly-1.6.1-hadoopx.x.x.jar try again > Spark client picking hive 1.2.1 by default which failed to alter a table name > - > > Key: SPARK-15817 > URL: https://issues.apache.org/jira/browse/SPARK-15817 > Project: Spark > Issue Type: Bug > Components: Spark Shell >Affects Versions: 1.6.1 >Reporter: Nataraj Gorantla > > Some of our scala scripts are failing with below error. > FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.DDLTask. Unable to alter table. Invalid > method name: 'alter_table_with_cascade' > msg: org.apache.spark.sql.execution.QueryExecutionException: FAILED: > Spark when invoked is trying to initiate Hive 1.2.1 by default. We have Hive > 0.14 installed. Some backgroud investigation from our side explained this. > Analysis > "alter_table_with_cascade" error occurs because of metastore version mismatch > of Spark. > To correct this error set proper version of metastore in Spark config. > I tried to add a couple of parameters to spark-default-conf file. > spark.sql.hive.metastore.version 0.14.0 > #spark.sql.hive.metastore.jars maven > spark.sql.hive.metastore.jars =/usr/hdp/current/hive-client/lib > Still I see issues. Can you please let me know if you have any alternative to > fix this issue. > Thanks, > Nataraj G -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-15817) Spark client picking hive 1.2.1 by default which failed to alter a table name
[ https://issues.apache.org/jira/browse/SPARK-15817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15333069#comment-15333069 ] Nataraj Gorantla commented on SPARK-15817: -- Can some one please add an update . Thanks, Nataraj > Spark client picking hive 1.2.1 by default which failed to alter a table name > - > > Key: SPARK-15817 > URL: https://issues.apache.org/jira/browse/SPARK-15817 > Project: Spark > Issue Type: Bug > Components: Spark Shell >Affects Versions: 1.6.1 >Reporter: Nataraj Gorantla > > Some of our scala scripts are failing with below error. > FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.DDLTask. Unable to alter table. Invalid > method name: 'alter_table_with_cascade' > msg: org.apache.spark.sql.execution.QueryExecutionException: FAILED: > Spark when invoked is trying to initiate Hive 1.2.1 by default. We have Hive > 0.14 installed. Some backgroud investigation from our side explained this. > Analysis > "alter_table_with_cascade" error occurs because of metastore version mismatch > of Spark. > To correct this error set proper version of metastore in Spark config. > I tried to add a couple of parameters to spark-default-conf file. > spark.sql.hive.metastore.version 0.14.0 > #spark.sql.hive.metastore.jars maven > spark.sql.hive.metastore.jars =/usr/hdp/current/hive-client/lib > Still I see issues. Can you please let me know if you have any alternative to > fix this issue. > Thanks, > Nataraj G -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-15817) Spark client picking hive 1.2.1 by default which failed to alter a table name
[ https://issues.apache.org/jira/browse/SPARK-15817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15320265#comment-15320265 ] Nataraj Gorantla commented on SPARK-15817: -- Sean, I didn't build this. I Just downloaded Spark Client and extracted. Not aware of Build Version. Can you please let me know what other details you require. > Spark client picking hive 1.2.1 by default which failed to alter a table name > - > > Key: SPARK-15817 > URL: https://issues.apache.org/jira/browse/SPARK-15817 > Project: Spark > Issue Type: Bug > Components: Spark Shell >Affects Versions: 1.6.1 >Reporter: Nataraj Gorantla > > Some of our scala scripts are failing with below error. > FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.DDLTask. Unable to alter table. Invalid > method name: 'alter_table_with_cascade' > msg: org.apache.spark.sql.execution.QueryExecutionException: FAILED: > Spark when invoked is trying to initiate Hive 1.2.1 by default. We have Hive > 0.14 installed. Some backgroud investigation from our side explained this. > Analysis > "alter_table_with_cascade" error occurs because of metastore version mismatch > of Spark. > To correct this error set proper version of metastore in Spark config. > I tried to add a couple of parameters to spark-default-conf file. > spark.sql.hive.metastore.version 0.14.0 > #spark.sql.hive.metastore.jars maven > spark.sql.hive.metastore.jars =/usr/hdp/current/hive-client/lib > Still I see issues. Can you please let me know if you have any alternative to > fix this issue. > Thanks, > Nataraj G -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-15817) Spark client picking hive 1.2.1 by default which failed to alter a table name
[ https://issues.apache.org/jira/browse/SPARK-15817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15320225#comment-15320225 ] Sean Owen commented on SPARK-15817: --- Hm, what version did you build with? > Spark client picking hive 1.2.1 by default which failed to alter a table name > - > > Key: SPARK-15817 > URL: https://issues.apache.org/jira/browse/SPARK-15817 > Project: Spark > Issue Type: Bug > Components: Spark Shell >Affects Versions: 1.6.1 >Reporter: Nataraj Gorantla > > Some of our scala scripts are failing with below error. > FAILED: Execution Error, return code 1 from > org.apache.hadoop.hive.ql.exec.DDLTask. Unable to alter table. Invalid > method name: 'alter_table_with_cascade' > msg: org.apache.spark.sql.execution.QueryExecutionException: FAILED: > Spark when invoked is trying to initiate Hive 1.2.1 by default. We have Hive > 0.14 installed. Some backgroud investigation from our side explained this. > Analysis > "alter_table_with_cascade" error occurs because of metastore version mismatch > of Spark. > To correct this error set proper version of metastore in Spark config. > I tried to add a couple of parameters to spark-default-conf file. > spark.sql.hive.metastore.version 0.14.0 > #spark.sql.hive.metastore.jars maven > spark.sql.hive.metastore.jars =/usr/hdp/current/hive-client/lib > Still I see issues. Can you please let me know if you have any alternative to > fix this issue. > Thanks, > Nataraj G -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org