[jira] [Resolved] (SPARK-22501) 64KB JVM bytecode limit problem with in

[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22501. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by pull

[jira] [Assigned] (SPARK-22501) 64KB JVM bytecode limit problem with in

[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22501: --- Assignee: Kazuaki Ishizaki > 64KB JVM bytecode limit problem with in >

[jira] [Created] (SPARK-22543) fix java 64kb compile error for deeply nested expressions

Wenchen Fan created SPARK-22543: --- Summary: fix java 64kb compile error for deeply nested expressions Key: SPARK-22543 URL: https://issues.apache.org/jira/browse/SPARK-22543 Project: Spark

[jira] [Commented] (SPARK-22267) Spark SQL incorrectly reads ORC file when column order is different

[ https://issues.apache.org/jira/browse/SPARK-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255650#comment-16255650 ] Dongjoon Hyun commented on SPARK-22267: --- Yep. It does, but there exist the following issues still.

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22499: Fix Version/s: (was: 2.2.1) 2.2.2 > 64KB JVM bytecode limit problem with

[jira] [Assigned] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22499: --- Assignee: Kazuaki Ishizaki > 64KB JVM bytecode limit problem with least and greatest >

[jira] [Resolved] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22499. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull

[jira] [Resolved] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22494. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.2 Issue resolved by pull

[jira] [Assigned] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-22494: --- Assignee: Marco Gaido > Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit

[jira] [Updated] (SPARK-22469) Accuracy problem in comparison with string and numeric

[ https://issues.apache.org/jira/browse/SPARK-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-22469: Fix Version/s: 2.2.2 > Accuracy problem in comparison with string and numeric >

[jira] [Updated] (SPARK-22274) User-defined aggregation functions with pandas udf

[ https://issues.apache.org/jira/browse/SPARK-22274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-22274: --- Summary: User-defined aggregation functions with pandas udf (was: Used-defined aggregation functions with

[jira] [Updated] (SPARK-22239) User-defined window functions with pandas udf

[ https://issues.apache.org/jira/browse/SPARK-22239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Jin updated SPARK-22239: --- Summary: User-defined window functions with pandas udf (was: Used-defined window functions with pandas udf)

[jira] [Commented] (SPARK-22274) User-defined aggregation functions with pandas udf

[ https://issues.apache.org/jira/browse/SPARK-22274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255363#comment-16255363 ] Li Jin commented on SPARK-22274: Hi [~holdenk] I am working on this but haven't got a PR yet. >

[jira] [Assigned] (SPARK-22542) remove unused features in ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-22542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22542: Assignee: Apache Spark (was: Wenchen Fan) > remove unused features in ColumnarBatch >

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255329#comment-16255329 ] Steve Loughran commented on SPARK-16996: [~maver1ck] Spark hive is custom as it was modified to

[jira] [Resolved] (SPARK-22479) SaveIntoDataSourceCommand logs jdbc credentials

[ https://issues.apache.org/jira/browse/SPARK-22479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-22479. - Resolution: Fixed Assignee: Onur Satici Fix Version/s: 2.2.2

[jira] [Assigned] (SPARK-22542) remove unused features in ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-22542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22542: Assignee: Wenchen Fan (was: Apache Spark) > remove unused features in ColumnarBatch >

[jira] [Created] (SPARK-22542) remove unused features in ColumnarBatch

Wenchen Fan created SPARK-22542: --- Summary: remove unused features in ColumnarBatch Key: SPARK-22542 URL: https://issues.apache.org/jira/browse/SPARK-22542 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-22542) remove unused features in ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-22542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255318#comment-16255318 ] Apache Spark commented on SPARK-22542: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-22504) Optimization in overwrite table in case of failure

[ https://issues.apache.org/jira/browse/SPARK-22504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255353#comment-16255353 ] Sean Owen commented on SPARK-22504: --- You're overlooking the new problem by just saying 'we can drop the

[jira] [Commented] (SPARK-20882) Executor is waiting for ShuffleBlockFetcherIterator

[ https://issues.apache.org/jira/browse/SPARK-20882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256578#comment-16256578 ] ShuMing Li commented on SPARK-20882: Can I ask what `Still have 1 requests outstanding when

[jira] [Commented] (SPARK-22240) S3 CSV number of partitions incorrectly computed

[ https://issues.apache.org/jira/browse/SPARK-22240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255861#comment-16255861 ] Steve Loughran commented on SPARK-22240: I think there are two separate issues and I'm adding

[jira] [Assigned] (SPARK-22543) fix java 64kb compile error for deeply nested expressions

[ https://issues.apache.org/jira/browse/SPARK-22543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22543: Assignee: Wenchen Fan (was: Apache Spark) > fix java 64kb compile error for deeply

[jira] [Assigned] (SPARK-22543) fix java 64kb compile error for deeply nested expressions

[ https://issues.apache.org/jira/browse/SPARK-22543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22543: Assignee: Apache Spark (was: Wenchen Fan) > fix java 64kb compile error for deeply

[jira] [Commented] (SPARK-22543) fix java 64kb compile error for deeply nested expressions

[ https://issues.apache.org/jira/browse/SPARK-22543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255678#comment-16255678 ] Apache Spark commented on SPARK-22543: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-22535) PythonRunner.MonitorThread should give the task a little time to finish before killing the python worker

[ https://issues.apache.org/jira/browse/SPARK-22535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255791#comment-16255791 ] Apache Spark commented on SPARK-22535: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Created] (SPARK-22544) FileStreamSource should use its own hadoop conf to call globPathIfNecessary

Shixiong Zhu created SPARK-22544: Summary: FileStreamSource should use its own hadoop conf to call globPathIfNecessary Key: SPARK-22544 URL: https://issues.apache.org/jira/browse/SPARK-22544 Project:

[jira] [Updated] (SPARK-22535) PythonRunner.MonitorThread should give the task a little time to finish before killing the python worker

[ https://issues.apache.org/jira/browse/SPARK-22535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-22535: - Fix Version/s: 2.2.2 > PythonRunner.MonitorThread should give the task a little time to finish

[jira] [Assigned] (SPARK-22544) FileStreamSource should use its own hadoop conf to call globPathIfNecessary

[ https://issues.apache.org/jira/browse/SPARK-22544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22544: Assignee: Apache Spark > FileStreamSource should use its own hadoop conf to call

[jira] [Commented] (SPARK-22544) FileStreamSource should use its own hadoop conf to call globPathIfNecessary

[ https://issues.apache.org/jira/browse/SPARK-22544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256154#comment-16256154 ] Apache Spark commented on SPARK-22544: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22544) FileStreamSource should use its own hadoop conf to call globPathIfNecessary

[ https://issues.apache.org/jira/browse/SPARK-22544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22544: Assignee: (was: Apache Spark) > FileStreamSource should use its own hadoop conf to

[jira] [Commented] (SPARK-22541) Dataframes: applying multiple filters one after another using udfs and accumulators results in faulty accumulators

[ https://issues.apache.org/jira/browse/SPARK-22541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256441#comment-16256441 ] Liang-Chi Hsieh commented on SPARK-22541: - Due to query optimization, two filters are combined

[jira] [Assigned] (SPARK-22538) SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

[ https://issues.apache.org/jira/browse/SPARK-22538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22538: Assignee: Apache Spark > SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

[jira] [Commented] (SPARK-22538) SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

[ https://issues.apache.org/jira/browse/SPARK-22538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256468#comment-16256468 ] Apache Spark commented on SPARK-22538: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22538) SQLTransformer.transform(inputDataFrame) uncaches inputDataFrame

[ https://issues.apache.org/jira/browse/SPARK-22538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22538: Assignee: (was: Apache Spark) > SQLTransformer.transform(inputDataFrame) uncaches

[jira] [Comment Edited] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255070#comment-16255070 ] Maciej Bryński edited comment on SPARK-16996 at 11/16/17 11:04 AM: ---

[jira] [Commented] (SPARK-12297) Add work-around for Parquet/Hive int96 timestamp bug.

[ https://issues.apache.org/jira/browse/SPARK-12297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255972#comment-16255972 ] Apache Spark commented on SPARK-12297: -- User 'squito' has created a pull request for this issue:

[jira] [Commented] (SPARK-21571) Spark history server leaves incomplete or unreadable history files around forever.

[ https://issues.apache.org/jira/browse/SPARK-21571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256000#comment-16256000 ] Apache Spark commented on SPARK-21571: -- User 'ericvandenbergfb' has created a pull request for this

[jira] [Created] (SPARK-22540) HighlyCompressedMapStatus's avgSize is incorrect

yucai created SPARK-22540: - Summary: HighlyCompressedMapStatus's avgSize is incorrect Key: SPARK-22540 URL: https://issues.apache.org/jira/browse/SPARK-22540 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-22274) Used-defined aggregation functions with pandas udf

[ https://issues.apache.org/jira/browse/SPARK-22274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254944#comment-16254944 ] holdenk commented on SPARK-22274: - Is anyone working on this currently? > Used-defined aggregation

[jira] [Assigned] (SPARK-22540) HighlyCompressedMapStatus's avgSize is incorrect

[ https://issues.apache.org/jira/browse/SPARK-22540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22540: Assignee: Apache Spark > HighlyCompressedMapStatus's avgSize is incorrect >

[jira] [Commented] (SPARK-22540) HighlyCompressedMapStatus's avgSize is incorrect

[ https://issues.apache.org/jira/browse/SPARK-22540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254929#comment-16254929 ] Apache Spark commented on SPARK-22540: -- User 'yucai' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22540) HighlyCompressedMapStatus's avgSize is incorrect

[ https://issues.apache.org/jira/browse/SPARK-22540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22540: Assignee: (was: Apache Spark) > HighlyCompressedMapStatus's avgSize is incorrect >

[jira] [Updated] (SPARK-22540) HighlyCompressedMapStatus's avgSize is incorrect

[ https://issues.apache.org/jira/browse/SPARK-22540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-22540: -- Description: The calculation of HighlyCompressedMapStatus's avgSize is incorrect. Currently, it looks like

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255070#comment-16255070 ] Maciej Bryński commented on SPARK-16996: Update: At the end I was able to read from ACID table.

[jira] [Created] (SPARK-22541) Dataframes: applying multiple filters one after another using udfs and accumulators results in faulty accumulators

Janne K. Olesen created SPARK-22541: --- Summary: Dataframes: applying multiple filters one after another using udfs and accumulators results in faulty accumulators Key: SPARK-22541 URL:

[jira] [Comment Edited] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255070#comment-16255070 ] Maciej Bryński edited comment on SPARK-16996 at 11/16/17 10:38 AM: ---

[jira] [Commented] (SPARK-22267) Spark SQL incorrectly reads ORC file when column order is different

[ https://issues.apache.org/jira/browse/SPARK-22267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255112#comment-16255112 ] Mark Petruska commented on SPARK-22267: --- Hi [~dongjoon], I can confirm that reading from an ORC

[jira] [Created] (SPARK-22545) spark dirve is not exit and no executor exists due to executor failing

liuxiaobin created SPARK-22545: -- Summary: spark dirve is not exit and no executor exists due to executor failing Key: SPARK-22545 URL: https://issues.apache.org/jira/browse/SPARK-22545 Project:

[jira] [Updated] (SPARK-22545) spark dirve is not exit and no executor exists due to executor failing

[ https://issues.apache.org/jira/browse/SPARK-22545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liuxiaobin updated SPARK-22545: --- Flags: Patch,Important (was: Important) > spark dirve is not exit and no executor exists due to

[jira] [Resolved] (SPARK-22545) spark dirve is not exit and no executor exists due to executor failing

[ https://issues.apache.org/jira/browse/SPARK-22545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22545. --- Resolution: Invalid > spark dirve is not exit and no executor exists due to executor failing >

[jira] [Commented] (SPARK-22545) spark dirve is not exit and no executor exists due to executor failing

[ https://issues.apache.org/jira/browse/SPARK-22545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256392#comment-16256392 ] liuxiaobin commented on SPARK-22545: how to resole this problem ? [~srowen] > spark dirve is not

[jira] [Resolved] (SPARK-22542) remove unused features in ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-22542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22542. - Resolution: Fixed Fix Version/s: 2.3.0 > remove unused features in ColumnarBatch >

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22499: - Target Version/s: 2.3.0, 2.2.2 > 64KB JVM bytecode limit problem with least and greatest >

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Affects Version/s: (was: 2.2.2) > PySpark doc has misleading string for SparkSession.builder

[jira] [Updated] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22490: - Target Version/s: 2.3.0, 2.2.2 Fix Version/s: (was: 2.2.1) 2.2.2

[jira] [Updated] (SPARK-22535) PythonRunner.MonitorThread should give the task a little time to finish before killing the python worker

[ https://issues.apache.org/jira/browse/SPARK-22535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22535: - Target Version/s: 2.2.2 > PythonRunner.MonitorThread should give the task a little time to

[jira] [Updated] (SPARK-22469) Accuracy problem in comparison with string and numeric

[ https://issues.apache.org/jira/browse/SPARK-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22469: - Target Version/s: 2.3.0, 2.2.2 (was: 2.2.2) > Accuracy problem in comparison with string and

[jira] [Updated] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22494: - Target Version/s: 2.2.2 > Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit

[jira] [Updated] (SPARK-22479) SaveIntoDataSourceCommand logs jdbc credentials

[ https://issues.apache.org/jira/browse/SPARK-22479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22479: - Target Version/s: 2.3.0, 2.2.2 > SaveIntoDataSourceCommand logs jdbc credentials >

[jira] [Commented] (SPARK-20295) when spark.sql.adaptive.enabled is enabled, have conflict with Exchange Resue

[ https://issues.apache.org/jira/browse/SPARK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256546#comment-16256546 ] Liang-Chi Hsieh commented on SPARK-20295: - Is this bug also in 2.2? When adaptive execution is

[jira] [Commented] (SPARK-20295) when spark.sql.adaptive.enabled is enabled, have conflict with Exchange Resue

[ https://issues.apache.org/jira/browse/SPARK-20295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16256570#comment-16256570 ] Liang-Chi Hsieh commented on SPARK-20295: - Btw, from the partial query plan you posted, looks

[jira] [Updated] (SPARK-22511) Update maven central repo address

[ https://issues.apache.org/jira/browse/SPARK-22511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22511: - Target Version/s: 2.3.0, 2.2.2 > Update maven central repo address >

[jira] [Updated] (SPARK-22377) Maven nightly snapshot jenkins jobs are broken on multiple workers due to lsof

[ https://issues.apache.org/jira/browse/SPARK-22377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-22377: - Target Version/s: 2.2.2 Fix Version/s: (was: 2.2.1) > Maven nightly snapshot jenkins

[jira] [Commented] (SPARK-19076) Upgrade Hive dependence to Hive 2.x

[ https://issues.apache.org/jira/browse/SPARK-19076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16255002#comment-16255002 ] Maciej Bryński commented on SPARK-19076: Why we mark this as Resolved ? > Upgrade Hive

[jira] [Commented] (SPARK-16996) Hive ACID delta files not seen

[ https://issues.apache.org/jira/browse/SPARK-16996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16254997#comment-16254997 ] Maciej Bryński commented on SPARK-16996: I changed hive libraries to version provided by