[
https://issues.apache.org/jira/browse/TOREE-359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Evan Oman updated TOREE-359:
----------------------------
Description:
*This only affects 0.2.0.dev1, 0.1.0 works just fine*
After running `a %AddDeps` I get the following error when trying to make a
`DataFrame`:
.
{code}
Name: Compile Error
Message: error: error while loading package, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/execution/package.class)'
has location not matching its contents: contains package object execution
error: error while loading QueryExecution, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/execution/QueryExecution.class)'
has location not matching its contents: contains class QueryExecution
error: error while loading package, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/plans/package.class)'
has location not matching its contents: contains package object plans
error: error while loading LogicalPlan, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.class)'
has location not matching its contents: contains class LogicalPlan
error: error while loading package, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/encoders/package.class)'
has location not matching its contents: contains package object encoders
error: error while loading ExpressionEncoder, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/encoders/ExpressionEncoder.class)'
has location not matching its contents: contains class ExpressionEncoder
error: error while loading NamedExpression, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/expressions/NamedExpression.class)'
has location not matching its contents: contains class NamedExpression
error: error while loading Expression, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/expressions/Expression.class)'
has location not matching its contents: contains class Expression
error: error while loading DataFrameNaFunctions, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/DataFrameNaFunctions.class)'
has location not matching its contents: contains class DataFrameNaFunctions
error: error while loading DataFrameStatFunctions, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/DataFrameStatFunctions.class)'
has location not matching its contents: contains class DataFrameStatFunctions
error: error while loading Column, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/Column.class)'
has location not matching its contents: contains class Column
error: error while loading TypedColumn, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/TypedColumn.class)'
has location not matching its contents: contains class TypedColumn
error: error while loading RelationalGroupedDataset, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/RelationalGroupedDataset.class)'
has location not matching its contents: contains class RelationalGroupedDataset
error: error while loading package, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/package.class)'
has location not matching its contents: contains package object function
error: error while loading ReduceFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/ReduceFunction.class)'
has location not matching its contents: contains class ReduceFunction
error: error while loading KeyValueGroupedDataset, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/KeyValueGroupedDataset.class)'
has location not matching its contents: contains class KeyValueGroupedDataset
error: error while loading MapFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/MapFunction.class)'
has location not matching its contents: contains class MapFunction
error: error while loading Metadata, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/types/Metadata.class)'
has location not matching its contents: contains class Metadata
error: error while loading FilterFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/FilterFunction.class)'
has location not matching its contents: contains class FilterFunction
error: error while loading MapPartitionsFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/MapPartitionsFunction.class)'
has location not matching its contents: contains class MapPartitionsFunction
error: error while loading FlatMapFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/FlatMapFunction.class)'
has location not matching its contents: contains class FlatMapFunction
error: error while loading ForeachFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/ForeachFunction.class)'
has location not matching its contents: contains class ForeachFunction
error: error while loading ForeachPartitionFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/ForeachPartitionFunction.class)'
has location not matching its contents: contains class ForeachPartitionFunction
error: error while loading StorageLevel, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/storage/StorageLevel.class)'
has location not matching its contents: contains class StorageLevel
error: error while loading DataFrameWriter, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/DataFrameWriter.class)'
has location not matching its contents: contains class DataFrameWriter
error: error while loading DataStreamWriter, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/streaming/DataStreamWriter.class)'
has location not matching its contents: contains class DataStreamWriter
error: error while loading Partition, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/Partition.class)'
has location not matching its contents: contains class Partition
error: error while loading Partitioner, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/Partitioner.class)'
has location not matching its contents: contains class Partitioner
error: error while loading Since, class file
'/usr/local/spark/jars/spark-tags_2.11-2.0.1.jar(org/apache/spark/annotation/Since.class)'
has location not matching its contents: contains class Since
error: error while loading PartitionCoalescer, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/rdd/PartitionCoalescer.class)'
has location not matching its contents: contains class PartitionCoalescer
error: error while loading BoundedDouble, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/partial/BoundedDouble.class)'
has location not matching its contents: contains class BoundedDouble
error: error while loading CompressionCodec, class file
'/usr/local/spark/jars/hadoop-common-2.7.3.jar(org/apache/hadoop/io/compress/CompressionCodec.class)'
has location not matching its contents: contains class CompressionCodec
error: error while loading RDDOperationScope, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/rdd/RDDOperationScope.class)'
has location not matching its contents: contains class RDDOperationScope
StackTrace: :
{code}
Also see the screenshots for an example of how adding `AddDeps` causes the
compile error.
was:
After running `a %AddDeps` I get the following error when trying to make a
`DataFrame`:
.
{code}
Name: Compile Error
Message: error: error while loading package, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/execution/package.class)'
has location not matching its contents: contains package object execution
error: error while loading QueryExecution, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/execution/QueryExecution.class)'
has location not matching its contents: contains class QueryExecution
error: error while loading package, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/plans/package.class)'
has location not matching its contents: contains package object plans
error: error while loading LogicalPlan, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.class)'
has location not matching its contents: contains class LogicalPlan
error: error while loading package, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/encoders/package.class)'
has location not matching its contents: contains package object encoders
error: error while loading ExpressionEncoder, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/encoders/ExpressionEncoder.class)'
has location not matching its contents: contains class ExpressionEncoder
error: error while loading NamedExpression, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/expressions/NamedExpression.class)'
has location not matching its contents: contains class NamedExpression
error: error while loading Expression, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/expressions/Expression.class)'
has location not matching its contents: contains class Expression
error: error while loading DataFrameNaFunctions, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/DataFrameNaFunctions.class)'
has location not matching its contents: contains class DataFrameNaFunctions
error: error while loading DataFrameStatFunctions, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/DataFrameStatFunctions.class)'
has location not matching its contents: contains class DataFrameStatFunctions
error: error while loading Column, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/Column.class)'
has location not matching its contents: contains class Column
error: error while loading TypedColumn, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/TypedColumn.class)'
has location not matching its contents: contains class TypedColumn
error: error while loading RelationalGroupedDataset, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/RelationalGroupedDataset.class)'
has location not matching its contents: contains class RelationalGroupedDataset
error: error while loading package, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/package.class)'
has location not matching its contents: contains package object function
error: error while loading ReduceFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/ReduceFunction.class)'
has location not matching its contents: contains class ReduceFunction
error: error while loading KeyValueGroupedDataset, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/KeyValueGroupedDataset.class)'
has location not matching its contents: contains class KeyValueGroupedDataset
error: error while loading MapFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/MapFunction.class)'
has location not matching its contents: contains class MapFunction
error: error while loading Metadata, class file
'/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/types/Metadata.class)'
has location not matching its contents: contains class Metadata
error: error while loading FilterFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/FilterFunction.class)'
has location not matching its contents: contains class FilterFunction
error: error while loading MapPartitionsFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/MapPartitionsFunction.class)'
has location not matching its contents: contains class MapPartitionsFunction
error: error while loading FlatMapFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/FlatMapFunction.class)'
has location not matching its contents: contains class FlatMapFunction
error: error while loading ForeachFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/ForeachFunction.class)'
has location not matching its contents: contains class ForeachFunction
error: error while loading ForeachPartitionFunction, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/ForeachPartitionFunction.class)'
has location not matching its contents: contains class ForeachPartitionFunction
error: error while loading StorageLevel, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/storage/StorageLevel.class)'
has location not matching its contents: contains class StorageLevel
error: error while loading DataFrameWriter, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/DataFrameWriter.class)'
has location not matching its contents: contains class DataFrameWriter
error: error while loading DataStreamWriter, class file
'/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/streaming/DataStreamWriter.class)'
has location not matching its contents: contains class DataStreamWriter
error: error while loading Partition, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/Partition.class)'
has location not matching its contents: contains class Partition
error: error while loading Partitioner, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/Partitioner.class)'
has location not matching its contents: contains class Partitioner
error: error while loading Since, class file
'/usr/local/spark/jars/spark-tags_2.11-2.0.1.jar(org/apache/spark/annotation/Since.class)'
has location not matching its contents: contains class Since
error: error while loading PartitionCoalescer, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/rdd/PartitionCoalescer.class)'
has location not matching its contents: contains class PartitionCoalescer
error: error while loading BoundedDouble, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/partial/BoundedDouble.class)'
has location not matching its contents: contains class BoundedDouble
error: error while loading CompressionCodec, class file
'/usr/local/spark/jars/hadoop-common-2.7.3.jar(org/apache/hadoop/io/compress/CompressionCodec.class)'
has location not matching its contents: contains class CompressionCodec
error: error while loading RDDOperationScope, class file
'/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/rdd/RDDOperationScope.class)'
has location not matching its contents: contains class RDDOperationScope
StackTrace: :
{code}
Also see the screenshots for an example of how adding `AddDeps` causes the
compile error.
> Compile Error after `%AddDeps`
> -------------------------------
>
> Key: TOREE-359
> URL: https://issues.apache.org/jira/browse/TOREE-359
> Project: TOREE
> Issue Type: Bug
> Affects Versions: 0.1.0
> Environment: openSUSE 42, building 0.2.0.dev1 with `make pip-release`
> Reporter: Evan Oman
> Attachments: not_working_with_AddDeps.PNG, working_without_AddDeps.PNG
>
>
> *This only affects 0.2.0.dev1, 0.1.0 works just fine*
> After running `a %AddDeps` I get the following error when trying to make a
> `DataFrame`:
> .
> {code}
> Name: Compile Error
> Message: error: error while loading package, class file
> '/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/execution/package.class)'
> has location not matching its contents: contains package object execution
> error: error while loading QueryExecution, class file
> '/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/execution/QueryExecution.class)'
> has location not matching its contents: contains class QueryExecution
> error: error while loading package, class file
> '/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/plans/package.class)'
> has location not matching its contents: contains package object plans
> error: error while loading LogicalPlan, class file
> '/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/plans/logical/LogicalPlan.class)'
> has location not matching its contents: contains class LogicalPlan
> error: error while loading package, class file
> '/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/encoders/package.class)'
> has location not matching its contents: contains package object encoders
> error: error while loading ExpressionEncoder, class file
> '/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/encoders/ExpressionEncoder.class)'
> has location not matching its contents: contains class ExpressionEncoder
> error: error while loading NamedExpression, class file
> '/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/expressions/NamedExpression.class)'
> has location not matching its contents: contains class NamedExpression
> error: error while loading Expression, class file
> '/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/catalyst/expressions/Expression.class)'
> has location not matching its contents: contains class Expression
> error: error while loading DataFrameNaFunctions, class file
> '/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/DataFrameNaFunctions.class)'
> has location not matching its contents: contains class DataFrameNaFunctions
> error: error while loading DataFrameStatFunctions, class file
> '/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/DataFrameStatFunctions.class)'
> has location not matching its contents: contains class DataFrameStatFunctions
> error: error while loading Column, class file
> '/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/Column.class)'
> has location not matching its contents: contains class Column
> error: error while loading TypedColumn, class file
> '/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/TypedColumn.class)'
> has location not matching its contents: contains class TypedColumn
> error: error while loading RelationalGroupedDataset, class file
> '/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/RelationalGroupedDataset.class)'
> has location not matching its contents: contains class
> RelationalGroupedDataset
> error: error while loading package, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/package.class)'
> has location not matching its contents: contains package object function
> error: error while loading ReduceFunction, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/ReduceFunction.class)'
> has location not matching its contents: contains class ReduceFunction
> error: error while loading KeyValueGroupedDataset, class file
> '/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/KeyValueGroupedDataset.class)'
> has location not matching its contents: contains class KeyValueGroupedDataset
> error: error while loading MapFunction, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/MapFunction.class)'
> has location not matching its contents: contains class MapFunction
> error: error while loading Metadata, class file
> '/usr/local/spark/jars/spark-catalyst_2.11-2.0.1.jar(org/apache/spark/sql/types/Metadata.class)'
> has location not matching its contents: contains class Metadata
> error: error while loading FilterFunction, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/FilterFunction.class)'
> has location not matching its contents: contains class FilterFunction
> error: error while loading MapPartitionsFunction, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/MapPartitionsFunction.class)'
> has location not matching its contents: contains class MapPartitionsFunction
> error: error while loading FlatMapFunction, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/FlatMapFunction.class)'
> has location not matching its contents: contains class FlatMapFunction
> error: error while loading ForeachFunction, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/ForeachFunction.class)'
> has location not matching its contents: contains class ForeachFunction
> error: error while loading ForeachPartitionFunction, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/api/java/function/ForeachPartitionFunction.class)'
> has location not matching its contents: contains class
> ForeachPartitionFunction
> error: error while loading StorageLevel, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/storage/StorageLevel.class)'
> has location not matching its contents: contains class StorageLevel
> error: error while loading DataFrameWriter, class file
> '/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/DataFrameWriter.class)'
> has location not matching its contents: contains class DataFrameWriter
> error: error while loading DataStreamWriter, class file
> '/usr/local/spark/jars/spark-sql_2.11-2.0.1.jar(org/apache/spark/sql/streaming/DataStreamWriter.class)'
> has location not matching its contents: contains class DataStreamWriter
> error: error while loading Partition, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/Partition.class)'
> has location not matching its contents: contains class Partition
> error: error while loading Partitioner, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/Partitioner.class)'
> has location not matching its contents: contains class Partitioner
> error: error while loading Since, class file
> '/usr/local/spark/jars/spark-tags_2.11-2.0.1.jar(org/apache/spark/annotation/Since.class)'
> has location not matching its contents: contains class Since
> error: error while loading PartitionCoalescer, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/rdd/PartitionCoalescer.class)'
> has location not matching its contents: contains class PartitionCoalescer
> error: error while loading BoundedDouble, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/partial/BoundedDouble.class)'
> has location not matching its contents: contains class BoundedDouble
> error: error while loading CompressionCodec, class file
> '/usr/local/spark/jars/hadoop-common-2.7.3.jar(org/apache/hadoop/io/compress/CompressionCodec.class)'
> has location not matching its contents: contains class CompressionCodec
> error: error while loading RDDOperationScope, class file
> '/usr/local/spark/jars/spark-core_2.11-2.0.1.jar(org/apache/spark/rdd/RDDOperationScope.class)'
> has location not matching its contents: contains class RDDOperationScope
> StackTrace: :
> {code}
> Also see the screenshots for an example of how adding `AddDeps` causes the
> compile error.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
