GitHub user gatorsmile opened a pull request:
https://github.com/apache/spark/pull/12134
[SPARK-14349] [SQL] [WIP] Issue Error Messages for Unsupported
Operators/DML/DDL in SQL Context.
#### What changes were proposed in this pull request?
Currently, the weird error messages are issued if we use Hive Context-only
operations in SQL Context.
For example,
- When calling `Drop Table` in SQL Context, we got the following message:
```
Expected exception org.apache.spark.sql.catalyst.parser.ParseException to
be thrown, but java.lang.ClassCastException was thrown.
```
- When calling `Script Transform` in SQL Context, we got the message:
```
assertion failed: No plan for ScriptTransformation [key#9,value#10], cat,
[tKey#155,tValue#156], null
+- LogicalRDD [key#9,value#10], MapPartitionsRDD[3] at beforeAll at
BeforeAndAfterAll.scala:187
```
#### How was this patch tested?
Two test cases are added.
Not sure if the same issue exist for the other operators/DDL/DML.
@hvanhovell
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/gatorsmile/spark hiveParserCommand
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12134.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12134
----
commit e09ac7c7981ff8ee405978b019abca1a6a0168cb
Author: gatorsmile <[email protected]>
Date: 2016-04-02T23:51:07Z
unsupported operations in SQL Context.
commit 62c814d630b2a1e3aa004942f178628a83a40919
Author: gatorsmile <[email protected]>
Date: 2016-04-03T00:10:45Z
style fix.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
