[
https://issues.apache.org/jira/browse/SPARK-10577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14742036#comment-14742036
]
Maciej Bryński edited comment on SPARK-10577 at 9/12/15 12:29 PM:
------------------------------------------------------------------
[~rxin]
I can find broadcast in functions.scala.
Is it possible to use it in SQL ?
select * from t1 join broadcast(t2) on t1.k1 = t2.k2 doesn't work.
{code}
Py4JJavaError: An error occurred while calling o31.sql.
: org.apache.spark.sql.AnalysisException: missing EOF at '(' near 'broadcast';
line 1 pos 41
at org.apache.spark.sql.hive.HiveQl$.createPlan(HiveQl.scala:296)
at
org.apache.spark.sql.hive.ExtendedHiveQlParser$$anonfun$hiveQl$1.apply(ExtendedHiveQlParser.scala:41)
at
org.apache.spark.sql.hive.ExtendedHiveQlParser$$anonfun$hiveQl$1.apply(ExtendedHiveQlParser.scala:40)
at scala.util.parsing.combinator.Parsers$Success.map(Parsers.scala:136)
at scala.util.parsing.combinator.Parsers$Success.map(Parsers.scala:135)
{code}
was (Author: maver1ck):
[~rxin]
I can find broadcast in functions.scala.
Is it possible to use it in SQL ?
select * from t1 join broadcast(t2) on t1.k1 = t2.k2 doesn't work.
> [PySpark, SQL] DataFrame hint for broadcast join
> ------------------------------------------------
>
> Key: SPARK-10577
> URL: https://issues.apache.org/jira/browse/SPARK-10577
> Project: Spark
> Issue Type: Improvement
> Components: PySpark, SQL
> Affects Versions: 1.5.0
> Reporter: Maciej Bryński
>
> As in https://issues.apache.org/jira/browse/SPARK-8300
> there should by possibility to add hint for broadcast join in:
> - Spark SQL
> - Pyspark
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
