Re: HiveContext created SchemaRDD's saveAsTable is not working on 1.2.0

[matroyd]

It works now using 1.2.1. Thanks for all the help. Spark rocks !!



-
Thanks,
Roy
--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Re-HiveContext-created-SchemaRDD-s-saveAsTable-is-not-working-on-1-2-0-tp21442p21664.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: HiveContext created SchemaRDD's saveAsTable is not working on 1.2.0

[Cheng Lian]

Yeah, currently there isn't such a repo. However, the Spark team is 
working on this.


Cheng

On 1/30/15 8:19 AM, Ayoub wrote:

I am not personally aware of a repo for snapshot builds.
In my use case, I had to build spark 1.2.1-snapshot

see https://spark.apache.org/docs/latest/building-spark.html

2015-01-30 17:11 GMT+01:00 Debajyoti Roy <[hidden email] 
>:


Thanks Ayoub and Zhan,
I am new to spark and wanted to make sure i am not trying
something stupid or using a wrong API.

Is there a repo where i can pull the snapshot or nighly builds for
spark ?



On Fri, Jan 30, 2015 at 2:45 AM, Ayoub Benali <[hidden email]
> wrote:

Hello,

I had the same issue then I found this JIRA ticket
https://issues.apache.org/jira/browse/SPARK-4825
So I switched to Spark 1.2.1-snapshot witch solved the problem.



2015-01-30 8:40 GMT+01:00 Zhan Zhang <[hidden email]
>:

I think it is expected. Refer to the comments in
saveAsTable "Note that this currently only works with
SchemaRDDs that are created from a HiveContext”. If I
understand correctly, here the SchemaRDD means those
generated by HiveContext.sql, instead of applySchema.

Thanks.

Zhan Zhang



On Jan 29, 2015, at 9:38 PM, matroyd <[hidden email]
> wrote:


Hi, I am trying saveAsTable on SchemaRDD created from
HiveContext and it fails. This is on Spark 1.2.0.
Following are details of the code, command and
exceptions:

http://stackoverflow.com/questions/28222496/how-to-enable-sql-on-schemardd-via-the-jdbc-interface-is-it-even-possible

<http://cp.mcafee.com/d/5fHCMUe6zqb2qrVEVso73ztPqdT7HLIcII6QrK6zBxNB55cSztNWXX3bbVJ6XxEVvjKOMedywEjS1454WNDm1yIiJendAWNDm1yIiJendS76zB4xpx_HYO-OMe7tuVtdBBzD1NEVKCqeumKzp55l55zBgY-F6lK1FJ4SOrLOtXTLuZXTdTdw0WjSNmFDUKDRcsLwITZ9OH2C9L9FFI6zBP2tj1uti_MQwvVuwIunH0LiNfRtywwncOQLcDVshg8mbOxfUKXrOYG5Vjb-p-1tqJai87-rrFYiYvCT61tdZxZYKa2xfo4jytoPH0Nm9mDbwGySNaZGSS9_M04SOevpdxuhDNaI9-7Pd45E_I_gd40NoDWKwIe3zhfgQgkQPUxg4WgfYQgiEq88lCq835oBpg8Cy2I3h0zOvndK3zsm65OVJP>
Thanks in advance for any guidance


View this message in context: HiveContext created
SchemaRDD's saveAsTable is not working on 1.2.0

<http://cp.mcafee.com/d/FZsScxNJ5xddYQsKc3xNKVJ6XzRTS6mm3qdT3hOMUOyyCrhKUZtZxBBYSztMQsLFTpo76Ngk9X0y2ytoPH0Nm9mDbCOtoPH0Nm9mDbCX3zhOygIM_R-pvpo73KLsKCOONPwUQsTjd7fbnhIyyGyyNOEuvkzaT0QSCrpdTVeZXTLuZXCXCM0uHroDVuySNaBSWv4KvaA-hLt5ZO_gpW6A21_YLwnApYiH2vxYOZE_I_gbz5yvGW2MUebQbQQPUxg4WgfYLaxu5pBP5oBpg8BWMbEBQOZOYRAQm6me1NJKDNbN-rso5QTS7TOUEa4Zwhe9RzeI35oBqsK2Gbr4HSHroD_00jr8VZAS5V6v4GMDUvcQgmz-PZ0Qg35yvGW2MUed4Z3h1jjfy50jF0_Ph1axEwxmpEwclylB0yq8aMd42f9ZsSUedGaVp>
Sent from the Apache Spark User List mailing list archive

<http://cp.mcafee.com/d/k-Kr43qb2qrVEVso73ztPqdT7HLIcII6QrK6zBxNB55cSztNWXX3bbVJ6XxEVvjKOMedywEjS1454WNDm1yIiJendAWNDm1yIiJendS76zB4xpx_HYO-OMe7tuVtdBBzD1NEVKCqeumKzp55l55zBgY-F6lK1FJASOrLOtXTLuZXTdTdw0ZmSNfOZ5JylbJQ-9s-l9YzuWbXB-wPQd843_Vv3rtfynzYSUMbFLIfLBNgk9X0ysjH6to6aNaQVs5kmS9nJmSNf-00CShPX9IbOc-9lxfM-pEwJ7ZDW1Ew6b4_lQ5xMsq9W6y2CCv4a0Di1_Cy2l3h12IPh0oH4Ha14Qglwq84ujWVJMsrlDSD>
at Nabble.com <http://Nabble.com>.






-- 
Thanks,


*Debajyoti Roy*
[hidden email] 
(646)561-0844
350 Madison Ave., FL 16,
New York, NY 10017.



------------
View this message in context: Re: HiveContext created SchemaRDD's 
saveAsTable is not working on 1.2.0 
<http://apache-spark-user-list.1001560.n3.nabble.com/Re-HiveContext-created-SchemaRDD-s-saveAsTable-is-not-working-on-1-2-0-tp21442.html>
Sent from the Apache Spark User List mailing list archive 
<http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.

Re: HiveContext created SchemaRDD's saveAsTable is not working on 1.2.0

[Ayoub]

I am not personally aware of a repo for snapshot builds.
In my use case, I had to build spark 1.2.1-snapshot

see https://spark.apache.org/docs/latest/building-spark.html

2015-01-30 17:11 GMT+01:00 Debajyoti Roy :

> Thanks Ayoub and Zhan,
> I am new to spark and wanted to make sure i am not trying something stupid
> or using a wrong API.
>
> Is there a repo where i can pull the snapshot or nighly builds for spark ?
>
>
>
> On Fri, Jan 30, 2015 at 2:45 AM, Ayoub Benali  > wrote:
>
>> Hello,
>>
>> I had the same issue then I found this JIRA ticket
>> https://issues.apache.org/jira/browse/SPARK-4825
>> So I switched to Spark 1.2.1-snapshot witch solved the problem.
>>
>>
>>
>> 2015-01-30 8:40 GMT+01:00 Zhan Zhang :
>>
>>>  I think it is expected. Refer to the comments in saveAsTable "Note that
>>> this currently only works with SchemaRDDs that are created from a
>>> HiveContext". If I understand correctly, here the SchemaRDD means those
>>> generated by HiveContext.sql, instead of applySchema.
>>>
>>>  Thanks.
>>>
>>>  Zhan Zhang
>>>
>>>
>>>
>>>  On Jan 29, 2015, at 9:38 PM, matroyd 
>>> wrote:
>>>
>>> Hi, I am trying saveAsTable on SchemaRDD created from HiveContext and it
>>> fails. This is on Spark 1.2.0. Following are details of the code, command
>>> and exceptions:
>>> http://stackoverflow.com/questions/28222496/how-to-enable-sql-on-schemardd-via-the-jdbc-interface-is-it-even-possible
>>> 
>>> Thanks in advance for any guidance
>>> --
>>> View this message in context: HiveContext created SchemaRDD's
>>> saveAsTable is not working on 1.2.0
>>> 
>>> Sent from the Apache Spark User List mailing list archive
>>> 
>>> at Nabble.com.
>>>
>>>
>>>
>>
>
>
> --
> Thanks,
>
> *Debajyoti Roy*
> debajyoti@healthagen.com
> (646)561-0844 <646-561-0844>
> 350 Madison Ave., FL 16,
> New York, NY 10017.
>




--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Re-HiveContext-created-SchemaRDD-s-saveAsTable-is-not-working-on-1-2-0-tp21442.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: HiveContext created SchemaRDD's saveAsTable is not working on 1.2.0

[Zhan Zhang]

I think it is expected. Refer to the comments in saveAsTable "Note that this 
currently only works with SchemaRDDs that are created from a HiveContext”. If I 
understand correctly, here the SchemaRDD means those generated by 
HiveContext.sql, instead of applySchema.

Thanks.

Zhan Zhang


On Jan 29, 2015, at 9:38 PM, matroyd 
mailto:debajyoti@healthagen.com>> wrote:

Hi, I am trying saveAsTable on SchemaRDD created from HiveContext and it fails. 
This is on Spark 1.2.0. Following are details of the code, command and 
exceptions: 
http://stackoverflow.com/questions/28222496/how-to-enable-sql-on-schemardd-via-the-jdbc-interface-is-it-even-possible
 Thanks in advance for any guidance

View this message in context: HiveContext created SchemaRDD's saveAsTable is 
not working on 
1.2.0
Sent from the Apache Spark User List mailing list 
archive
 at Nabble.com.