Re: Spark SQL . How to enlarge output rows ?

2016-01-27 Thread bo yang 
Hi Eli, are you using Python? I see there is a method show(numRows) in
Java, but not sure about Python.

On Wed, Jan 27, 2016 at 2:39 AM, Akhil Das <ak...@sigmoidanalytics.com>
wrote:

> Why would you want to print all rows? You can try the following:
>
> sqlContext.sql("select day_time from my_table limit
> 10").collect().foreach(println)
>
>
>
> Thanks
> Best Regards
>
> On Sun, Jan 24, 2016 at 5:58 PM, Eli Super <eli.su...@gmail.com> wrote:
>
>> Unfortunately still getting error when use .show() with `false` or
>> `False` or `FALSE`
>>
>> Py4JError: An error occurred while calling o153.showString. Trace:
>> py4j.Py4JException: Method showString([class java.lang.String, class 
>> java.lang.Boolean]) does not exist
>>  at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:333)
>>  at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:342)
>>  at py4j.Gateway.invoke(Gateway.java:252)
>>  at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133)
>>  at py4j.commands.CallCommand.execute(CallCommand.java:79)
>>  at py4j.GatewayConnection.run(GatewayConnection.java:207)
>>  at java.lang.Thread.run(Thread.java:745)
>>
>>
>> On Thu, Jan 21, 2016 at 4:54 PM, Spencer, Alex (Santander) <
>> alex.spen...@santander.co.uk> wrote:
>>
>>> I forgot to add this is (I think) from 1.5.0.
>>>
>>>
>>>
>>> And yeah that looks like a Python – I’m not hot with Python but it may
>>> be capitalised as False or FALSE?
>>>
>>>
>>>
>>>
>>>
>>> *From:* Eli Super [mailto:eli.su...@gmail.com]
>>> *Sent:* 21 January 2016 14:48
>>> *To:* Spencer, Alex (Santander)
>>> *Cc:* user@spark.apache.org
>>> *Subject:* Re: Spark SQL . How to enlarge output rows ?
>>>
>>>
>>>
>>> Thanks Alex
>>>
>>>
>>>
>>> I get NameError
>>>
>>> NameError: name 'false' is not defined
>>>
>>> Is it because of PySpark ?
>>>
>>>
>>>
>>>
>>>
>>> On Thu, Jan 14, 2016 at 3:34 PM, Spencer, Alex (Santander) <
>>> alex.spen...@santander.co.uk> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> Try …..show(*false*)
>>>
>>>
>>>
>>> public void show(int numRows,
>>>
>>> boolean truncate)
>>>
>>>
>>>
>>>
>>>
>>> Kind Regards,
>>>
>>> Alex.
>>>
>>>
>>>
>>> *From:* Eli Super [mailto:eli.su...@gmail.com]
>>> *Sent:* 14 January 2016 13:09
>>> *To:* user@spark.apache.org
>>> *Subject:* Spark SQL . How to enlarge output rows ?
>>>
>>>
>>>
>>>
>>>
>>> Hi
>>>
>>>
>>>
>>> After executing sql
>>>
>>>
>>>
>>> sqlContext.sql("select day_time from my_table limit 10").show()
>>>
>>>
>>>
>>> my output looks like  :
>>>
>>> ++
>>>
>>> |  day_time|
>>>
>>> ++
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:53:...|
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:51:...|
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:53:...|
>>>
>>> ++
>>>
>>>
>>>
>>> I'd like to get full rows
>>>
>>> Thanks !
>>>
>>> Emails aren't always secure, and they may be intercepted or changed after
>>> they've been sent. Santander doesn't accept liability if this happens.
>>> If you
>>> think someone may have interfered with this email, please get in touch
>>> with the
>>> sender another way. This message doesn't create or change any contract.
>>> Santander doesn't accept responsibility for damage caused by any viruses
>>> contained in this email or its attachments. Emails may be monitored. If
>>> you've
>>> received this email by mistake, please let the sender know at once that
>>> it's
>>> gone to the wrong person and then destroy it without c

Re: Spark SQL . How to enlarge output rows ?

2016-01-27 Thread Kevin Mellott 
I believe that *show* should work if you provide it with both the number of
rows and the truncate flag.

ex: df.show(10, false)

http://spark.apache.org/docs/1.5.0/api/python/pyspark.sql.html#pyspark.sql.DataFrame.show


On Wed, Jan 27, 2016 at 2:39 AM, Akhil Das <ak...@sigmoidanalytics.com>
wrote:

> Why would you want to print all rows? You can try the following:
>
> sqlContext.sql("select day_time from my_table limit
> 10").collect().foreach(println)
>
>
>
> Thanks
> Best Regards
>
> On Sun, Jan 24, 2016 at 5:58 PM, Eli Super <eli.su...@gmail.com> wrote:
>
>> Unfortunately still getting error when use .show() with `false` or
>> `False` or `FALSE`
>>
>> Py4JError: An error occurred while calling o153.showString. Trace:
>> py4j.Py4JException: Method showString([class java.lang.String, class 
>> java.lang.Boolean]) does not exist
>>  at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:333)
>>  at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:342)
>>  at py4j.Gateway.invoke(Gateway.java:252)
>>  at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133)
>>  at py4j.commands.CallCommand.execute(CallCommand.java:79)
>>  at py4j.GatewayConnection.run(GatewayConnection.java:207)
>>  at java.lang.Thread.run(Thread.java:745)
>>
>>
>> On Thu, Jan 21, 2016 at 4:54 PM, Spencer, Alex (Santander) <
>> alex.spen...@santander.co.uk> wrote:
>>
>>> I forgot to add this is (I think) from 1.5.0.
>>>
>>>
>>>
>>> And yeah that looks like a Python – I’m not hot with Python but it may
>>> be capitalised as False or FALSE?
>>>
>>>
>>>
>>>
>>>
>>> *From:* Eli Super [mailto:eli.su...@gmail.com]
>>> *Sent:* 21 January 2016 14:48
>>> *To:* Spencer, Alex (Santander)
>>> *Cc:* user@spark.apache.org
>>> *Subject:* Re: Spark SQL . How to enlarge output rows ?
>>>
>>>
>>>
>>> Thanks Alex
>>>
>>>
>>>
>>> I get NameError
>>>
>>> NameError: name 'false' is not defined
>>>
>>> Is it because of PySpark ?
>>>
>>>
>>>
>>>
>>>
>>> On Thu, Jan 14, 2016 at 3:34 PM, Spencer, Alex (Santander) <
>>> alex.spen...@santander.co.uk> wrote:
>>>
>>> Hi,
>>>
>>>
>>>
>>> Try …..show(*false*)
>>>
>>>
>>>
>>> public void show(int numRows,
>>>
>>> boolean truncate)
>>>
>>>
>>>
>>>
>>>
>>> Kind Regards,
>>>
>>> Alex.
>>>
>>>
>>>
>>> *From:* Eli Super [mailto:eli.su...@gmail.com]
>>> *Sent:* 14 January 2016 13:09
>>> *To:* user@spark.apache.org
>>> *Subject:* Spark SQL . How to enlarge output rows ?
>>>
>>>
>>>
>>>
>>>
>>> Hi
>>>
>>>
>>>
>>> After executing sql
>>>
>>>
>>>
>>> sqlContext.sql("select day_time from my_table limit 10").show()
>>>
>>>
>>>
>>> my output looks like  :
>>>
>>> ++
>>>
>>> |  day_time|
>>>
>>> ++
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:53:...|
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:51:...|
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:52:...|
>>>
>>> |2015/12/15 15:53:...|
>>>
>>> ++
>>>
>>>
>>>
>>> I'd like to get full rows
>>>
>>> Thanks !
>>>
>>> Emails aren't always secure, and they may be intercepted or changed after
>>> they've been sent. Santander doesn't accept liability if this happens.
>>> If you
>>> think someone may have interfered with this email, please get in touch
>>> with the
>>> sender another way. This message doesn't create or change any contract.
>>> Santander doesn't accept responsibility for damage caused by any viruses
>>> contained in this email or its attachments. Emails may be monitored. If
>>> you've
>>> received this email by mistake, pleas

Re: Spark SQL . How to enlarge output rows ?

2016-01-27 Thread sm...@yahoo.com.INVALID 
Kevin’s solution works.  Just minor correction, Python boolean should be 
capitalized.  
That is
df.show(10, False)

> On Jan 27, 2016, at 12:34 PM, Kevin Mellott <kevin.r.mell...@gmail.com> wrote:
> 
> I believe that show should work if you provide it with both the number of 
> rows and the truncate flag.
> 
> ex: df.show(10, false)
> 
> http://spark.apache.org/docs/1.5.0/api/python/pyspark.sql.html#pyspark.sql.DataFrame.show
>  
> <http://spark.apache.org/docs/1.5.0/api/python/pyspark.sql.html#pyspark.sql.DataFrame.show>
>  
> 
> On Wed, Jan 27, 2016 at 2:39 AM, Akhil Das <ak...@sigmoidanalytics.com 
> <mailto:ak...@sigmoidanalytics.com>> wrote:
> Why would you want to print all rows? You can try the following:
> 
> sqlContext.sql("select day_time from my_table limit 
> 10").collect().foreach(println)
> 
> 
> Thanks
> Best Regards
> 
> On Sun, Jan 24, 2016 at 5:58 PM, Eli Super <eli.su...@gmail.com 
> <mailto:eli.su...@gmail.com>> wrote:
> Unfortunately still getting error when use .show() with `false` or `False` or 
> `FALSE` 
> 
> 
> Py4JError: An error occurred while calling o153.showString. Trace:
> py4j.Py4JException: Method showString([class java.lang.String, class 
> java.lang.Boolean]) does not exist
>   at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:333)
>   at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:342)
>   at py4j.Gateway.invoke(Gateway.java:252)
>   at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133)
>   at py4j.commands.CallCommand.execute(CallCommand.java:79)
>   at py4j.GatewayConnection.run(GatewayConnection.java:207)
>   at java.lang.Thread.run(Thread.java:745)
> 
> On Thu, Jan 21, 2016 at 4:54 PM, Spencer, Alex (Santander) 
> <alex.spen...@santander.co.uk <mailto:alex.spen...@santander.co.uk>> wrote:
> I forgot to add this is (I think) from 1.5.0.
> 
>  
> 
> And yeah that looks like a Python – I’m not hot with Python but it may be 
> capitalised as False or FALSE?
> 
>  
> 
>  
> 
> From: Eli Super [mailto:eli.su...@gmail.com <mailto:eli.su...@gmail.com>] 
> Sent: 21 January 2016 14:48
> To: Spencer, Alex (Santander)
> Cc: user@spark.apache.org <mailto:user@spark.apache.org>
> Subject: Re: Spark SQL . How to enlarge output rows ?
> 
>  
> 
> Thanks Alex
> 
>  
> 
> I get NameError
> 
> NameError: name 'false' is not defined
> Is it because of PySpark ?
>  
>  
> 
> On Thu, Jan 14, 2016 at 3:34 PM, Spencer, Alex (Santander) 
> <alex.spen...@santander.co.uk <mailto:alex.spen...@santander.co.uk>> wrote:
> 
> Hi,
> 
>  
> 
> Try …..show(false)
> 
>  
> 
> public void show(int numRows,
> 
> boolean truncate)
> 
>  
> 
>  
> 
> Kind Regards,
> 
> Alex.
> 
>  
> 
> From: Eli Super [mailto:eli.su...@gmail.com <mailto:eli.su...@gmail.com>] 
> Sent: 14 January 2016 13:09
> To: user@spark.apache.org <mailto:user@spark.apache.org>
> Subject: Spark SQL . How to enlarge output rows ?
> 
>  
> 
>  
> 
> Hi
> 
>  
> 
> After executing sql 
> 
>  
> 
> sqlContext.sql("select day_time from my_table limit 10").show()
> 
>  
> 
> my output looks like  :
> 
> ++
> |  day_time|
> ++
> |2015/12/15 15:52:...|
> |2015/12/15 15:53:...|
> |2015/12/15 15:52:...|
> |2015/12/15 15:52:...|
> |2015/12/15 15:52:...|
> |2015/12/15 15:52:...|
> |2015/12/15 15:51:...|
> |2015/12/15 15:52:...|
> |2015/12/15 15:52:...|
> |2015/12/15 15:53:...|
> ++
>  
> I'd like to get full rows 
> Thanks !
> Emails aren't always secure, and they may be intercepted or changed after
> they've been sent. Santander doesn't accept liability if this happens. If you
> think someone may have interfered with this email, please get in touch with 
> the
> sender another way. This message doesn't create or change any contract.
> Santander doesn't accept responsibility for damage caused by any viruses
> contained in this email or its attachments. Emails may be monitored. If you've
> received this email by mistake, please let the sender know at once that it's
> gone to the wrong person and then destroy it without copying, using, or 
> telling
> anyone about its contents.
> Santander UK plc Reg. No. 2294747 and Abbey National Treasury Services plc 
> Reg.
> No. 2338548 Registered Offices: 2 Triton Square, Regent's Place, London NW1 
> 3AN.
> Registered in England. www.santander.co.uk <http://www.santander.co.uk/>. 
&

Re: Spark SQL . How to enlarge output rows ?

2016-01-27 Thread Akhil Das 
Why would you want to print all rows? You can try the following:

sqlContext.sql("select day_time from my_table limit
10").collect().foreach(println)



Thanks
Best Regards

On Sun, Jan 24, 2016 at 5:58 PM, Eli Super <eli.su...@gmail.com> wrote:

> Unfortunately still getting error when use .show() with `false` or `False`
> or `FALSE`
>
> Py4JError: An error occurred while calling o153.showString. Trace:
> py4j.Py4JException: Method showString([class java.lang.String, class 
> java.lang.Boolean]) does not exist
>   at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:333)
>   at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:342)
>   at py4j.Gateway.invoke(Gateway.java:252)
>   at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133)
>   at py4j.commands.CallCommand.execute(CallCommand.java:79)
>   at py4j.GatewayConnection.run(GatewayConnection.java:207)
>   at java.lang.Thread.run(Thread.java:745)
>
>
> On Thu, Jan 21, 2016 at 4:54 PM, Spencer, Alex (Santander) <
> alex.spen...@santander.co.uk> wrote:
>
>> I forgot to add this is (I think) from 1.5.0.
>>
>>
>>
>> And yeah that looks like a Python – I’m not hot with Python but it may be
>> capitalised as False or FALSE?
>>
>>
>>
>>
>>
>> *From:* Eli Super [mailto:eli.su...@gmail.com]
>> *Sent:* 21 January 2016 14:48
>> *To:* Spencer, Alex (Santander)
>> *Cc:* user@spark.apache.org
>> *Subject:* Re: Spark SQL . How to enlarge output rows ?
>>
>>
>>
>> Thanks Alex
>>
>>
>>
>> I get NameError
>>
>> NameError: name 'false' is not defined
>>
>> Is it because of PySpark ?
>>
>>
>>
>>
>>
>> On Thu, Jan 14, 2016 at 3:34 PM, Spencer, Alex (Santander) <
>> alex.spen...@santander.co.uk> wrote:
>>
>> Hi,
>>
>>
>>
>> Try …..show(*false*)
>>
>>
>>
>> public void show(int numRows,
>>
>> boolean truncate)
>>
>>
>>
>>
>>
>> Kind Regards,
>>
>> Alex.
>>
>>
>>
>> *From:* Eli Super [mailto:eli.su...@gmail.com]
>> *Sent:* 14 January 2016 13:09
>> *To:* user@spark.apache.org
>> *Subject:* Spark SQL . How to enlarge output rows ?
>>
>>
>>
>>
>>
>> Hi
>>
>>
>>
>> After executing sql
>>
>>
>>
>> sqlContext.sql("select day_time from my_table limit 10").show()
>>
>>
>>
>> my output looks like  :
>>
>> ++
>>
>> |  day_time|
>>
>> ++
>>
>> |2015/12/15 15:52:...|
>>
>> |2015/12/15 15:53:...|
>>
>> |2015/12/15 15:52:...|
>>
>> |2015/12/15 15:52:...|
>>
>> |2015/12/15 15:52:...|
>>
>> |2015/12/15 15:52:...|
>>
>> |2015/12/15 15:51:...|
>>
>> |2015/12/15 15:52:...|
>>
>> |2015/12/15 15:52:...|
>>
>> |2015/12/15 15:53:...|
>>
>> ++
>>
>>
>>
>> I'd like to get full rows
>>
>> Thanks !
>>
>> Emails aren't always secure, and they may be intercepted or changed after
>> they've been sent. Santander doesn't accept liability if this happens. If
>> you
>> think someone may have interfered with this email, please get in touch
>> with the
>> sender another way. This message doesn't create or change any contract.
>> Santander doesn't accept responsibility for damage caused by any viruses
>> contained in this email or its attachments. Emails may be monitored. If
>> you've
>> received this email by mistake, please let the sender know at once that
>> it's
>> gone to the wrong person and then destroy it without copying, using, or
>> telling
>> anyone about its contents.
>> Santander UK plc Reg. No. 2294747 and Abbey National Treasury Services
>> plc Reg.
>> No. 2338548 Registered Offices: 2 Triton Square, Regent's Place, London
>> NW1 3AN.
>> Registered in England. www.santander.co.uk. Authorised by the Prudential
>> Regulation Authority and regulated by the Financial Conduct Authority and
>> the
>> Prudential Regulation Authority. FCA Reg. No. 106054 and 146003
>> respectively.
>> Santander Sharedealing is a trading name of Abbey Stockbrokers Limited
>> Reg. No.
>> 02666793. Registered Office: Kingfisher House, Radford Way, Billericay,
>> Essex
>> CM12 0GZ. Authorised and regulated by the Financial Conduct Autho

Re: Spark SQL . How to enlarge output rows ?

2016-01-24 Thread Eli Super 
Unfortunately still getting error when use .show() with `false` or `False`
or `FALSE`

Py4JError: An error occurred while calling o153.showString. Trace:
py4j.Py4JException: Method showString([class java.lang.String, class
java.lang.Boolean]) does not exist
at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:333)
at py4j.reflection.ReflectionEngine.getMethod(ReflectionEngine.java:342)
at py4j.Gateway.invoke(Gateway.java:252)
at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:133)
at py4j.commands.CallCommand.execute(CallCommand.java:79)
at py4j.GatewayConnection.run(GatewayConnection.java:207)
at java.lang.Thread.run(Thread.java:745)


On Thu, Jan 21, 2016 at 4:54 PM, Spencer, Alex (Santander) <
alex.spen...@santander.co.uk> wrote:

> I forgot to add this is (I think) from 1.5.0.
>
>
>
> And yeah that looks like a Python – I’m not hot with Python but it may be
> capitalised as False or FALSE?
>
>
>
>
>
> *From:* Eli Super [mailto:eli.su...@gmail.com]
> *Sent:* 21 January 2016 14:48
> *To:* Spencer, Alex (Santander)
> *Cc:* user@spark.apache.org
> *Subject:* Re: Spark SQL . How to enlarge output rows ?
>
>
>
> Thanks Alex
>
>
>
> I get NameError
>
> NameError: name 'false' is not defined
>
> Is it because of PySpark ?
>
>
>
>
>
> On Thu, Jan 14, 2016 at 3:34 PM, Spencer, Alex (Santander) <
> alex.spen...@santander.co.uk> wrote:
>
> Hi,
>
>
>
> Try …..show(*false*)
>
>
>
> public void show(int numRows,
>
> boolean truncate)
>
>
>
>
>
> Kind Regards,
>
> Alex.
>
>
>
> *From:* Eli Super [mailto:eli.su...@gmail.com]
> *Sent:* 14 January 2016 13:09
> *To:* user@spark.apache.org
> *Subject:* Spark SQL . How to enlarge output rows ?
>
>
>
>
>
> Hi
>
>
>
> After executing sql
>
>
>
> sqlContext.sql("select day_time from my_table limit 10").show()
>
>
>
> my output looks like  :
>
> ++
>
> |  day_time|
>
> ++
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:53:...|
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:51:...|
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:53:...|
>
> ++
>
>
>
> I'd like to get full rows
>
> Thanks !
>
> Emails aren't always secure, and they may be intercepted or changed after
> they've been sent. Santander doesn't accept liability if this happens. If
> you
> think someone may have interfered with this email, please get in touch
> with the
> sender another way. This message doesn't create or change any contract.
> Santander doesn't accept responsibility for damage caused by any viruses
> contained in this email or its attachments. Emails may be monitored. If
> you've
> received this email by mistake, please let the sender know at once that
> it's
> gone to the wrong person and then destroy it without copying, using, or
> telling
> anyone about its contents.
> Santander UK plc Reg. No. 2294747 and Abbey National Treasury Services plc
> Reg.
> No. 2338548 Registered Offices: 2 Triton Square, Regent's Place, London
> NW1 3AN.
> Registered in England. www.santander.co.uk. Authorised by the Prudential
> Regulation Authority and regulated by the Financial Conduct Authority and
> the
> Prudential Regulation Authority. FCA Reg. No. 106054 and 146003
> respectively.
> Santander Sharedealing is a trading name of Abbey Stockbrokers Limited
> Reg. No.
> 02666793. Registered Office: Kingfisher House, Radford Way, Billericay,
> Essex
> CM12 0GZ. Authorised and regulated by the Financial Conduct Authority. FCA
> Reg.
> No. 154210. You can check this on the Financial Services Register by
> visiting
> the FCA’s website www.fca.org.uk/register or by contacting the FCA on
> 0800 111
> 6768. Santander UK plc is also licensed by the Financial Supervision
> Commission
> of the Isle of Man for its branch in the Isle of Man. Deposits held with
> the
> Isle of Man branch are covered by the Isle of Man Depositors’ Compensation
> Scheme as set out in the Isle of Man Depositors’ Compensation Scheme
> Regulations
> 2010. In the Isle of Man, Santander UK plc’s principal place of business
> is at
> 19/21 Prospect Hill, Douglas, Isle of Man, IM1 1ET. Santander and the
> flame logo
> are registered trademarks.
> Santander Asset Finance plc. Reg. No. 1533123. Registered Office: 2 Triton
> Square, Regent’s Place, London NW1 3AN. Registered in England. Santander
> Corporate & Commercial is a brand name used by Santander UK plc, Abbey
> National
> Treasury Services plc and Santander Asset Finance plc.
> Ref:[PDB#1-4A]
>
>
>

RE: Spark SQL . How to enlarge output rows ?

2016-01-21 Thread Spencer, Alex (Santander) 
I forgot to add this is (I think) from 1.5.0.

And yeah that looks like a Python – I’m not hot with Python but it may be 
capitalised as False or FALSE?


From: Eli Super [mailto:eli.su...@gmail.com]
Sent: 21 January 2016 14:48
To: Spencer, Alex (Santander)
Cc: user@spark.apache.org
Subject: Re: Spark SQL . How to enlarge output rows ?

Thanks Alex

I get NameError

NameError: name 'false' is not defined

Is it because of PySpark ?



On Thu, Jan 14, 2016 at 3:34 PM, Spencer, Alex (Santander) 
<alex.spen...@santander.co.uk<mailto:alex.spen...@santander.co.uk>> wrote:
Hi,

Try …..show(false)

public void show(int numRows,
boolean truncate)


Kind Regards,
Alex.

From: Eli Super [mailto:eli.su...@gmail.com<mailto:eli.su...@gmail.com>]
Sent: 14 January 2016 13:09
To: user@spark.apache.org<mailto:user@spark.apache.org>
Subject: Spark SQL . How to enlarge output rows ?


Hi

After executing sql

sqlContext.sql("select day_time from my_table limit 10").show()

my output looks like  :

++

|  day_time|

++

|2015/12/15 15:52:...|

|2015/12/15 15:53:...|

|2015/12/15 15:52:...|

|2015/12/15 15:52:...|

|2015/12/15 15:52:...|

|2015/12/15 15:52:...|

|2015/12/15 15:51:...|

|2015/12/15 15:52:...|

|2015/12/15 15:52:...|

|2015/12/15 15:53:...|

++



I'd like to get full rows

Thanks !
Emails aren't always secure, and they may be intercepted or changed after
they've been sent. Santander doesn't accept liability if this happens. If you
think someone may have interfered with this email, please get in touch with the
sender another way. This message doesn't create or change any contract.
Santander doesn't accept responsibility for damage caused by any viruses
contained in this email or its attachments. Emails may be monitored. If you've
received this email by mistake, please let the sender know at once that it's
gone to the wrong person and then destroy it without copying, using, or telling
anyone about its contents.
Santander UK plc Reg. No. 2294747 and Abbey National Treasury Services plc Reg.
No. 2338548 Registered Offices: 2 Triton Square, Regent's Place, London NW1 3AN.
Registered in England. www.santander.co.uk<http://www.santander.co.uk>. 
Authorised by the Prudential
Regulation Authority and regulated by the Financial Conduct Authority and the
Prudential Regulation Authority. FCA Reg. No. 106054 and 146003 respectively.
Santander Sharedealing is a trading name of Abbey Stockbrokers Limited Reg. No.
02666793. Registered Office: Kingfisher House, Radford Way, Billericay, Essex
CM12 0GZ. Authorised and regulated by the Financial Conduct Authority. FCA Reg.
No. 154210. You can check this on the Financial Services Register by visiting
the FCA’s website www.fca.org.uk/register<http://www.fca.org.uk/register> or by 
contacting the FCA on 0800 111
6768. Santander UK plc is also licensed by the Financial Supervision Commission
of the Isle of Man for its branch in the Isle of Man. Deposits held with the
Isle of Man branch are covered by the Isle of Man Depositors’ Compensation
Scheme as set out in the Isle of Man Depositors’ Compensation Scheme Regulations
2010. In the Isle of Man, Santander UK plc’s principal place of business is at
19/21 Prospect Hill, Douglas, Isle of Man, IM1 1ET. Santander and the flame logo
are registered trademarks.
Santander Asset Finance plc. Reg. No. 1533123. Registered Office: 2 Triton
Square, Regent’s Place, London NW1 3AN. Registered in England. Santander
Corporate & Commercial is a brand name used by Santander UK plc, Abbey National
Treasury Services plc and Santander Asset Finance plc.
Ref:[PDB#1-4A]

Re: Spark SQL . How to enlarge output rows ?

2016-01-21 Thread Eli Super 
Thanks Alex

I get NameError

NameError: name 'false' is not defined

Is it because of PySpark ?



On Thu, Jan 14, 2016 at 3:34 PM, Spencer, Alex (Santander) <
alex.spen...@santander.co.uk> wrote:

> Hi,
>
>
>
> Try …..show(*false*)
>
>
>
> public void show(int numRows,
>
> boolean truncate)
>
>
>
>
>
> Kind Regards,
>
> Alex.
>
>
>
> *From:* Eli Super [mailto:eli.su...@gmail.com]
> *Sent:* 14 January 2016 13:09
> *To:* user@spark.apache.org
> *Subject:* Spark SQL . How to enlarge output rows ?
>
>
>
>
>
> Hi
>
>
>
> After executing sql
>
>
>
> sqlContext.sql("select day_time from my_table limit 10").show()
>
>
>
> my output looks like  :
>
> ++
>
> |  day_time|
>
> ++
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:53:...|
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:51:...|
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:52:...|
>
> |2015/12/15 15:53:...|
>
> ++
>
>
>
> I'd like to get full rows
>
> Thanks !
>
> Emails aren't always secure, and they may be intercepted or changed after
> they've been sent. Santander doesn't accept liability if this happens. If
> you
> think someone may have interfered with this email, please get in touch
> with the
> sender another way. This message doesn't create or change any contract.
> Santander doesn't accept responsibility for damage caused by any viruses
> contained in this email or its attachments. Emails may be monitored. If
> you've
> received this email by mistake, please let the sender know at once that
> it's
> gone to the wrong person and then destroy it without copying, using, or
> telling
> anyone about its contents.
> Santander UK plc Reg. No. 2294747 and Abbey National Treasury Services plc
> Reg.
> No. 2338548 Registered Offices: 2 Triton Square, Regent's Place, London
> NW1 3AN.
> Registered in England. www.santander.co.uk. Authorised by the Prudential
> Regulation Authority and regulated by the Financial Conduct Authority and
> the
> Prudential Regulation Authority. FCA Reg. No. 106054 and 146003
> respectively.
> Santander Sharedealing is a trading name of Abbey Stockbrokers Limited
> Reg. No.
> 02666793. Registered Office: Kingfisher House, Radford Way, Billericay,
> Essex
> CM12 0GZ. Authorised and regulated by the Financial Conduct Authority. FCA
> Reg.
> No. 154210. You can check this on the Financial Services Register by
> visiting
> the FCA’s website www.fca.org.uk/register or by contacting the FCA on
> 0800 111
> 6768. Santander UK plc is also licensed by the Financial Supervision
> Commission
> of the Isle of Man for its branch in the Isle of Man. Deposits held with
> the
> Isle of Man branch are covered by the Isle of Man Depositors’ Compensation
> Scheme as set out in the Isle of Man Depositors’ Compensation Scheme
> Regulations
> 2010. In the Isle of Man, Santander UK plc’s principal place of business
> is at
> 19/21 Prospect Hill, Douglas, Isle of Man, IM1 1ET. Santander and the
> flame logo
> are registered trademarks.
> Santander Asset Finance plc. Reg. No. 1533123. Registered Office: 2 Triton
> Square, Regent’s Place, London NW1 3AN. Registered in England. Santander
> Corporate & Commercial is a brand name used by Santander UK plc, Abbey
> National
> Treasury Services plc and Santander Asset Finance plc.
> Ref:[PDB#1-4A]
>

Spark SQL . How to enlarge output rows ?

2016-01-14 Thread Eli Super 
Hi

After executing sql

sqlContext.sql("select day_time from my_table limit 10").show()

my output looks like  :

++
|  day_time|
++
|2015/12/15 15:52:...|
|2015/12/15 15:53:...|
|2015/12/15 15:52:...|
|2015/12/15 15:52:...|
|2015/12/15 15:52:...|
|2015/12/15 15:52:...|
|2015/12/15 15:51:...|
|2015/12/15 15:52:...|
|2015/12/15 15:52:...|
|2015/12/15 15:53:...|
++


I'd like to get full rows

Thanks !

RE: Spark SQL . How to enlarge output rows ?

2016-01-14 Thread Spencer, Alex (Santander) 
Hi,

Try …..show(false)

public void show(int numRows,
boolean truncate)


Kind Regards,
Alex.

From: Eli Super [mailto:eli.su...@gmail.com]
Sent: 14 January 2016 13:09
To: user@spark.apache.org
Subject: Spark SQL . How to enlarge output rows ?


Hi

After executing sql

sqlContext.sql("select day_time from my_table limit 10").show()

my output looks like  :

++

|  day_time|

++

|2015/12/15 15:52:...|

|2015/12/15 15:53:...|

|2015/12/15 15:52:...|

|2015/12/15 15:52:...|

|2015/12/15 15:52:...|

|2015/12/15 15:52:...|

|2015/12/15 15:51:...|

|2015/12/15 15:52:...|

|2015/12/15 15:52:...|

|2015/12/15 15:53:...|

++



I'd like to get full rows

Thanks !
Emails aren't always secure, and they may be intercepted or changed after
they've been sent. Santander doesn't accept liability if this happens. If you
think someone may have interfered with this email, please get in touch with the
sender another way. This message doesn't create or change any contract.
Santander doesn't accept responsibility for damage caused by any viruses
contained in this email or its attachments. Emails may be monitored. If you've
received this email by mistake, please let the sender know at once that it's
gone to the wrong person and then destroy it without copying, using, or telling
anyone about its contents.
Santander UK plc Reg. No. 2294747 and Abbey National Treasury Services plc Reg.
No. 2338548 Registered Offices: 2 Triton Square, Regent's Place, London NW1 3AN.
Registered in England. www.santander.co.uk. Authorised by the Prudential
Regulation Authority and regulated by the Financial Conduct Authority and the
Prudential Regulation Authority. FCA Reg. No. 106054 and 146003 respectively.
Santander Sharedealing is a trading name of Abbey Stockbrokers Limited Reg. No.
02666793. Registered Office: Kingfisher House, Radford Way, Billericay, Essex
CM12 0GZ. Authorised and regulated by the Financial Conduct Authority. FCA Reg.
No. 154210. You can check this on the Financial Services Register by visiting
the FCA’s website www.fca.org.uk/register or by contacting the FCA on 0800 111
6768. Santander UK plc is also licensed by the Financial Supervision Commission
of the Isle of Man for its branch in the Isle of Man. Deposits held with the
Isle of Man branch are covered by the Isle of Man Depositors’ Compensation
Scheme as set out in the Isle of Man Depositors’ Compensation Scheme Regulations
2010. In the Isle of Man, Santander UK plc’s principal place of business is at
19/21 Prospect Hill, Douglas, Isle of Man, IM1 1ET. Santander and the flame logo
are registered trademarks.
Santander Asset Finance plc. Reg. No. 1533123. Registered Office: 2 Triton
Square, Regent’s Place, London NW1 3AN. Registered in England. Santander
Corporate & Commercial is a brand name used by Santander UK plc, Abbey National
Treasury Services plc and Santander Asset Finance plc.
Ref:[PDB#1-4A]