[GitHub] zeppelin pull request #1248: [ZEPPELIN-1069]Ignore implicit interpreter when...

2016-07-29 Thread mwkang
GitHub user mwkang opened a pull request:

https://github.com/apache/zeppelin/pull/1248

[ZEPPELIN-1069]Ignore implicit interpreter when user enter wrong 
interpreter name

### What is this PR for?
Ignore implicit interpreter when user enter wrong interpreter name
linked to https://github.com/apache/zeppelin/pull/806#issuecomment-227041293

This PR is related to #1113 
ZEPPELIN-1069 branch was force push, so couldn't reopen that PR.

### What type of PR is it?
Improvement

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1069

### How should this be tested?
Unit test
Run-time checking

### Screenshots (if appropriate)

![zeppelin-1069-gif](https://cloud.githubusercontent.com/assets/10624086/17268431/d6d9370c-5664-11e6-9274-d0244d60a8c9.gif)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/mwkang/zeppelin ZEPPELIN-1069

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1248.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1248


commit 0b3cb383870e77037b79035c34a6dd146fb37ec0
Author: Minwoo Kang 
Date:   2016-07-29T07:21:53Z

Add function that is replName is binding.

commit d1c074887dc419a68014b912e0ed852d8d029df7
Author: Minwoo Kang 
Date:   2016-07-30T05:31:10Z

Add test cases




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1113: [ZEPPELIN-1069]Ignore implicit interpreter when user e...

2016-07-29 Thread mwkang
Github user mwkang commented on the issue:

https://github.com/apache/zeppelin/pull/1113
  
@AhyoungRyu Thanks for your advice. Next time, I will try to do that.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1170: BigQuery Interpreter for Apazhe Zeppelin[ZEPPELIN-1153...

2016-07-29 Thread babupe
Github user babupe commented on the issue:

https://github.com/apache/zeppelin/pull/1170
  
Do you think the external auth could be a blocker for the initial merge?
If not, lets table it for now and I will pick this up later?
It may be a little bit more involved than I thought.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1170: BigQuery Interpreter for Apazhe Zeppelin[ZEPPELIN-1153...

2016-07-29 Thread babupe
Github user babupe commented on the issue:

https://github.com/apache/zeppelin/pull/1170
  
I have now pushed the change to capture and show bigquery exceptions with 
bad statements both in logs and interpreter. Will look into the credentials.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: Garbage collection in Spark interpreter

2016-07-29 Thread Sachin Janani
Thanks Moon. It means that this is the issue with the scala interpreter
itself.

Regards,
-Sachin
On Jul 30, 2016 04:48, "moon soo Lee"  wrote:

> Hi,
>
> Here's related issue.
> https://issues.scala-lang.org/browse/SI-4331
>
> Restart interpreter will be the only way to release memory.
> It looks like there're some unreleased memory for keeping variable and
> generated class, even if you're manually releasing reference to the object,
> like
>
> var myObject = new MyObject
> 
> myObject = null
>
> Thanks,
> moon
>
>
> On Mon, Jul 25, 2016 at 10:48 PM Sachin Janani 
> wrote:
>
> > Hi All,
> > I was looking into the spark interpreter code to understand how it works
> > and found that it is using Spark REPL for executing scala code.As per my
> > understanding spark REPL will not do GC unless we restart the
> > interpreter.So my question here is
> > 1) if we are using Spark interpreter will the variables that we create
> will
> > ever be destroyed without restarting the interpreter?
> > 2) Have someone faced any issue related to GC in interpreter process
> > before?
> >
> >
> > Thanks and Regards,
> > Sachin J
> >
>


[GitHub] zeppelin issue #1243: [ZEPPELIN-1250] remove 2.11 suffix from zeppelin-serve...

2016-07-29 Thread minahlee
Github user minahlee commented on the issue:

https://github.com/apache/zeppelin/pull/1243
  
Merging it to prepare release 0.6.1


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1170: BigQuery Interpreter for Apazhe Zeppelin[ZEPPELIN-1153...

2016-07-29 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1170
  
Thank you! Sounds awesome to me. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1170: BigQuery Interpreter for Apazhe Zeppelin[ZEPPELIN-1153...

2016-07-29 Thread babupe
Github user babupe commented on the issue:

https://github.com/apache/zeppelin/pull/1170
  
Sorry about the delay. Merged it now. Thank you so much for documenting 
this!
I am looking at surfacing the errors out to the interpreter. Will have an 
update on it.
Will also look at exposing creds for non GCE instances through 
configuration.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1255) z.show() does not display Pandas DataFrame with non-string values

2016-07-29 Thread Paul Bustios (JIRA)
Paul Bustios created ZEPPELIN-1255:
--

 Summary: z.show() does not display Pandas DataFrame with 
non-string values
 Key: ZEPPELIN-1255
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1255
 Project: Zeppelin
  Issue Type: Bug
  Components: python-interpreter
Affects Versions: 0.7.0
Reporter: Paul Bustios


{{z.show()}} implementation for Pandas DataFrame support on 
-[ZEPPELIN-1048|https://issues.apache.org/jira/browse/ZEPPELIN-1048]- writes 
any kind of data to a text stream raising a {{TypeError: string argument 
expected}}.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


Re: Garbage collection in Spark interpreter

2016-07-29 Thread moon soo Lee
Hi,

Here's related issue.
https://issues.scala-lang.org/browse/SI-4331

Restart interpreter will be the only way to release memory.
It looks like there're some unreleased memory for keeping variable and
generated class, even if you're manually releasing reference to the object,
like

var myObject = new MyObject

myObject = null

Thanks,
moon


On Mon, Jul 25, 2016 at 10:48 PM Sachin Janani 
wrote:

> Hi All,
> I was looking into the spark interpreter code to understand how it works
> and found that it is using Spark REPL for executing scala code.As per my
> understanding spark REPL will not do GC unless we restart the
> interpreter.So my question here is
> 1) if we are using Spark interpreter will the variables that we create will
> ever be destroyed without restarting the interpreter?
> 2) Have someone faced any issue related to GC in interpreter process
> before?
>
>
> Thanks and Regards,
> Sachin J
>


[GitHub] zeppelin issue #1210: [ZEPPELIN-1220] Add geographical map as visualization ...

2016-07-29 Thread mwpenny
Github user mwpenny commented on the issue:

https://github.com/apache/zeppelin/pull/1210
  
@corneadoug Done


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1240: [ZEPPELIN-1246] In JDBCInterpreter.getScheduler...

2016-07-29 Thread prasadwagle
GitHub user prasadwagle reopened a pull request:

https://github.com/apache/zeppelin/pull/1240

[ZEPPELIN-1246] In JDBCInterpreter.getScheduler, use 
getMaxConcurrentConnection instead of hardcoding maxConcurrency to 10

### What is this PR for?
In JDBCInterpreter.getScheduler, use getMaxConcurrentConnection instead of 
hardcoding maxConcurrency to 10


### What type of PR is it?
Improvement

### Todos
* [ ] - Task

### What is the Jira issue?
[ZEPPELIN-1246] (https://issues.apache.org/jira/browse/ZEPPELIN-1246)

### How should this be tested?
Set zeppelin.jdbc.concurrent.max_connection to 2 and verify after starting 
two long-running queries, a third query is pending.

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update?
No

* Is there breaking changes for older versions?
No

* Does this needs documentation?
No

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/prasadwagle/incubator-zeppelin ZEPPELIN-1246

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1240.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1240


commit 4b2990fe89e6fcc37c9de5839443ed9edc9e48ef
Author: Prasad Wagle 
Date:   2016-07-28T21:27:15Z

In JDBCInterpreter.getScheduler, use getMaxConcurrentConnection instead of 
hardcoding maxConcurrency to 10




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1240: [ZEPPELIN-1246] In JDBCInterpreter.getScheduler...

2016-07-29 Thread prasadwagle
Github user prasadwagle closed the pull request at:

https://github.com/apache/zeppelin/pull/1240


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1246: [MINOR] Fix missing validation on interpreter page

2016-07-29 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1246
  
Good catch, LGTM!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1247: ZEPPELIN-1254 Make get and save Interpreter bin...

2016-07-29 Thread r-kamath
GitHub user r-kamath opened a pull request:

https://github.com/apache/zeppelin/pull/1247

ZEPPELIN-1254 Make get and save Interpreter bindings calls via websocket

### What is this PR for?
This PR uses websocket to get and save interpreter bindings instead of rest 
api

### What type of PR is it?
Improvement

### Todos
* [ ] - Task

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1254

### How should this be tested?
Go to interpreter binding settings on notebook page and enable/disable 
interpreter or reorder and save. Simultaneously verify the network calls on 
browser's console.

### Screenshots (if appropriate)
n/a
### Questions:
* Does the licenses files need update? n/a
* Is there breaking changes for older versions? n/a
* Does this needs documentation? n/a



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/r-kamath/zeppelin ZEPPELIN-1254

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1247.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1247


commit 97bfd7d8c2dd18ad5a93a8374b7cd397612bf4c2
Author: Renjith Kamath 
Date:   2016-07-29T12:58:31Z

ZEPPELIN-1254 Make get and save Interpreter bindings calls via websocket




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1254) Make get and save Interpreter bindings calls via websocket

2016-07-29 Thread Renjith Kamath (JIRA)
Renjith Kamath created ZEPPELIN-1254:


 Summary: Make get and save Interpreter bindings calls via websocket
 Key: ZEPPELIN-1254
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1254
 Project: Zeppelin
  Issue Type: Improvement
Reporter: Renjith Kamath
Assignee: Renjith Kamath






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (ZEPPELIN-1253) Spark 2.0 provided spark installation is not working

2016-07-29 Thread Tamas Szuromi (JIRA)
Tamas Szuromi created ZEPPELIN-1253:
---

 Summary: Spark 2.0 provided spark installation is not working
 Key: ZEPPELIN-1253
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1253
 Project: Zeppelin
  Issue Type: Bug
Affects Versions: 0.7.0
 Environment: Zeppelin master 848dbd0302a4e6d4917a70c1cbc2220a7a814488
Spark 2.0
mvn clean package -Dscala-2.11 -Pspark-2.0 -Dspark.version=2.0.0-Ppyspark 
-Psparkr -Pyarn -Phadoop-2.6 -DskipTests
Reporter: Tamas Szuromi


Zeppelin is not working with provided spark installation.
I have a separate spark 2.0 installation so SPARK_HOME env variable pointed to 
that location.

I got the following:

{code:xml}
 INFO [2016-07-29 12:19:26,503] ({qtp1837760739-52} 
InterpreterFactory.java[createInterpretersForNote]:660) - Create interpreter 
instance spark for note 2BURMS2FQ
 INFO [2016-07-29 12:19:26,507] ({qtp1837760739-52} 
InterpreterFactory.java[createInterpretersForNote]:691) - Interpreter 
org.apache.zeppelin.spark.SparkInterpreter 1338618313 created
 INFO [2016-07-29 12:19:26,507] ({qtp1837760739-52} 
InterpreterFactory.java[createInterpretersForNote]:691) - Interpreter 
org.apache.zeppelin.spark.SparkSqlInterpreter 982802932 created
 INFO [2016-07-29 12:19:26,508] ({qtp1837760739-52} 
InterpreterFactory.java[createInterpretersForNote]:691) - Interpreter 
org.apache.zeppelin.spark.DepInterpreter 714154339 created
 INFO [2016-07-29 12:19:26,508] ({qtp1837760739-52} 
InterpreterFactory.java[createInterpretersForNote]:691) - Interpreter 
org.apache.zeppelin.spark.PySparkInterpreter 352617436 created
 INFO [2016-07-29 12:19:26,509] ({qtp1837760739-52} 
InterpreterFactory.java[createInterpretersForNote]:691) - Interpreter 
org.apache.zeppelin.spark.SparkRInterpreter 398536524 created
 INFO [2016-07-29 12:19:42,688] ({pool-2-thread-2} 
SchedulerFactory.java[jobStarted]:131) - Job 
paragraph_1469794765938_-1119780584 started by scheduler 
org.apache.zeppelin.interpreter.remote.RemoteInterpretershared_session1545433467
 INFO [2016-07-29 12:19:42,689] ({pool-2-thread-2} Paragraph.java[jobRun]:282) 
- run paragraph 20160729-121925_2015885616 using spark 
org.apache.zeppelin.interpreter.LazyOpenInterpreter@4fc9b1c9
 INFO [2016-07-29 12:19:42,698] ({pool-2-thread-2} 
RemoteInterpreterManagedProcess.java[start]:116) - Run interpreter process 
[/incubator-zeppelin/bin/interpreter.sh, -d, 
/incubator-zeppelin/interpreter/spark, -p, 50669, -l, 
/incubator-zeppelin/local-repo/2BRTFB2HH]
ERROR [2016-07-29 12:19:42,718] ({qtp1837760739-49} 
ResourcePoolUtils.java[getAllResourcesExcept]:64) -
java.lang.NullPointerException
at 
org.apache.zeppelin.resource.ResourcePoolUtils.getAllResourcesExcept(ResourcePoolUtils.java:58)
at 
org.apache.zeppelin.resource.ResourcePoolUtils.getAllResources(ResourcePoolUtils.java:36)
at org.apache.zeppelin.helium.Helium.suggestApp(Helium.java:153)
at org.apache.zeppelin.rest.HeliumRestApi.suggest(HeliumRestApi.java:83)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:180)
at 
org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:96)
at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:192)
at org.apache.cxf.jaxrs.JAXRSInvoker.invoke(JAXRSInvoker.java:100)
at 
org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:57)
at 
org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:93)
at 
org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:272)
at 
org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
at 
org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:239)
at 
org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:248)
at 
org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:222)
at 
org.apache.cxf.transport.servlet.ServletController.invoke(ServletController.java:153)
at 
org.apache.cxf.transport.servlet.CXFNonSpringServlet.invoke(CXFNonSpringServlet.java:167)
at 
org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:286)
at 
org.apache.cxf.transport.servlet.AbstractHTTPServlet.doGet(AbstractHTTPServlet.java:211)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:687

[GitHub] zeppelin pull request #1246: [MINOR] Fix missing validation on interpreter p...

2016-07-29 Thread r-kamath
GitHub user r-kamath opened a pull request:

https://github.com/apache/zeppelin/pull/1246

[MINOR] Fix missing validation on interpreter page

### What is this PR for?
Fix missing validation on interpreter page. TypeError on console when Save 
interpreter settings button is clicked without specifying any value.

### What type of PR is it?
Bug Fix

### Todos
* [ ] - Task

### What is the Jira issue?
n/a

### How should this be tested?
1) go to interpreter settings page and click on create buttons
2) click on save without filling any fields

### Screenshots (if appropriate)
before fix
https://cloud.githubusercontent.com/assets/2031306/17248223/c3b7a194-55b6-11e6-9746-5d912a723f6a.png;>


### Questions:
* Does the licenses files need update? n/a
* Is there breaking changes for older versions? n/a
* Does this needs documentation? n/a



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/r-kamath/zeppelin interpreterPageFix

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1246.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1246


commit 0ccf5156123569c3c93562a354ae751c3e6cf15d
Author: Renjith Kamath 
Date:   2016-07-29T12:30:55Z

Fix missing validation on interpreter page




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1245: ZEPPELIN-1225. Errors before the last shell command ar...

2016-07-29 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1245
  
@Leemoonsoo this is for branch-0.6, the test fail seems irrelevant. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1232: ZEPPELIN-1197. Should print output directly without in...

2016-07-29 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1232
  
Thanks you for explanation. LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1235: ZEPPELIN-1227 change spark-2.0.0-preview to spark-2.0....

2016-07-29 Thread minahlee
Github user minahlee commented on the issue:

https://github.com/apache/zeppelin/pull/1235
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1241: [ZEPPELIN-1217] Remove horizontal scrollbar in Zeppeli...

2016-07-29 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1241
  
@zjffdu I'm not sure, your issue is related with [this 
issue](https://github.com/bundler/bundler/issues/4065#issuecomment-149596385), 
could you try

```
gem uninstall bundler
sudo gem install bundler
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1244: [ZEPPELIN-1251] Update interpreter artifact option lis...

2016-07-29 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1244
  
What will happen with `./bin/install-interpreter.sh --all` ?
@minahlee Do you have any good idea to not install xxx_2.10 and xxx_2.11 
together with `--all` option?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1244: [ZEPPELIN-1251] Update interpreter artifact opt...

2016-07-29 Thread minahlee
GitHub user minahlee opened a pull request:

https://github.com/apache/zeppelin/pull/1244

[ZEPPELIN-1251] Update interpreter artifact option list for netinst package

### What is this PR for?
Add scala 2.11 artifact options for netinst package

### What type of PR is it?
Documentation

### What is the Jira issue?
[ZEPPELIN-1251](https://issues.apache.org/jira/browse/ZEPPELIN-1251)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/minahlee/zeppelin ZEPPELIN-1251

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1244.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1244


commit 4c038a08ba1efdbbc8d5825692448565651c47c9
Author: Mina Lee 
Date:   2016-07-29T09:42:09Z

Add interpreter artifact list built with scala 2.10 and scala 2.11




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1241: [ZEPPELIN-1217] Remove horizontal scrollbar in Zeppeli...

2016-07-29 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1241
  
yes, I run it under `ZEPPELIN_HOME/docs`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1241: [ZEPPELIN-1217] Remove horizontal scrollbar in Zeppeli...

2016-07-29 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1241
  
@zjffdu Did you run `bundle install` under `ZEPPELIN_HOME/docs` dir? 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1243: [ZEPPELIN-1250] remove 2.11 suffix from zeppelin-serve...

2016-07-29 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1243
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1215: ZEPPELIN-1225. Errors before the last shell command ar...

2016-07-29 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1215
  
Merged into master. However, it wasn't able to be merged in branch-0.6 with 
conflict.
So @zjffdu I'm resolving issue 
[ZEPPELIN-1225](https://issues.apache.org/jira/browse/ZEPPELIN-1225) with 
fixversion 0.7.0.

You can always create PR to branch-0.6, when you think this patch should be 
included in branch-0.6.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1243: [ZEPPELIN-1250] remove 2.11 suffix from zeppeli...

2016-07-29 Thread minahlee
GitHub user minahlee opened a pull request:

https://github.com/apache/zeppelin/pull/1243

[ZEPPELIN-1250] remove 2.11 suffix from zeppelin-server

### What is this PR for?
Remove 2.11 suffix from zeppelin-server since it uses scala dependencies 
only for test, so doesn't need to separate the artifact by scala version

### What type of PR is it?
Build

### What is the Jira issue?
[ZEPPELIN-1250](https://issues.apache.org/jira/browse/ZEPPELIN-1250)

### Screenshots (if appropriate)
Attaching result of compatibility between zeppelin-server_2.10, 
zeppelin-server_2.11.
![screen shot 2016-07-29 at 6 22 32 
pm](https://cloud.githubusercontent.com/assets/8503346/17243801/87b2a90c-55b9-11e6-8fd3-d4ccd51a5e80.png)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/minahlee/zeppelin ZEPPELIN-1250

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1243.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1243


commit 8f1149c994b546e3fc8958e886e1e5e08f147ced
Author: Mina Lee 
Date:   2016-07-29T09:18:09Z

remove 2.11 suffix




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1241: [ZEPPELIN-1217] Remove horizontal scrollbar in Zeppeli...

2016-07-29 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1241
  
@AhyoungRyu I follow the instruction here to build the doc 
https://github.com/apache/zeppelin/blob/master/docs/README.md#build-documentation,
 but fails. Here's the error after `bundle install`
```
Using bundler 1.12.5
An error occurred while installing RedCloth (4.2.9), and Bundler cannot 
continue.
Make sure that `gem install RedCloth -v '4.2.9'` succeeds before bundling.
```

I ran it on mac os 10.11, and also did `xcode-select --install`,  do you 
know how can I fix this ? Thanks


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: Python SQL over Pandas Dataframe, was - Re: [GSoC 2016] Notebooks

2016-07-29 Thread Alexander Bezzubov
Hi Paul,

it definitely looks like a bug and the right fix to me!

Could you please create a JIRA issue and submit a PR with the fix?
I think it is a very valuable contribution, thank you!

--
Alex

On Fri, Jul 29, 2016 at 3:45 PM, Paul Bustios Belizario 
wrote:

> Hi Alex,
>
> Now, with that problem solved, another one appeared. I tried to reproduce
> this example and got an error with the type of data:
> https://db.tt/fhfzlWGS
>
> I tested it with python 2 and 3, but the error persists. So I thought in
> casting the values to string when the content of the DataFrame is written
> in the StringIO stream:
>
> header_buf.write(str(df.columns[0]))
> header_buf.write(str(col))
> body_buf.write(str(row[0]))
> body_buf.write(str(cell))
>
> With such changes, the problem was solved: https://db.tt/afrCORIU
>
> I'm not sure how the error can be reproduced because I just tried to
> reproduce an example. Should it be consider a bug?
>
> Regards,
> Paul
>
> On Thu, Jul 28, 2016 at 6:52 AM Alexander Bezzubov  wrote:
>
> > Hi Paul,
> >
> > note the subject change.
> >
> > This is definitely a bug I can reproduce in default configuration!
> > Thank you for reporting, have logged it under ZEPPELIN-1244 [1] and
> > attached a hotfix.
> >
> >  1. https://issues.apache.org/jira/browse/ZEPPELIN-1244
> >
> > --
> > Alex
> >
> > On Thu, Jul 28, 2016 at 11:45 AM, Paul Bustios Belizario <
> > pbust...@gmail.com
> > > wrote:
> >
> > > Hi Alexander,
> > >
> > > Yes, I'm using the latest version of the code in master branch and I
> have
> > > installed pandas and pandasql.
> > >
> > > By the way, I made searches in the repository. Below, the 2 screens of
> > the
> > > search results for:
> > >
> > > PythonPandasSQL*Interpreter*
> > >
> > >
> >
> https://dl.dropboxusercontent.com/u/20947972/search_pandassql_interpreter.png
> > >
> > > Python*Interpreter*PandasSQL
> > >
> > >
> >
> https://dl.dropboxusercontent.com/u/20947972/search_interpreter_pandassql.png
> > >
> > > Attached error log.
> > >
> > > Regards,
> > > Paul
> > >
> > > On Mon, Jul 25, 2016 at 10:44 PM Alexander Bezzubov 
> > > wrote:
> > >
> > >> Hi Paul,
> > >>
> > >> this sounds very strange indeed.
> > >>
> > >> Please make sure you are using latest master and to get correct
> > >> interpreters classnames - it should be enough to delete
> > >> /conf/interpreter-settings.json and restart Zeppelin - it will be
> > >> re-created.
> > >>
> > >> Regarding dependencies for to run %python.sql (it's implementation is
> > >> PythonInterpreterPandasSql), please refer [1] and make sure
> pre-requests
> > >> are installed on your system's Python (or the one that is configured
> to
> > >> use
> > >> through interpreter settings UI)
> > >>
> > >> If nothing helps, please feel free to file a Jira issue with
> description
> > >> on
> > >> how the error can be reproduced and I will be happy to help you and
> look
> > >> more into it!
> > >>
> > >> 1.
> > >>
> > >>
> >
> https://github.com/apache/zeppelin/blob/master/docs/interpreter/python.md#sql-over-pandas-dataframes
> > >>
> > >> --
> > >> Alex
> > >>
> > >> On Tue, Jul 26, 2016, 09:44 Paul Bustios Belizario <
> pbust...@gmail.com>
> > >> wrote:
> > >>
> > >> > Hi Alexander,
> > >> >
> > >> > Yes. I knew that, but for some reason, that I'm still investigating,
> > >> > z.show() doesn't display the dataframe in my notebook. That's why I
> > >> decided
> > >> > to not incorporate z.show() yet. As soon as I find the problem I
> will
> > >> add
> > >> > it.
> > >> >
> > >> > Regarding to pandasql, there is an error creating the interpreter:
> > >> >
> > >> > java.lang.ClassNotFoundException:
> > >> > org.apache.zeppelin.python.PythonPandasSqlInterpreter
> > >> >
> > >> > I couldn't found PythonPandasSqlInterpreter class, I only found
> > >> > PythonInterpreterPandasSql.java in the latest version of the code.
> Is
> > >> there
> > >> > anything more I need to do to have ready this interpreter? Do I have
> > to
> > >> > change the class name of the interpreter in the
> > >> interpreter-setting.json?
> > >> >
> > >> > Regards,
> > >> > Paul
> > >> >
> > >> > On Sun, Jul 24, 2016 at 11:44 PM Alexander Bezzubov  >
> > >> > wrote:
> > >> >
> > >> > > Thanks for sharing your progress Paul, the notebook looks great!
> > >> > >
> > >> > > By the way, did you know that in latest Apache Zeppelin instead of
> > >> > > ```
> > >> > > print(titanic.head())
> > >> > > ```
> > >> > > one can use
> > >> > >
> > >> > > ```
> > >> > > z.show(titanic)
> > >> > > ```
> > >> > > ?
> > >> > >
> > >> > > It would be a good opportunity to showcase this [1] and other
> > >> features of
> > >> > > the Python interpreter like recent SQL over PandasDataframe with
> > >> built-in
> > >> > > visualizations for easy exploratory analysis [2] thought this
> work,
> > >> how
> > >> > do
> > >> > > you think?
> > >> > >
> > >> > > 1.
> > >> > >
> > >> > >
> > >> >
> > >>
> >
> 

[GitHub] zeppelin issue #1170: BigQuery Interpreter for Apazhe Zeppelin[ZEPPELIN-1153...

2016-07-29 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1170
  
Added babupe/zeppelin#2 

After configuring credentials I got strange behavior: query `show tables` 
results is `ERROR` paragraph status with 
 - no output in GUI
 - and nothing in the logs

![screen shot 2016-07-29 at 15 40 
08](https://cloud.githubusercontent.com/assets/5582506/17239974/3869e042-55a3-11e6-9861-ecc4cc9f6247.png)

```
  INFO [2016-07-29 15:39:49,759] ({pool-2-thread-2} 
SchedulerFactory.java[jobStarted]:131) - Job remoteInterpretJob_1469774389758 
started by scheduler org.apache.zeppelin.bigquery.BigQueryInterpreter745463803
 INFO [2016-07-29 15:39:49,759] ({pool-2-thread-2} 
BigQueryInterpreter.java[interpret]:288) - Run SQL command 'show tables'
 INFO [2016-07-29 15:39:50,531] ({pool-2-thread-2} 
SchedulerFactory.java[jobFinished]:137) - Job remoteInterpretJob_1469774389758 
finished by scheduler org.apache.zeppelin.bigquery.BigQueryInterpreter745463803
```

Which is a bit frustrating experience, since it is `ERROR` but user does 
not know why.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1225: [Zeppelin-1229] Add cache buster for zeppelin-w...

2016-07-29 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1225


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1241: [ZEPPELIN-1217] Remove horizontal scrollbar in Zeppeli...

2016-07-29 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1241
  
@zjffdu Could you review this PR as a reporter?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1241: [ZEPPELIN-1217] Remove horizontal scrollbar in ...

2016-07-29 Thread AhyoungRyu
GitHub user AhyoungRyu opened a pull request:

https://github.com/apache/zeppelin/pull/1241

[ZEPPELIN-1217] Remove horizontal scrollbar in Zeppelin conf table

### What is this PR for?
This PR will fix 
[ZEPPELIN-1217](https://issues.apache.org/jira/browse/ZEPPELIN-1217).

Current [Zeppelin configuration 
table](https://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/install/install.html#apache-zeppelin-configuration)
 is hard to compare the env variable name with the descriptions at a glance 
because of the horizontal scrollbar. So I just removed the scrollbar. 

### What type of PR is it?
Improvement

### What is the Jira issue?
[ZEPPELIN-1217](https://issues.apache.org/jira/browse/ZEPPELIN-1217)

### Screenshots (if appropriate)
 - Before 

![before](https://cloud.githubusercontent.com/assets/10060731/17239827/10957730-55a2-11e6-90c8-86724d835530.gif)

 - After 

![after](https://cloud.githubusercontent.com/assets/10060731/17239828/1374f1a6-55a2-11e6-99c4-01d7959482a4.gif)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/AhyoungRyu/zeppelin ZEPPELIN-1217

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1241.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1241


commit 2c822524df2ce3cf504774baa6d44a18618e1d4c
Author: AhyoungRyu 
Date:   2016-07-29T06:23:47Z

Remove horizontal scrollbar in Zeppelin conf table




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1220: [MINOR] Make scala version definition consisten...

2016-07-29 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1220


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1252) Please provide Zeppelin precompiled for Hbase 1.2

2016-07-29 Thread chris snow (JIRA)
chris snow created ZEPPELIN-1252:


 Summary: Please provide Zeppelin precompiled for Hbase 1.2
 Key: ZEPPELIN-1252
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1252
 Project: Zeppelin
  Issue Type: New Feature
  Components: build
Affects Versions: 0.6.0
Reporter: chris snow


It would be great if I could use Zeppelin with Hbase 1.2 without having to 
compile Zeppelin from source.

See also: https://issues.apache.org/jira/browse/ZEPPELIN-768



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1237: ZEPPELIN-1242. Should set property SPARK_YARN_MODE and...

2016-07-29 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1237
  
Merging this if no more discussion.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1251) Add scala 2.11 artifact options in netinst name list

2016-07-29 Thread Mina Lee (JIRA)
Mina Lee created ZEPPELIN-1251:
--

 Summary: Add scala 2.11 artifact options in netinst name list
 Key: ZEPPELIN-1251
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1251
 Project: Zeppelin
  Issue Type: Task
Reporter: Mina Lee






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (ZEPPELIN-1250) Remove unnecessary dependencies

2016-07-29 Thread Mina Lee (JIRA)
Mina Lee created ZEPPELIN-1250:
--

 Summary: Remove unnecessary dependencies
 Key: ZEPPELIN-1250
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1250
 Project: Zeppelin
  Issue Type: Task
Reporter: Mina Lee


zeppelin-server and zeppelin-distribution doesn't need scala dependency



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1170: BigQuery Interpreter for Apazhe Zeppelin[ZEPPELIN-1153...

2016-07-29 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1170
  
While running locally I got:

```
ERROR [2016-07-29 15:05:09,591] ({pool-2-thread-2} 
BigQueryInterpreter.java[open]:142) - Cannot open connection
java.io.IOException: The Application Default Credentials are not available. 
They are available if running in Google Compute Engine. Otherwise, the 
environment variable GOOGLE_APPLICATION_CREDENTIALS must be defined pointing to 
a file defining the credentials. See 
https://developers.google.com/accounts/docs/application-default-credentials for 
more information.
at 
com.google.api.client.googleapis.auth.oauth2.DefaultCredentialProvider.getDefaultCredential(DefaultCredentialProvider.java:95)
at 
com.google.api.client.googleapis.auth.oauth2.GoogleCredential.getApplicationDefault(GoogleCredential.java:213)
at 
org.apache.zeppelin.bigquery.BigQueryInterpreter.createAuthorizedClient(BigQueryInterpreter.java:155)
at 
org.apache.zeppelin.bigquery.BigQueryInterpreter.open(BigQueryInterpreter.java:138)
at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:383)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at 
org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
 INFO [2016-07-29 15:05:09,593] ({pool-2-thread-2} 
BigQueryInterpreter.java[close]:281) - Close bqsql connection!
```

@babupe do you think it would make sense to expose this though interpreter 
configuration properties, same as `project id`, so people could override it? Or 
may be it would be easier to use OAuth service account?

In any way, we need to document this properly for people to know that there 
are 
[pre-requests](https://developers.google.com/identity/protocols/application-default-credentials),
 before using this interpreter.

I will submit the PR with docs


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1215: ZEPPELIN-1225. Errors before the last shell com...

2016-07-29 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1215


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---