[GitHub] zeppelin issue #1270: [ZEPPELIN-1273] Use Math.abs to determine if custom fo...

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1270
  
Looks great to me, thank you @praagarw 
Merging to only to master, if there is no further discussion

Or do you think we should also apply this to upcoming 0.6.1 as well?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1258
  
Looks great to me!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1271: [Z

2016-08-02 Thread sarutak
GitHub user sarutak opened a pull request:

https://github.com/apache/zeppelin/pull/1271

[Z

### What is this PR for?
Some of the doc files say "SparkSQL" but the collect spelling is "Spark 
SQL" (need a white space between "Spark" and "SQL").
Lets's replace it with the collect one.


### What type of PR is it?
[Bug Fix | Improvement | Feature | Documentation | Hot Fix | Refactoring]

### Todos
* [ ] - Task

### What is the Jira issue?
* Open an issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN/
* Put link here, and add [ZEPPELIN-*Jira number*] in PR title, eg. 
[ZEPPELIN-533]

### How should this be tested?
Outline the steps to test the PR here.

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sarutak/zeppelin ZEPPELIN-1274

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1271.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1271


commit 14aa2b760c256a3a862342bdca365bcecbea7072
Author: Kousuke Saruta 
Date:   2016-08-03T05:37:28Z

Replaced 'SparkSQL' in docs into 'Spark SQL'




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1274) Write "Spark SQL" in docs rather than "SparkSQL"

2016-08-02 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created ZEPPELIN-1274:


 Summary: Write "Spark SQL" in docs rather than "SparkSQL"
 Key: ZEPPELIN-1274
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1274
 Project: Zeppelin
  Issue Type: Improvement
  Components: documentation
Affects Versions: 0.7.0
Reporter: Kousuke Saruta
Priority: Minor


Some of the doc files say "SparkSQL" but the collect spelling is "Spark SQL" 
(need a white space between "Spark" and "SQL").

Lets's replace it with the collect one.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1263: Small cleanup of zeppelin-server tests

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1263
  
CI failure

```
Results :

Failed tests: 
  ZeppelinSparkClusterTest.sparkRTest:116 expected:<[[1] 3]> but 
was:<[Error in getSparkSession(): SparkSession not initialized


Error in (function (classes, fdef, mtable) : unable to find an 
inherited method for function 'count' for signature 'function'
]>

Tests run: 65, Failures: 1, Errors: 0, Skipped: 0


Fixed in #1259 so rebasing again


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization

2016-08-02 Thread cloverhearts
Github user cloverhearts commented on the issue:

https://github.com/apache/zeppelin/pull/1258
  
@bzz 
I removed the parts which you say.
Thank you.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization

2016-08-02 Thread cloverhearts
Github user cloverhearts commented on the issue:

https://github.com/apache/zeppelin/pull/1258
  
@corneadoug 
I did modification.
Please review for this pr.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1267: [ZEPPELIN-1261] Bug fix in z.show() for matplot...

2016-08-02 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1267


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1248: [ZEPPELIN-1069]Ignore implicit interpreter when user e...

2016-08-02 Thread mwkang
Github user mwkang commented on the issue:

https://github.com/apache/zeppelin/pull/1248
  
I refactor method name.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1266: [ZEPPELIN-1219] Add searching feature to Zeppelin docs...

2016-08-02 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1266
  
@bzz Really appreciate for your all precise comments! Updated several docs 
as you suggested :)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1270: [ZEPPELIN-1273] Use Math.abs to determine if cu...

2016-08-02 Thread prasadwagle
GitHub user prasadwagle opened a pull request:

https://github.com/apache/zeppelin/pull/1270

[ZEPPELIN-1273] Use Math.abs to determine if custom formatter should be 
called for y axis values

### What is this PR for?
Use Math.abs to determine if custom formatter should be called for y axis 
values.


### What type of PR is it?
Bug Fix

### Todos
* [ ] - Task

### What is the Jira issue?
[ZEPPELIN-1273] https://issues.apache.org/jira/browse/ZEPPELIN-1273

### How should this be tested?
Create simple table with two columns - date in one and large negative 
numbers like -1000 in other. Display line chart and see that the y axis 
values are formatted like -10M.

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? 
No
* Is there breaking changes for older versions?
No
* Does this needs documentation?
No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/prasadwagle/incubator-zeppelin ZEPPELIN-1273

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1270.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1270


commit 06e12f88e3d39f6b090ad8c9fc346491f9e79908
Author: Prasad Wagle 
Date:   2016-08-03T03:57:13Z

Use Math.abs to determine if custom formatter should be called for y axis 
values




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1273) d3.format not called for large negative numbers

2016-08-02 Thread Prasad Wagle (JIRA)
Prasad Wagle created ZEPPELIN-1273:
--

 Summary: d3.format not called for large negative numbers
 Key: ZEPPELIN-1273
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1273
 Project: Zeppelin
  Issue Type: Bug
  Components: front-end
Reporter: Prasad Wagle
Assignee: Prasad Wagle
Priority: Minor






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1207: [DOC][ZEPPELIN-1209] Remove a useless sentence about d...

2016-08-02 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1207
  
CI build failure is irrelevant with this PR i think. Can this be merged 
then?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1268: minor doc fix for r.md

2016-08-02 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1268


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1259: [ZEPPELIN-1260] R interpreter doesn't work with...

2016-08-02 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1259


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1268: minor doc fix for r.md

2016-08-02 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1268
  
@zjffdu you have good eyes :) Looks good.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1267: [ZEPPELIN-1261] Bug fix in z.show() for matplotlib gra...

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1267
  
 Sounds great! Apparently CI failure has been addressed in #1259 as well


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #932: Replace CXF with Jersey2 [ZEPPELIN-903]

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/932
  
A quick search over JIRA suggests that the failure you reffer was taked 
care of in [ZEPPELIN-1264](https://issues.apache.org/jira/browse/ZEPPELIN-1264) 
and is resolved in latest master, please rebase.


In PR body 

> Does the licenses files need update? N

I think it does

@echarles all transitive dependencies lie `woodstox` and 
`org.glassfish.jersey.bundles` and `javax.validation`, etc  will be included in 
convenience binary for release so each of them must be as well included in 
`zeppelin-distribution/src/bin-license/LICENSE` according to their license. 
Could you please double check that?



>Jersey2 can better manage the JSON bodies and mappings.

Could you please elaborate on that part? People might not be very familiar 
with it very well, so if you could put the benefits of such change in PR 
description - that would help a lot.

Thank you!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1272) Zeppelin spark innterpreters throws java.lang.StackOverflowError after running a while

2016-08-02 Thread lichenglin (JIRA)
lichenglin created ZEPPELIN-1272:


 Summary: Zeppelin spark innterpreters throws 
java.lang.StackOverflowError after running a while
 Key: ZEPPELIN-1272
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1272
 Project: Zeppelin
  Issue Type: Bug
  Components: Interpreters
Affects Versions: 0.6.0
Reporter: lichenglin


I'm using Zeppelin  to run some spark job with crontab.

But In the last days,I found Zeppelin's spark interpreter shut down almost 
every day once or more.

And here is the log 
{code}
java.lang.StackOverflowError
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4183)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4197)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
at scala.reflect.internal.Types$Type.asSeenFrom(Types.scala:754)
at scala.reflect.internal.Types$Type.computeMemberType(Types.scala:788)
at 
scala.reflect.internal.Symbols$MethodSymbol.typeAsMemberOf(Symbols.scala:2655)
at scala.reflect.internal.Types$Type.memberType(Types.scala:779)
at 
scala.reflect.internal.Types$class.defineUnderlyingOfSingleType(Types.scala:1534)
at 
scala.reflect.internal.SymbolTable.defineUnderlyingOfSingleType(SymbolTable.scala:13)
at scala.reflect.internal.Types$SingleType.underlying(Types.scala:1486)
at scala.reflect.internal.Types$SingletonType.widen(Types.scala:1340)
at 
scala.reflect.internal.Types$AsSeenFromMap.toPrefix$1(Types.scala:4541)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4556)
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4183)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4197)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
at scala.reflect.internal.Types$Type.asSeenFrom(Types.scala:754)
at scala.reflect.internal.Types$Type.computeMemberType(Types.scala:788)
at 
scala.reflect.internal.Symbols$MethodSymbol.typeAsMemberOf(Symbols.scala:2655)
at scala.reflect.internal.Types$Type.memberType(Types.scala:779)
at 
scala.reflect.internal.Types$class.defineUnderlyingOfSingleType(Types.scala:1534)
at 
scala.reflect.internal.SymbolTable.defineUnderlyingOfSingleType(SymbolTable.scala:13)
at scala.reflect.internal.Types$SingleType.underlying(Types.scala:1486)
at scala.reflect.internal.Types$SingletonType.widen(Types.scala:1340)
at 
scala.reflect.internal.Types$AsSeenFromMap.toPrefix$1(Types.scala:4541)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4556)
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4183)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4197)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4638)
at scala.reflect.internal.Types$Type.asSeenFrom(Types.scala:754)
at scala.reflect.internal.Types$Type.computeMemberType(Types.scala:788)
at 
scala.reflect.internal.Symbols$MethodSymbol.typeAsMemberOf(Symbols.scala:2655)
at scala.reflect.internal.Types$Type.memberType(Types.scala:779)
at 
scala.reflect.internal.Types$class.defineUnderlyingOfSingleType(Types.scala:1534)
at 
scala.reflect.internal.SymbolTable.defineUnderlyingOfSingleType(SymbolTable.scala:13)
at scala.reflect.internal.Types$SingleType.underlying(Types.scala:1486)
at scala.reflect.internal.Types$SingletonType.widen(Types.scala:1340)
at 
scala.reflect.internal.Types$AsSeenFromMap.toPrefix$1(Types.scala:4541)
at scala.reflect.internal.Types$AsSeenFromMap.apply(Types.scala:4556)
at scala.reflect.internal.Types$TypeMap.mapOver(Types.scala:4183)

{code}

It was a very very long log, seems to be a loop

I have adjust the env like this
{code}
export JAVA_HOME=/home/hadoop/jdk
export MASTER=spark://namenode:7077 
export ZEPPELIN_PORT=10001
export SPARK_HOME=/home/hadoop/spark-1.6.2-bin-hadoop2.6
export SPARK_SUBMIT_OPTIONS="--driver-memory 2g --executor-memory 5g 
--driver-class-path 

[GitHub] zeppelin issue #1266: [ZEPPELIN-1219] Add searching feature to Zeppelin docs...

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1266
  
Great improvement @AhyoungRyu ! Posted few suggestions above.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1263: Small cleanup of zeppelin-server tests

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1263
  
CI failed due to 
[ZEPPELIN-1264](https://issues.apache.org/jira/browse/ZEPPELIN-1264)

Rebasing on latest master and merging, if there is no further discusison


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1267: [ZEPPELIN-1261] Bug fix in z.show() for matplotlib gra...

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1267
  
Looks great to me, thank you @bustios !

Merging to master if there is no further discussion


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1269: ZEPPELIN-1270. Remove getting SQLContext from SparkSes...

2016-08-02 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1269
  
\cc @Leemoonsoo  Please help review, thanks


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1269: ZEPPELIN-1270. Remove getting SQLContext from S...

2016-08-02 Thread zjffdu
GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/1269

ZEPPELIN-1270. Remove getting SQLContext from SparkSession.wrapped()

### What is this PR for?
SparkSession.wrapped is only for spark 2.0 preview, it is not supported in 
spark 2.0 release. So I think we can remove that piece of code. Otherwise we 
will get the following error in log which might be a little confusing.
```
08:05:44,946 - Thread(pool-2-thread-3) - (Utils.java:40) - 
org.apache.spark.sql.SparkSession.wrapped()
java.lang.NoSuchMethodException: org.apache.spark.sql.SparkSession.wrapped()
at java.lang.Class.getMethod(Class.java:1786)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
```


### What type of PR is it?
[Improvement]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1270

### How should this be tested?
Check the log and the above error is gone. 

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-1270

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1269.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1269


commit 4401561ca852654fecc0affa5617816517402641
Author: Jeff Zhang 
Date:   2016-08-03T00:20:03Z

ZEPPELIN-1270. Remove getting SQLContext from SparkSession.wrapped()




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1270) Remove getting SQLContext from SparkSession.wrapped()

2016-08-02 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-1270:


 Summary: Remove getting SQLContext from SparkSession.wrapped()
 Key: ZEPPELIN-1270
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1270
 Project: Zeppelin
  Issue Type: Improvement
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Assignee: Jeff Zhang
Priority: Minor


SparkSession.wrapped is only for spark 2.0 preview, it is not supported in 
spark 2.0 release. So I think we can remove that piece of code. Otherwise we 
will get the following error in log which might be a little confusing.

{noformat}
08:05:44,946 - Thread(pool-2-thread-3) - (Utils.java:40) - 
org.apache.spark.sql.SparkSession.wrapped()
java.lang.NoSuchMethodException: org.apache.spark.sql.SparkSession.wrapped()
at java.lang.Class.getMethod(Class.java:1786)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:38)
at org.apache.zeppelin.spark.Utils.invokeMethod(Utils.java:33)
at 
org.apache.zeppelin.spark.SparkInterpreter.getSQLContext_2(SparkInterpreter.java:241)
at 
org.apache.zeppelin.spark.SparkInterpreter.getSQLContext(SparkInterpreter.java:229)
at 
org.apache.zeppelin.spark.SparkInterpreter.open(SparkInterpreter.java:744)
at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at 
org.apache.zeppelin.spark.SparkRInterpreter.getSparkInterpreter(SparkRInterpreter.java:188)
at 
org.apache.zeppelin.spark.SparkRInterpreter.open(SparkRInterpreter.java:72)
at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:93)
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:383)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1268: minor doc fix for r.md

2016-08-02 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1268
  
@AhyoungRyu  Please help review. Thanks


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1260: ZEPPELIN-1267. PySparkInterpreter doesn't work in spar...

2016-08-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1260
  
Looks good to me.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1267: [ZEPPELIN-1261] Bug fix in z.show() for matplot...

2016-08-02 Thread bustios
GitHub user bustios opened a pull request:

https://github.com/apache/zeppelin/pull/1267

[ZEPPELIN-1261] Bug fix in z.show() for matplotlib graphs

### What is this PR for?
Bug fix in z.show() for matplotlib graphs and code refactoring

### What type of PR is it?
Bug Fix

### What is the Jira issue?
[ZEPPELIN-1261](https://issues.apache.org/jira/browse/ZEPPELIN-1261)

### How should this be tested?
```
%python
import matplotlib.pyplot as plt

x = [1,2,3,4,5]
y = [6,7,8,9,0]

plt.plot(x, y, marker="o")
z.show(plt, height="20em")
plt.close()
```
```
%python
import matplotlib.pyplot as plt

x = [1,2,3,4,5]
y = [6,7,8,9,0]

plt.plot(x, y, marker="o")
z.show(plt, height="300px")
plt.close()
```

### Screenshots (if appropriate)

![plot](https://dl.dropboxusercontent.com/u/20947972/z.show.height.example.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bustios/zeppelin ZEPPELIN-1261

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1267.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1267


commit 3e0ef22121d3858206f9af1787bf79108f9f2ed6
Author: Paul Bustios 
Date:   2016-08-02T20:55:56Z

Bug fix in show_matplotlib




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1259: [ZEPPELIN-1260] R interpreter doesn't work with Spark ...

2016-08-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1259
  
Merge it into master and branch-0.6 if there're no more discussion


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure wi...

2016-08-02 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1261


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...

2016-08-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1261
  
Merge it into master and branch-0.6 as a hotfix


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1266: [ZEPPELIN-1219] Add searching feature to Zeppel...

2016-08-02 Thread AhyoungRyu
GitHub user AhyoungRyu opened a pull request:

https://github.com/apache/zeppelin/pull/1266

[ZEPPELIN-1219] Add searching feature to Zeppelin docs site

### What is this PR for?
As more and more document pages are added, it's really hard to find 
specific pages. So I added searching feature to Zeppelin documentation 
site([jekyll](https://jekyllrb.com/) based site) using 
[lunr.js](http://lunrjs.com/).

 - **How it works?**
  
  I created 
[`search_data.json`](https://github.com/AhyoungRyu/zeppelin/blob/6e02423f541cc406e4e41031629609a276a9f481/docs/search_data.json)
 which is used for docs info template. `lunr.js` combines all of the text from 
all of the docs in `docs/` into `_site/search_data.json`. It looks like below.
![screen shot 2016-08-03 at 4 49 59 
am](https://cloud.githubusercontent.com/assets/10060731/17342828/f2908be8-5935-11e6-8eee-b189677c0531.png)
All the info are comes from [Jekyll YAML front 
matter](https://jekyllrb.com/docs/frontmatter/) variables. (i.e. title, group, 
description.. that's why I rewrote all docs' title and description.)
Using this data, 
[search.js](https://github.com/AhyoungRyu/zeppelin/blob/6e02423f541cc406e4e41031629609a276a9f481/docs/assets/themes/zeppelin/js/search.js)
 will do this job!

### What type of PR is it?
Improvement & Feature

### Todos
* [x] - Keep consistency for all docs pages' `Title`
* [x] - Add some overview sentences to all docs pages' `Description` 
section (this will be used as the result preview)
* [x] - Add apache license header to all docs page (some pages are missing 
the license header currently)
* [x] - Add LICENSE for `lunr.min.js`

### What is the Jira issue?
[ZEPPELIN-1219](https://issues.apache.org/jira/browse/ZEPPELIN-1219)

### How should this be tested?
1. Build docs site -> please see 
[docs/README.md#build-documentation](https://github.com/apache/zeppelin/tree/master/docs#build-documentation)
2. Click `search` icon in navbar and go to `search.html` page
3. Type anything you want to search in the search bar (i.e. type `python`, 
`spark`, `dynamic` ... )

### Screenshots (if appropriate)
https://cloud.githubusercontent.com/assets/10060731/17343202/71185300-5937-11e6-9e57-687bf2839cfb.png;>


![search](https://cloud.githubusercontent.com/assets/10060731/17343154/3df052f2-5937-11e6-950a-ba922576914d.gif)

### Questions:
* Does the licenses files need update? Yes, for `lunr.min.js`
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/AhyoungRyu/zeppelin ZEPPELIN-1219

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1266.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1266


commit 881a6b036e70bfb05f12c8a633f10c873508de9d
Author: AhyoungRyu 
Date:   2016-08-02T19:11:27Z

Add js files: lunr.min.js & search.js

commit d261a63a7581ed0cc7ca3d78c46ae4b074a17ba7
Author: AhyoungRyu 
Date:   2016-08-02T19:13:25Z

Add template for storing docs info based on jekyll front matter

commit 495d6c420d975653f48926e055cc299e043daaa8
Author: AhyoungRyu 
Date:   2016-08-02T19:16:27Z

Keep consistency all docs' front matter for the right search result

commit 09e023d86cfc48794f3df53529266f8fd6e65832
Author: AhyoungRyu 
Date:   2016-08-02T19:16:51Z

Add search icon to navbar

commit d55ce76f310634298c5605f8b5a9ff2e1f3dcd6c
Author: AhyoungRyu 
Date:   2016-08-02T19:17:08Z

Add searching page

commit d24c536f67c597db77751cbb383d113916bf769e
Author: AhyoungRyu 
Date:   2016-08-02T19:19:02Z

Attach 'Apache Zeppelin ZEPPELIN_VERSION Documentation: ' to title

commit 6e02423f541cc406e4e41031629609a276a9f481
Author: AhyoungRyu 
Date:   2016-08-02T19:20:03Z

Apply css style for the search results

commit 0f3457d8c4aaebe4419f68c48a6422494d54a2d2
Author: AhyoungRyu 
Date:   2016-08-02T20:12:11Z

Add lunr.min.js license info

commit e6ab4b7a424f6681001eb14dffad9bdae4b2e03d
Author: AhyoungRyu 
Date:   2016-08-02T20:12:42Z

Exclude lunr.min.js




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1259: [ZEPPELIN-1260] R interpreter doesn't work with Spark ...

2016-08-02 Thread echarles
Github user echarles commented on the issue:

https://github.com/apache/zeppelin/pull/1259
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #932: Replace CXF with Jersey2 [ZEPPELIN-903]

2016-08-02 Thread echarles
Github user echarles commented on the issue:

https://github.com/apache/zeppelin/pull/932
  
Failing with 

org.apache.zeppelin.interpreter.InterpreterException: 
org.apache.thrift.TApplicationException: Internal error processing 
createInterpreter
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:238)

Is this a WKZCIF (Well Know Zeppelin CI Failure) ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1265: [ZEPPELIN-1210] Run interpreter per user

2016-08-02 Thread echarles
Github user echarles commented on the issue:

https://github.com/apache/zeppelin/pull/1265
  
Quickly went through the changes, but not sure to get it.
In which way is this related to the various intepreter modes we already 
have?
In which way is this related to ZEPPELIN-1000 (Multiple simultaneous users 
on a single WEB server)?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1247: ZEPPELIN-1254 Make get and save Interpreter bindings c...

2016-08-02 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1247
  
LGTM!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #928: [ZEPPELIN-116] Add Apache Mahout Interpreter

2016-08-02 Thread rawkintrevo
Github user rawkintrevo commented on the issue:

https://github.com/apache/zeppelin/pull/928
  
[Build 6281](https://travis-ci.org/apache/zeppelin/builds/149199571)

Profiles 
[1](https://s3.amazonaws.com/archive.travis-ci.org/jobs/149199572/log.txt), 
[2](https://s3.amazonaws.com/archive.travis-ci.org/jobs/149199574/log.txt), and 
[3](https://travis-ci.org/apache/zeppelin/jobs/149199575):

All stalled a la 
[ZEPPELIN-862](https://issues.apache.org/jira/browse/ZEPPELIN-862?jql=project%20%3D%20ZEPPELIN%20AND%20status%20in%20(Open%2C%20%22In%20Progress%22%2C%20Reopened)%20AND%20labels%20%3D%20flaky-test)



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #928: [ZEPPELIN-116] Add Apache Mahout Interpreter

2016-08-02 Thread rawkintrevo
GitHub user rawkintrevo reopened a pull request:

https://github.com/apache/zeppelin/pull/928

[ZEPPELIN-116] Add Apache Mahout Interpreter

### What is this PR for?
This PR adds Mahout functionality for the Spark Interpreter.


### What type of PR is it?
Improvement 

### Todos
- [x] Implement Mahout Interpreter in Spark
- [x] Add Unit Tests
- [x] Add Documentation
- [x] Add Example Notebook

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-116

### How should this be tested?
Open a Spark Notebook with Mahout enabled and run a few simple commands 
using the R-Like DSL and Spark Distributed Context (Mahout Specific)

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update?
No
* Is there breaking changes for older versions?
No
* Does this needs documentation?
Yes



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/rawkintrevo/incubator-zeppelin mahout-terp

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/928.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #928


commit af935152ce0b70578317ad0f629fd7cf7043f9e0
Author: Trevor Grant 
Date:   2016-06-08T17:05:25Z

[ZEPPELIN-116] Add Mahout Interpreter




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #928: [ZEPPELIN-116] Add Apache Mahout Interpreter

2016-08-02 Thread rawkintrevo
Github user rawkintrevo closed the pull request at:

https://github.com/apache/zeppelin/pull/928


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1264: Updated path to point to latest Maven binaries

2016-08-02 Thread jojurajan
GitHub user jojurajan opened a pull request:

https://github.com/apache/zeppelin/pull/1264

Updated path to point to latest Maven binaries

### What is this PR for?
To update link of Maven binary provided in the installation steps.

### What type of PR is it?
[Documentation]

### Todos
NA

### What is the Jira issue?
NA

### How should this be tested?
By running the following commands
```
wget 
http://www.eu.apache.org/dist/maven/maven-3/3.3.9/binaries/apache-maven-3.3.9-bin.tar.gz
sudo tar -zxf apache-maven-3.3.9-bin.tar.gz -C /usr/local/
sudo ln -s /usr/local/apache-maven-3.3.9/bin/mvn /usr/local/bin/mvn

# Build using latest mvn
mvn clean package -Pspark-1.6 -Phadoop-2.4 -Pyarn -Ppyspark -DskipTests
```

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jojurajan/zeppelin jojurajan-maven-link-patch

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1264.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1264


commit 0a4853f1a56c1bf108ec5a9e19111708ae649194
Author: Joju Rajan 
Date:   2016-08-02T06:56:48Z

Updated path to latest Maven binaries




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1261
  
Have created 
[ZEPPELIN-1269](https://issues.apache.org/jira/browse/ZEPPELIN-1269)

LGTM



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1259: [ZEPPELIN-1260] R interpreter doesn't work with Spark ...

2016-08-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1259
  
Thanks @echarles for the review. I have exposed sqlContext as well


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1262: [ZEPPELIN-1268]

2016-08-02 Thread corneadoug
Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1262
  
@kavinkumarks Thanks for the contribution, the Paragraph ID is actually 
already shown in the UI

https://github.com/apache/zeppelin/blob/master/zeppelin-web/src/app/notebook/paragraph/paragraph-control.html#L43



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1239: [HOTFIX][ZEPPELIN-1240] Removed interpreter properties...

2016-08-02 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1239
  
@Leemoonsoo @minahlee Could you please test it?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1262: [ZEPPELIN-1268]

2016-08-02 Thread kavinkumarks
GitHub user kavinkumarks opened a pull request:

https://github.com/apache/zeppelin/pull/1262

[ZEPPELIN-1268]

### What is this PR for?
This pull request is to add the below options so when someone develops a 
custom UI it would ease them.
1. Add a new option "Get paragraph id" in the notebook UI
2. Add a new REST API to get the status of a single paragraph

### What type of PR is it?
Improvement

### Todos
* Need to update the REST APIs documentation 
http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/rest-api/rest-notebook.html#get-the-status-of-all-paragraphs

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1268

### How should this be tested?
* Navigate to the notebook UI and a new option "Get paragraph id" will be 
shown for each paragraph and on clicking on it, the paragraph id would be 
alerted
* The new REST API 
http://%5Bzeppelin-server%5D:%5Bzeppelin-port%5D/api/notebook/job/%5BnotebookId%5D/%5BparagraphId%5D
 could be accessed to get the status of a single paragraph.

### Screenshots (if appropriate)

### Questions:

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/kavinkumarks/zeppelin zeppelin-1268-custom-UI

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1262.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1262


commit a449992256d8badf72a412ccc0e3134873d5db31
Author: Kavin 
Date:   2016-08-02T11:07:35Z

Changes to show new option to get paragraph id in notebook UI and new REST 
API to get status of a single paragraph




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1259: [ZEPPELIN-1260] R interpreter doesn't work with Spark ...

2016-08-02 Thread echarles
Github user echarles commented on the issue:

https://github.com/apache/zeppelin/pull/1259
  
@minahlee Just saw you comment on ZEPPELIN-1260, but @Leemoonsoo has been 
fast...

I have tested the changes, and now sparkr dataframes are working well (with 
the `spark` variable which referts to the new Spark2 session).

The R tutorial note refers to sqlContext which is no more present

```
Error in dispatchFunc("createDataFrame(data, schema = NULL, samplingRatio = 
1.0)", : object 'sqlContext' not found
```

Patch could also expose sqlContext.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...

2016-08-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1261
  
@bzz I see the same error on my local test. However somehow travis does not 
have the error.
Anyway, do you mind file a new issue for the new error?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization

2016-08-02 Thread corneadoug
Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1258
  
I would limit this PR to the first commit, for me the rest is out of scope.
Also, in the first PR, there is no need to make a if before calling 
`setParagraphMode`, the conditions you added is already at the beginning of the 
function.

`$scope.setParagraphMode` can also be changed to `var setParagraphMode`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1234: [ZEPPELIN-1234] Fix for bug ZEPPELIN-1234

2016-08-02 Thread SachinJanani
Github user SachinJanani commented on the issue:

https://github.com/apache/zeppelin/pull/1234
  
Travis checks are failing but are not related to this changes.@jongyoul Can 
you please have a look. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1261
  
Have updated the comment, you might need to reload the page


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1261
  
Local build results are - it hangs for last 4 minutes with the error below

```
20:56:59,101  INFO org.apache.zeppelin.notebook.Paragraph:282 - run 
paragraph 20160802-205659_1961452200 using null 
org.apache.zeppelin.interpreter.LazyOpenInterpreter@747b96ad
20:56:59,105 ERROR org.apache.zeppelin.scheduler.Job:189 - Job failed
org.apache.zeppelin.interpreter.InterpreterException: 
java.lang.NullPointerException
at 
org.apache.zeppelin.interpreter.dev.DevInterpreter.interpret(DevInterpreter.java:88)
at 
org.apache.zeppelin.interpreter.ClassloaderInterpreter.interpret(ClassloaderInterpreter.java:58)
at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
at org.apache.zeppelin.notebook.Paragraph.jobRun(Paragraph.java:309)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at 
org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
Caused by: java.lang.NullPointerException
at 
org.apache.zeppelin.interpreter.dev.DevInterpreter.interpret(DevInterpreter.java:86)
... 12 more
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...

2016-08-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1261
  
Not sure why CI is not triggered in this PR.
Here's CI result with my travis account 
https://travis-ci.org/Leemoonsoo/zeppelin/builds/149153003

CI is not green yet, but at least ZEPPELIN-1264 is resolved.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #932: Replace CXF with Jersey2 [ZEPPELIN-903]

2016-08-02 Thread echarles
Github user echarles commented on the issue:

https://github.com/apache/zeppelin/pull/932
  
@Leemoonsoo  Just pushed the asked changes regarding licenses.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure wi...

2016-08-02 Thread Leemoonsoo
Github user Leemoonsoo closed the pull request at:

https://github.com/apache/zeppelin/pull/1261


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Fail...

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1261
  
CI seems to not beeing triggered on this branch :\

Trying locally with `time mvn package -pl "\!zeppelin-distribution"`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1248: [ZEPPELIN-1069]Ignore implicit interpreter when user e...

2016-08-02 Thread astroshim
Github user astroshim commented on the issue:

https://github.com/apache/zeppelin/pull/1248
  
tested. LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1261: [ZEPPELIN-1264] [HOTFIX] Fix CI test failure wi...

2016-08-02 Thread Leemoonsoo
GitHub user Leemoonsoo opened a pull request:

https://github.com/apache/zeppelin/pull/1261

[ZEPPELIN-1264] [HOTFIX] Fix CI test failure with Failed to create 
interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA

### What is this PR for?
Fix CI test failure with error 

```
14:05:27,226 ERROR 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter:237 - Failed to create 
interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA
14:05:27,227 ERROR 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter:264 - Failed to 
initialize interpreter: 
org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA. Remove it from 
interpreterGroup
14:05:27,240  INFO org.apache.zeppelin.scheduler.SchedulerFactory:131 - Job 
jobName1 started by scheduler test
14:05:27,240  INFO 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter:223 - Create remote 
interpreter org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA
14:05:27,242 ERROR 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter:237 - Failed to create 
interpreter: org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA
14:05:27,243 ERROR org.apache.zeppelin.scheduler.Job:189 - Job failed
org.apache.zeppelin.interpreter.InterpreterException: 
org.apache.thrift.TApplicationException: Internal error processing 
createInterpreter
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:238)
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.getFormType(RemoteInterpreter.java:383)
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.interpret(RemoteInterpreter.java:299)
at 
org.apache.zeppelin.scheduler.RemoteSchedulerTest$2.jobRun(RemoteSchedulerTest.java:210)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at 
org.apache.zeppelin.scheduler.RemoteScheduler$JobRunner.run(RemoteScheduler.java:329)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.thrift.TApplicationException: Internal error 
processing createInterpreter
at 
org.apache.thrift.TApplicationException.read(TApplicationException.java:111)
at org.apache.thrift.TServiceClient.receiveBase(TServiceClient.java:71)
at 
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.recv_createInterpreter(RemoteInterpreterService.java:196)
at 
org.apache.zeppelin.interpreter.thrift.RemoteInterpreterService$Client.createInterpreter(RemoteInterpreterService.java:180)
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter.init(RemoteInterpreter.java:227)
... 12 more
```

Some unittest launches remote interpreter process for the test with some 
mock interpreter implementation. So mock interpreter class in the test should 
be available for interpreter's classpath for the test.


### What type of PR is it?
Hot Fix

### Todos
* [x] - Add necessary test-classes directory in interpreter process's 
classpath

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1264

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no

…/test-classes in classpath of interpreter

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Leemoonsoo/zeppelin ZEPPELIN-1264

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1261.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1261


commit 10ad928c79bc2ade26e6cdee58aa4e35ff4fda61
Author: Lee moon soo 
Date:   2016-08-02T11:38:45Z

Add zeppelin-interpreter/target/test-classes, 
zeppelin-zengine/target/test-classes in classpath of interpreter




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1259: [ZEPPELIN-1260] R interpreter doesn't work with Spark ...

2016-08-02 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1259
  
@bzz Thanks for quick review. Updated the indent.
This should be merged to branch-0.6 as well


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1227: [ZEPPELIN-1198][Spark Standalone] Documents for runnin...

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1227
  
Looks great to me! Merging if there is no further discussion.

> Does this needs documentation? no

I think it does ;)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1255: Adding extra libraries to livy

2016-08-02 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1255
  
You can use --conf spark.jars= and --conf 
spark.jars.packages= instead 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1255: Adding extra libraries to livy

2016-08-02 Thread mfelgamal
Github user mfelgamal commented on the issue:

https://github.com/apache/zeppelin/pull/1255
  
I think that the livy itself doesn't support add  (--jars/--packages 
property in spark-submit)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1231: [Zeppelin - 683][WIP] BittorrentNotebookRepo

2016-08-02 Thread onkarshedge
Github user onkarshedge commented on the issue:

https://github.com/apache/zeppelin/pull/1231
  
@bzz . I will post a diagram of communication for clear view.
`BittorrentNotebookRepo` does not implement/override any `NotebookRepo` 
methods. It uses all VFSNotebookRepo methods.
```java
Note get(String noteId, AuthenticationInfo subject);
List list(AuthenticationInfo subject);
void save(Note note, AuthenticationInfo subject);
```
Only two key methods are
```java
public String shareNote(String noteId); // take the note.json file and 
start seeding, return magnet link
public void download(String magnetLink); // download the files in the 
torrent directory.
```

```
Initial idea the we discussed was that BittorrentNotebookRepo encapsulates 
all the things that are required in order to get notebooks.
```
Could you please elaborate this point. 
Once the design and goal is clear, it will help me implement faster. 
Give me some time I will post a diagram..


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1254: [ZEPPELIN-1257] storage - fix get note revision api

2016-08-02 Thread khalidhuseynov
Github user khalidhuseynov commented on the issue:

https://github.com/apache/zeppelin/pull/1254
  
@bzz i believe we decided not to merge it for now. I'll revise it and let 
you know


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1231: [Zeppelin - 683][WIP] BittorrentNotebookRepo

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1231
  
@onkarshedge on the architecture side - could you please elaborate on the 
design that you choose, especially regarding `TorrentServlet` - why do you need 
a new servlet? What are the parts that communicate to each other? A diagram 
(event ASCI one) would help here.

On the code side - please read the project style guide for Java language 
carefully and make sure you follow the conventions described there.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1231: [Zeppelin - 683][WIP] BittorrentNotebookRepo

2016-08-02 Thread onkarshedge
Github user onkarshedge commented on the issue:

https://github.com/apache/zeppelin/pull/1231
  
@khalidhuseynov  thanks for helping.

To actually see `TorrentSocket` in action I have to create 
a`WebSocketCreator` and a `Servlet`, then add this to jetty server , [at this 
line](https://github.com/apache/zeppelin/blob/6f867ceb0c2b93ecca3be8a16c155547182eb0dc/zeppelin-server/src/main/java/org/apache/zeppelin/server/ZeppelinServer.java#L223)
```java
webApp.addServlet(new ServletHolder("ws-events",new 
TorrentServlet()),"/download");
```
So then should it be like this ...
```java
public class BittorrentNotebookRepo extends VFSNotebookRepo implements 
TorrentEngineListener,
WebSocketCreator {
@Override
public Object createWebSocket(ServletUpgradeRequest servletUpgradeRequest,
 ServletUpgradeResponse servletUpgradeResponse) {
return new TorrentSocket(this);
  }
}
```
And the `TorrentServlet` class
```java
public class TorrentServlet extends WebSocketServlet {
  @Override
  public void configure(WebSocketServletFactory webSocketServletFactory) {
webSocketServletFactory.setCreator(new BittorrentNotebookRepo());
  }
}
```
Here is the problem as I cannot instantiate the BittorrentNotebookRepo here 
, it requires `conf` parameter. Also the NotebookRepos' are instantiated in 
`NotebookRepoSync`. 



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1254: [ZEPPELIN-1257] storage - fix get note revision api

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1254
  
@khalidhuseynov thank you! 
Do you suggest merging this guy now and taking care of Revision separation 
later?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1268) As an enduser, I would like to embed paragraph and refresh the content of it in my custom UI

2016-08-02 Thread Kavin Kumar (JIRA)
Kavin Kumar created ZEPPELIN-1268:
-

 Summary: As an enduser, I would like to embed paragraph and 
refresh the content of it in my custom UI
 Key: ZEPPELIN-1268
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1268
 Project: Zeppelin
  Issue Type: Improvement
  Components: front-end, zeppelin-server, zeppelin-zengine
Reporter: Kavin Kumar


Being an end user of Apache Zeppelin, I would like to add the following 
enhancements to the codebase so that I can embed paragraph and also refresh the 
paragraph content from the custom UI.Note that the custom UI is different from 
the notebook UI and served by a simple js application.Embedding the paragraph 
content and refreshing the content of it in the custom UI are done using the 
Zeppelin REST APIs.

When we analyzed the existing APIs and the notebook UI, we thought that the 
following would be helpful when someone wants to do the same as mentioned above:

* Expose paragraph id as a new option for each paragraph in the notebook UI say 
"Get the paragraph id" so that the end user can easily find it out
* Create a new REST API to find out the status of a single paragraph



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1260: ZEPPELIN-1267. PySparkInterpreter doesn't work in spar...

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1260
  
\cc @jongyoul for review


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1248: [ZEPPELIN-1069]Ignore implicit interpreter when user e...

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1248
  
👍  for having a test!

Looks good to me, modulo the issue raised above.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1260: ZEPPELIN-1267. PySparkInterpreter doesn't work ...

2016-08-02 Thread zjffdu
GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/1260

ZEPPELIN-1267. PySparkInterpreter doesn't work in spark 2.0

### What is this PR for?
PySparkInterpreter doesn't work in spark 2.0 because pyspark and py4j is 
not distributed to executors.  This PR extract the setup staff for pyspark 
interpreter into method setupConfForPySpark and use it for both spark1 and 
spark2. But this is just a short term solution, as I think this should be 
handled by spark rather than zeppelin, here zeppelin duplicate part of spark's 
work. In the long term, I'd like to resolve it in `ZEPPELIN-1263`.


### What type of PR is it?
[Bug Fix]

### Todos
* https://issues.apache.org/jira/browse/ZEPPELIN-1263

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-1267

### How should this be tested?
Verify it manually. 

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-1267

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1260.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1260


commit 81d1d56c94934dd6c4b32144d810626356ce3c0e
Author: Jeff Zhang 
Date:   2016-08-02T09:41:21Z

ZEPPELIN-1267. PySparkInterpreter doesn't work in spark 2.0




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1259: [ZEPPELIN-1260] R interpreter doesn't work with Spark ...

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1259
  
Looks great to me, modulo question above.

Thank you for prompt fix @Leemoonsoo ! 
Shall this be merged to master or branch-0.6 as well? Asking as JIRA fix 
version is not set for this one.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization

2016-08-02 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1258
  
Would it make sense to change `isParagraphSaveAlready` => 
`wasParagraphAlreadySaved` ?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1259: [ZEPPELIN-1260] R interpreter doesn't work with...

2016-08-02 Thread Leemoonsoo
GitHub user Leemoonsoo opened a pull request:

https://github.com/apache/zeppelin/pull/1259

[ZEPPELIN-1260] R interpreter doesn't work with Spark 2.0

### What is this PR for?
This PR fixes R interpreter doesn't work with Spark 2.0


### What type of PR is it?
Bug Fix

### Todos
* [x] - Create and inject SparkSession into SparkRInterpreter

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1260

### How should this be tested?
Run Zeppelin with Spark 2.0 and run following codes and see if it returns 
`[1] 3`
```
%r 
localDF <- data.frame(name=c("a", "b", "c"), age=c(19, 23, 18))
df <- createDataFrame(spark, localDF)
count(df)
```

### Screenshots (if appropriate)

![image](https://cloud.githubusercontent.com/assets/1540981/17324196/fbf3df6c-586a-11e6-896f-68fd86e630e8.png)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Leemoonsoo/zeppelin ZEPPELIN-1260

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1259.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1259


commit 6bd112811d81aa871b077c655fa0980802e3bc71
Author: Lee moon soo 
Date:   2016-08-02T09:30:23Z

Create and inject spark session into sparkr interpreter




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1267) PySparkInterpreter doesn't work in spark 2.0

2016-08-02 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-1267:


 Summary: PySparkInterpreter doesn't work in spark 2.0
 Key: ZEPPELIN-1267
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1267
 Project: Zeppelin
  Issue Type: Bug
  Components: Interpreters
Affects Versions: 0.7.0
Reporter: Jeff Zhang
Assignee: Jeff Zhang


py4j is not distributed to executors. 
{noformat}
Error from python worker:
  /usr/bin/python: No module named pyspark
PYTHONPATH was:
  
/Users/jzhang/Temp/hadoop_tmp/nm-local-dir/usercache/jzhang/filecache/27/__spark_libs__3944184934921201174.zip/spark-core_2.11-2.0.0.jar
{noformat}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin pull request #1258: [ ZEPPELIN-1266 ] Code editor Optimization

2016-08-02 Thread cloverhearts
Github user cloverhearts closed the pull request at:

https://github.com/apache/zeppelin/pull/1258


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1258: [ ZEPPELIN-1266 ] Code editor Optimization

2016-08-02 Thread cloverhearts
Github user cloverhearts commented on the issue:

https://github.com/apache/zeppelin/pull/1258
  
ci trigger.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1258: [ ZEPPELIN-1266 ] Code editor Optimization

2016-08-02 Thread cloverhearts
GitHub user cloverhearts reopened a pull request:

https://github.com/apache/zeppelin/pull/1258

[ ZEPPELIN-1266 ] Code editor Optimization

### What is this PR for?
If the result of many para- graph, the code editor is very slow.

### What type of PR is it?
Improvement

### Todos
- [x] removed call to function in template.
- [x] changed event (aceChange event to ace input event)  

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1266

### How should this be tested?
1. going to r tutorial notebook.
2. write to paragraph on anyway. (many many.. fast.. fast typing.)

### Screenshots (if appropriate)
 Before optimization.

![performance02](https://cloud.githubusercontent.com/assets/10525473/17323111/a1cd9b2e-58db-11e6-8d61-7ab98ea96b3a.gif)

 After optimization.

![performance01](https://cloud.githubusercontent.com/assets/10525473/17323107/a02b5338-58db-11e6-95c8-543aab7131dd.gif)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/cloverhearts/zeppelin dev/aceeditorperformance

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1258.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1258


commit 86ba5c42a6eb9ea9ba22d90c11dbb823e5b81ce2
Author: CloverHearts 
Date:   2016-08-02T07:19:30Z

ace editor performance up

commit 979e2f3a05bdeba14f297d0bcb4e85d1e593424a
Author: CloverHearts 
Date:   2016-08-02T08:20:28Z

ace editor performance up - remove call to template function

commit af5e18f275ebe0850649e7956c1be3673214aaf0
Author: CloverHearts 
Date:   2016-08-02T08:38:09Z

ace editor optimize - get isChange paragraph text value in template




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1258: [ ZEPPELIN-1266 ] Code editor Optimization

2016-08-02 Thread cloverhearts
GitHub user cloverhearts opened a pull request:

https://github.com/apache/zeppelin/pull/1258

[ ZEPPELIN-1266 ] Code editor Optimization

### What is this PR for?
If the result of many para- graph, the code editor is very slow.

### What type of PR is it?
Improvement

### Todos
- [x] removed call to function in template.
- [x] changed event (aceChange event to ace input event)  

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1266

### How should this be tested?
1. going to r tutorial notebook.
2. write to paragraph on anyway. (many many.. fast.. fast typing.)

### Screenshots (if appropriate)
 Before optimization.

![performance02](https://cloud.githubusercontent.com/assets/10525473/17323111/a1cd9b2e-58db-11e6-8d61-7ab98ea96b3a.gif)

 After optimization.

![performance01](https://cloud.githubusercontent.com/assets/10525473/17323107/a02b5338-58db-11e6-95c8-543aab7131dd.gif)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/cloverhearts/zeppelin dev/aceeditorperformance

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1258.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1258


commit 86ba5c42a6eb9ea9ba22d90c11dbb823e5b81ce2
Author: CloverHearts 
Date:   2016-08-02T07:19:30Z

ace editor performance up

commit 979e2f3a05bdeba14f297d0bcb4e85d1e593424a
Author: CloverHearts 
Date:   2016-08-02T08:20:28Z

ace editor performance up - remove call to template function

commit af5e18f275ebe0850649e7956c1be3673214aaf0
Author: CloverHearts 
Date:   2016-08-02T08:38:09Z

ace editor optimize - get isChange paragraph text value in template




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1266) If the result of many paragraph, the code editor is very slow

2016-08-02 Thread CloverHearts (JIRA)
CloverHearts created ZEPPELIN-1266:
--

 Summary: If the result of many paragraph, the code editor is very 
slow
 Key: ZEPPELIN-1266
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1266
 Project: Zeppelin
  Issue Type: Bug
Reporter: CloverHearts
Assignee: CloverHearts


If the result of many paragraph, the code editor is very slow.
for example, writing to r tutorial notebook



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #673: [Zeppelin-630] Introduce new way of dependency loading ...

2016-08-02 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/673
  
Thanks @minahlee, it works. But any reason to make it hidden by default ? 
But it is not intuitive for me that I can click the gear button to display it. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1255: Adding extra libraries to livy

2016-08-02 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1255
  
No, I mean add interpreter property to allow user to specify jars/packages. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1255: Adding extra libraries to livy

2016-08-02 Thread jimdowling
Github user jimdowling commented on the issue:

https://github.com/apache/zeppelin/pull/1255
  
Do you mean by modifying the UI on notebook creation or using a param to 
selecting the interpreter like
 '%livy --jars [path]


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1251: [ZEPPELIN-1256][BUILD] Build distribution package with...

2016-08-02 Thread minahlee
Github user minahlee commented on the issue:

https://github.com/apache/zeppelin/pull/1251
  
@felixcheung I added description 99d91bf for the user who uses Spark 
version earlier than 2.0.0. And planning to add [zeppelin-spark_2.10 
installation 
link](https://github.com/minahlee/zeppelin/blob/99d91bf1a508c5f398cb4775ef5e374245172c37/docs/manual/interpreterinstallation.md#install-spark-interpreter-built-with-scala-2.10)
 in download page too.
What do you think?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1231: [Zeppelin - 683][WIP] BittorrentNotebookRepo

2016-08-02 Thread khalidhuseynov
Github user khalidhuseynov commented on the issue:

https://github.com/apache/zeppelin/pull/1231
  
@onkarshedge thanks for this contribution. as i can see, the design issue 
on passing `BittorrentNotebookRepo` to `TorrentSocket` was solved by passing 
through constructor. also better have torrent websocket message handling 
separate from `NotebookServer` as you did. any other design issues left 
non-mentioned?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1257: [Zeppelin-945] Interpreter authorization

2016-08-02 Thread astroshim
GitHub user astroshim opened a pull request:

https://github.com/apache/zeppelin/pull/1257

[Zeppelin-945] Interpreter authorization

### What is this PR for?
This PR is derived from https://github.com/apache/zeppelin/pull/1223


### What type of PR is it?
Improvement


### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-945


### How should this be tested?
You can change user permission of interpreter at interpreter setting page.


### Screenshots (if appropriate)

![image](https://cloud.githubusercontent.com/assets/3348133/17319553/5bbfcc86-58c9-11e6-86a5-48ece9510811.png)


### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/astroshim/zeppelin ZEPPELIN-945_1

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1257.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1257


commit 407d2603f98743ec9010c6cf16e1a367afbc1a5a
Author: astroshim 
Date:   2016-08-02T05:21:11Z

fit UX




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1265) Value of zeppelin.pyspark.python not reflected the python version Spark executors use on YARN

2016-08-02 Thread Sami Jaktholm (JIRA)
Sami Jaktholm created ZEPPELIN-1265:
---

 Summary: Value of zeppelin.pyspark.python not reflected the python 
version Spark executors use on YARN
 Key: ZEPPELIN-1265
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1265
 Project: Zeppelin
  Issue Type: Bug
Affects Versions: 0.5.6
Reporter: Sami Jaktholm


STR:
0. Have both python2 and python3 installed
1. Set {{zeppelin.pyspark.python}} to {{python3}} (or where your Python 3 is 
installed)
2. Run some pyspark code that involves executing tasks on executor nodes

What happens:
bq. Exception: Python in worker has different version 3.4 than that in driver 
2.7, PySpark cannot run with different minor versions

What should happen: The code runs without exceptions as the value of 
{{zeppelin.pyspark.python}} is correctly propagated to the Spark executors. IMO 
the correct behavior is to use the the value {{zeppelin.pyspark.python}} as the 
Python interpreter with Spark and set {{PYSPARK_PYTHON}} to that same value so 
that Spark can pick it up and ship it to executors.

The problem here is that when {{zeppelin.pyspark.python}} is set to use Python 
3, Zeppelin starts the Spark master process with python3. However, this 
configuration is not reflected on the executors and they use what they can find 
in {{PYSPARK_PYTHON}} envvar, which defaults to Python 2. So changing python 
version also requires setting {{PYSPARK_PYTHON}} to correct value which it not 
easy thing to do on the fly (I guess you need to change a config file somewhere 
and restart Zeppelin to achieve that).

This might only be an issue when running Spark on a YARN cluster with multiple 
machines (as in the selection of python version is not propagated to the 
executor machines) since I haven't tested this in a single machine scenario. 
Also, I haven't been able to test this in Zeppelin 0.6.0 yet so this could 
already be fixed but I didn't find any similar tickets that were resolved after 
Zeppelin 0.5.6.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)