[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-19 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1404 @zjffdu Thanks for great work! CI failure looks irrelevant. Merge into master and branch-0.6 if there're no more discussions. --- If your project is set up for it, you can reply to this em

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-18 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1404 @Leemoonsoo Finally got the unit test passed (The remaining one failure is irrelevant). Actually the test failure is caused by several bugs of `SparkInterpreter`. Here's the steps to repr

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-14 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1404 @Leemoonsoo The test is passed in my local box both under spark 1.6.2 and spark 2.0. Not sure why the travis CI fails, Is it possible for us to access the --- If your project is set up for it,

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-13 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1404 Thanks @zjffdu. I think second ci test profile failure looks relevant. ``` ests run: 6, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 120.231 sec <<< FAILURE! - in org.apache.ze

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-13 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1404 @Leemoonsoo , I updated the unit test. And also made a little change `AbstractTestRestApi`, the standalone way doesn't work for me. So I allow user to export `SPAKP_MASTER` to run it in other modes

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-12 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1404 @zjffdu Right, it looks like AbstractTestRestApi need to be improved when CI is not defined. So far, i think you can try download and run spark standalone cluster in this way ```

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-12 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1404 @Leemoonsoo , I follow the above command, but seems it doesn't work. I check `AbstractTestRestApi`, It seems pyspark related job would only run either in travis CI or set in spark standalone with S

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-09 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1404 @zjffdu Once you build zeppelin, ``` mvn package [your profiles] -DskipTests ``` Then you can run this test, like ``` mvn package -pl 'zeppelin-interpreter,

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-08 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1404 @Leemoonsoo Can you guide me how to run this test ? I try to run it using maven, but fails, seems it depends on something. --- If your project is set up for it, you can reply to this email and h

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-08 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1404 I tested this branch with given example, but it doesn't work for me. On my machine, it hangs on `sqlContext.createDataFrame()` and end up with errors like ``` kqueue: Too many o

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-08 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue: https://github.com/apache/zeppelin/pull/1404 Thanks @zjffdu for the contribution. Actually, we do have some tests for pyspark already. Please see https://github.com/apache/zeppelin/blob/master/zeppelin-server/src/test/java/org/ap

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-08 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1404 could you kick off CI again? Let's merge this after --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-06 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1404 CI failed because of selenium, I think --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featu

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-05 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1404 right. probably another PR, but I think we could use travis' addons support to install python via apt-get https://docs.travis-ci.com/user/installing-dependencies/ as we have for R. ---

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-05 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1404 It guess it is because PythonInterpreter depends on python environment, so there's no test for it yet. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-05 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/zeppelin/pull/1404 LGTM It'll be great to add some test for pyspark interpreter? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] zeppelin issue #1404: ZEPPELIN-1411. UDF with pyspark not working - object h...

2016-09-05 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/1404 \cc @Leemoonsoo Please help review, thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this featur