[GitHub] Leemoonsoo commented on issue #3303: [ZEPPELIN-3989] Configure IPython Interpreter in Docker image

2019-02-07 Thread GitBox
Leemoonsoo commented on issue #3303: [ZEPPELIN-3989] Configure IPython 
Interpreter in Docker image
URL: https://github.com/apache/zeppelin/pull/3303#issuecomment-461571102
 
 
   Ah branch-0.8 already has 
https://github.com/apache/zeppelin/commit/1b6b269d2c2ca4fb648a695d962a3c820807dad3.
 This PR is merged to master only.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] asfgit closed pull request #3303: [ZEPPELIN-3989] Configure IPython Interpreter in Docker image

2019-02-07 Thread GitBox
asfgit closed pull request #3303: [ZEPPELIN-3989] Configure IPython Interpreter 
in Docker image
URL: https://github.com/apache/zeppelin/pull/3303
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] Leemoonsoo commented on issue #3303: [ZEPPELIN-3989] Configure IPython Interpreter in Docker image

2019-02-07 Thread GitBox
Leemoonsoo commented on issue #3303: [ZEPPELIN-3989] Configure IPython 
Interpreter in Docker image
URL: https://github.com/apache/zeppelin/pull/3303#issuecomment-461568824
 
 
   Thanks @felixcheung for the review. Merging to master and branch-0.8


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] Leemoonsoo opened a new pull request #3303: [ZEPPELIN-3989] Configure IPython Interpreter in Docker image

2019-02-04 Thread GitBox
Leemoonsoo opened a new pull request #3303: [ZEPPELIN-3989] Configure IPython 
Interpreter in Docker image
URL: https://github.com/apache/zeppelin/pull/3303
 
 
   ### What is this PR for?
   Configure IPython interpreter in Docker image by installing necessary 
dependencies.
   
   ### What type of PR is it?
   Improvement
   
   ### What is the Jira issue?
   https://issues.apache.org/jira/browse/ZEPPELIN-3989
   
   ### How should this be tested?
   Build docker image and see if %python interpreter works with Ipython kernel.
   
   ### Questions:
   * Does the licenses files need update?  no
   * Is there breaking changes for older versions? no
   * Does this needs documentation? no
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] Leemoonsoo closed pull request #3303: [ZEPPELIN-3989] Configure IPython Interpreter in Docker image

2019-02-04 Thread GitBox
Leemoonsoo closed pull request #3303: [ZEPPELIN-3989] Configure IPython 
Interpreter in Docker image
URL: https://github.com/apache/zeppelin/pull/3303
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


Re: ipython

2019-02-04 Thread tecgie88
Hi

Can ipython server run inside its own docker container?  How does ipython 
server run in Zeppelin container?  Does it run inside the Zeppelin container?

Thanks


[GitHub] Leemoonsoo commented on a change in pull request #3303: [ZEPPELIN-3989] Configure IPython Interpreter in Docker image

2019-02-04 Thread GitBox
Leemoonsoo commented on a change in pull request #3303: [ZEPPELIN-3989] 
Configure IPython Interpreter in Docker image
URL: https://github.com/apache/zeppelin/pull/3303#discussion_r253588410
 
 

 ##
 File path: scripts/docker/zeppelin/bin/Dockerfile
 ##
 @@ -63,12 +63,11 @@ RUN echo "$LOG_TAG Install python related packages" && \
 apt-get install -y gfortran && \
 # numerical/algebra packages
 apt-get install -y libblas-dev libatlas-dev liblapack-dev && \
-# font, image for matplotlib
+# font, image
 apt-get install -y libpng-dev libfreetype6-dev libxft-dev && \
 # for tkinter
 apt-get install -y python-tk libxml2-dev libxslt-dev zlib1g-dev && \
-pip install numpy && \
-pip install matplotlib
+pip install numpy==1.12.1 pandas==0.21.1 matplotlib==2.1.1 pandasql==0.7.3 
ipython==5.4.1 jupyter_client==5.1.0 ipykernel==4.7.0 bokeh==0.12.10 
ggplot==0.11.5 grpcio==1.8.2 bkzep==0.4.0
 
 Review comment:
   This library list came from 
https://github.com/apache/zeppelin/blob/master/testing/install_external_dependencies.sh#L48-L49


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] Leemoonsoo opened a new pull request #3303: [ZEPPELIN-3989] Configure IPython Interpreter in Docker image

2019-02-04 Thread GitBox
Leemoonsoo opened a new pull request #3303: [ZEPPELIN-3989] Configure IPython 
Interpreter in Docker image
URL: https://github.com/apache/zeppelin/pull/3303
 
 
   ### What is this PR for?
   Configure IPython interpreter in Docker image by installing necessary 
dependencies.
   
   ### What type of PR is it?
   Improvement
   
   ### What is the Jira issue?
   https://issues.apache.org/jira/browse/ZEPPELIN-3989
   
   ### How should this be tested?
   Build docker image and see if %python interpreter works with Ipython kernel.
   
   ### Questions:
   * Does the licenses files need update?  no
   * Is there breaking changes for older versions? no
   * Does this needs documentation? no
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Created] (ZEPPELIN-3989) Configure IPython Interpreter in Docker image

2019-02-03 Thread Lee moon soo (JIRA)
Lee moon soo created ZEPPELIN-3989:
--

 Summary: Configure IPython Interpreter in Docker image
 Key: ZEPPELIN-3989
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3989
 Project: Zeppelin
  Issue Type: Task
Affects Versions: 0.8.0
Reporter: Lee moon soo
Assignee: Lee moon soo
 Fix For: 0.8.1


It'll be nice if Zeppelin docker image installs necessary libraries to enable 
IPython Interpreter.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] yx91490 closed pull request #3265: [ZEPPELIN-3910] IPython delete temp file and close stream

2019-01-20 Thread GitBox
yx91490 closed pull request #3265: [ZEPPELIN-3910] IPython delete temp file and 
close stream
URL: https://github.com/apache/zeppelin/pull/3265
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] felixcheung commented on issue #3265: [ZEPPELIN-3910] IPython delete temp file and close stream

2019-01-20 Thread GitBox
felixcheung commented on issue #3265: [ZEPPELIN-3910] IPython delete temp file 
and close stream
URL: https://github.com/apache/zeppelin/pull/3265#issuecomment-455901052
 
 
   you can rewrite log and force push - or it might be easier to open a new PR


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] yx91490 edited a comment on issue #3265: [ZEPPELIN-3910] IPython delete temp file and close stream

2019-01-19 Thread GitBox
yx91490 edited a comment on issue #3265: [ZEPPELIN-3910] IPython delete temp 
file and close stream
URL: https://github.com/apache/zeppelin/pull/3265#issuecomment-455831861
 
 
   > @yx91490 This PR is mixed with other commits.
   
   sorry, It's hard to revert, should I close this and make a new pr?


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] yx91490 commented on issue #3265: [ZEPPELIN-3910] IPython delete temp file and close stream

2019-01-19 Thread GitBox
yx91490 commented on issue #3265: [ZEPPELIN-3910] IPython delete temp file and 
close stream
URL: https://github.com/apache/zeppelin/pull/3265#issuecomment-455831861
 
 
   > @yx91490 This PR is mixed with other commits.
   
   sorry, I try to revert it


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[GitHub] zjffdu commented on issue #3265: [ZEPPELIN-3910] IPython delete temp file and close stream

2019-01-19 Thread GitBox
zjffdu commented on issue #3265: [ZEPPELIN-3910] IPython delete temp file and 
close stream
URL: https://github.com/apache/zeppelin/pull/3265#issuecomment-455780920
 
 
   @yx91490 This PR is mixed with other commits.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services


[jira] [Created] (ZEPPELIN-3951) Enable IPython in Docker

2019-01-16 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-3951:


 Summary: Enable IPython in Docker
 Key: ZEPPELIN-3951
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3951
 Project: Zeppelin
  Issue Type: Bug
Reporter: Jeff Zhang


IPythonInterpreter require some additional libraries installed, it is not 
available in zeppelin docker, this ticket is trying to enable it via installing 
the necessary libraries in zeppelin docker



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zeppelin issue #3265: [ZEPPELIN-3910] IPython delete temp file and close str...

2018-12-19 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/3265
  
LGTM


---


[GitHub] zeppelin issue #3265: [ZEPPELIN-3910] IPython delete temp file and close str...

2018-12-17 Thread yx91490
Github user yx91490 commented on the issue:

https://github.com/apache/zeppelin/pull/3265
  
> can you check failed tests 
https://travis-ci.org/yx91490/zeppelin/builds/468316435

I rebuild it and all test passed.


---


[GitHub] zeppelin issue #3265: [ZEPPELIN-3910] IPython delete temp file and close str...

2018-12-15 Thread felixcheung
Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/3265
  
can you check failed tests 
https://travis-ci.org/yx91490/zeppelin/builds/468316435


---


[GitHub] zeppelin pull request #3084: [zeppelin-3639] Add Ipython interpreter prerequ...

2018-08-02 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/3084


---


[GitHub] zeppelin issue #3084: [zeppelin-3639] Add Ipython interpreter prerequisite c...

2018-07-30 Thread Tagar
Github user Tagar commented on the issue:

https://github.com/apache/zeppelin/pull/3084
  
that makes sense. thanks @khalidhuseynov 


---


[GitHub] zeppelin issue #3084: [zeppelin-3639] Add Ipython interpreter prerequisite c...

2018-07-30 Thread khalidhuseynov
Github user khalidhuseynov commented on the issue:

https://github.com/apache/zeppelin/pull/3084
  
@Tagar thanks for suggestion, but I think it's better not to include this 
check for tornado in this function since it's not really pre-requisite check. 
if we add it, then we need to keep track it, and restore back when the issue 
with tornado is fixed. 


---


[GitHub] zeppelin issue #3084: [zeppelin-3639] Add Ipython interpreter prerequisite c...

2018-07-19 Thread Tagar
Github user Tagar commented on the issue:

https://github.com/apache/zeppelin/pull/3084
  
Would be nice to check freeze output for tornado version.
tornado 5.x is broken for Zeppelin. 
https://issues.apache.org/jira/browse/ZEPPELIN-3505 


---


[GitHub] zeppelin issue #3084: [zeppelin-3639] Add Ipython interpreter prerequisite c...

2018-07-19 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/3084
  
LGTM


---


[GitHub] zeppelin pull request #3084: [zeppelin-3639] Add Ipython interpreter prerequ...

2018-07-19 Thread khalidhuseynov
GitHub user khalidhuseynov opened a pull request:

https://github.com/apache/zeppelin/pull/3084

[zeppelin-3639] Add Ipython interpreter prerequisite check for protobuf

### What is this PR for?
This is to protobuf prerequisite check when starting ipython kernel. This 
is required since from grpcio 1.12.0 it's  independent from protobuf


### What type of PR is it?
[ Improvement ]

### Todos
* [x] - add protobuf prerequisite check
* [x] - add to ipython docs

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-3639

### How should this be tested?
1. remove grpcio and protobuf 
2. install latest grpcio and try to run ipython interpreter - should fail
3. then install protobuf and try again - should work

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/khalidhuseynov/zeppelin fix/ZEPPELIN-3639

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/3084.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3084


commit 58c06898b7d78790f153dfea9912acf1d837a5c8
Author: Khalid Huseynov 
Date:   2018-07-19T06:47:53Z

add protobuf prerequsite check

commit 066e061d25d0066102818eb57a97840cece77ad5
Author: Khalid Huseynov 
Date:   2018-07-19T07:03:58Z

fix ipython documentation




---


[jira] [Created] (ZEPPELIN-3639) Add Ipython interpreter prerequisite check for protobuf

2018-07-19 Thread Khalid Huseynov (JIRA)
Khalid Huseynov created ZEPPELIN-3639:
-

 Summary: Add Ipython interpreter prerequisite check for protobuf
 Key: ZEPPELIN-3639
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3639
 Project: Zeppelin
  Issue Type: Improvement
  Components: Interpreters, python-interpreter
Affects Versions: 0.8.0, 0.9.0
Reporter: Khalid Huseynov


after grpcio 1.12 release [https://github.com/grpc/grpc/releases/tag/v1.12.0] 
it doesn't depend on protobuf, however we need protobuf to communicate with 
ipython kernel. thus we need to add prerequisite check for protobuf when 
starting ipython kernel



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZEPPELIN-3588) Can't run ipython interpreter from docker container

2018-07-06 Thread Thomas Han (JIRA)
Thomas Han created ZEPPELIN-3588:


 Summary: Can't run ipython interpreter from docker container
 Key: ZEPPELIN-3588
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3588
 Project: Zeppelin
  Issue Type: Bug
  Components: Interpreters
Affects Versions: 0.8.0
Reporter: Thomas Han


Startup the docker container

{{docker run -p 8080:8080 --rm --name zeppelin apache/zeppelin:0.8.0}}

Inside the container execute (refer to [this 
page|https://www.zepl.com/viewer/notebooks/bm90ZTovL3pqZmZkdS84YjZmZTAzYmE4ZDc0ODg1OTQ0YWM5MDcwYjYyNzQ0Mi9ub3RlLmpzb24])

{{pip install jupyter }}{{grpcio}}{{}}

Execute

{{%python.ipython}}
{{import sys}}
{{sys?}}

If you look at the logs the ipython kernel can't be instantiated.
{quote}WARN [2018-07-06 05:33:00,389] (\{Exec Default Executor} 
IPythonInterpreter.java[onProcessFailed]:394) - Exception happens in Python 
Process
org.apache.commons.exec.ExecuteException: Process exited with an error: 1 (Exit 
value: 1)
    at 
org.apache.commons.exec.DefaultExecutor.executeInternal(DefaultExecutor.java:404)
    at 
org.apache.commons.exec.DefaultExecutor.access$200(DefaultExecutor.java:48)
    at org.apache.commons.exec.DefaultExecutor$1.run(DefaultExecutor.java:200)
    at java.lang.Thread.run(Thread.java:748)
{quote}
Followed by
{quote}INFO [2018-07-06 06:12:36,904] (\{pool-2-thread-2} 
IPythonInterpreter.java[launchIPythonKernel]:293) - Wait for IPython Kernel to 
be started
 INFO [2018-07-06 06:12:37,005] (\{pool-2-thread-2} 
IPythonInterpreter.java[launchIPythonKernel]:293) - Wait for IPython Kernel to 
be started

...
{quote}
And finally times out
{quote}java.lang.RuntimeException: Fail to open IPythonInterpreter
    at 
org.apache.zeppelin.python.IPythonInterpreter.open(IPythonInterpreter.java:157)
    at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.open(LazyOpenInterpreter.java:69)
    at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:617)
    at org.apache.zeppelin.scheduler.Job.run(Job.java:188)
    at org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:140)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
    at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
    at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Fail to launch IPython Kernel in 60 seconds
    at 
org.apache.zeppelin.python.IPythonInterpreter.launchIPythonKernel(IPythonInterpreter.java:297)
    at 
org.apache.zeppelin.python.IPythonInterpreter.open(IPythonInterpreter.java:154)
    ... 11 more
{quote}
 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZEPPELIN-3530) pyspark interpreter error when using ipython

2018-06-05 Thread zhenhuanli708 (JIRA)
zhenhuanli708 created ZEPPELIN-3530:
---

 Summary: pyspark interpreter error when using ipython
 Key: ZEPPELIN-3530
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3530
 Project: Zeppelin
  Issue Type: Bug
  Components: pySpark
Affects Versions: 0.8.1
Reporter: zhenhuanli708
 Fix For: 0.8.1






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZEPPELIN-3505) IPython interpreter: ERROR:tornado.general:Uncaught exception in ZMQStream callback

2018-05-26 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created ZEPPELIN-3505:
---

 Summary: IPython interpreter: ERROR:tornado.general:Uncaught 
exception in ZMQStream callback
 Key: ZEPPELIN-3505
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3505
 Project: Zeppelin
  Issue Type: Bug
  Components: Interpreters, pySpark, python-interpreter, 
zeppelin-interpreter
Affects Versions: 0.8.0, 0.9.0, 0.8.1
Reporter: Ruslan Dautkhanov


Getting following exceptions in IPython interpreter.. 

ERROR:tornado.general:Uncaught exception in ZMQStream callback 
ValueError: signal only works in main thread
ERROR:tornado.general:Uncaught exception in zmqstream callback
ERROR:tornado.application:Exception in callback 
...
raise RuntimeError("IOLoop is already running")

Complete list of exceptions - 

{noformat}
DEBUG [2018-05-26 10:28:29,453] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output: Traceback (most 
recent call last):
DEBUG [2018-05-26 10:28:29,453] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output:   File 
"/opt/cloudera/parcels/Anaconda/lib/python2.7/runpy.py", line 174, in 
_run_module_as_main
DEBUG [2018-05-26 10:28:29,454] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output: "__main__", 
fname, loader, pkg_name)
DEBUG [2018-05-26 10:28:29,454] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output:   File 
"/opt/cloudera/parcels/Anaconda/lib/python2.7/runpy.py", line 72, in _run_code
DEBUG [2018-05-26 10:28:29,454] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output: exec code in 
run_globals
DEBUG [2018-05-26 10:28:29,454] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output:   File 
"/opt/cloudera/parcels/Anaconda-4.4.0/lib/python2.7/site-packages/ipykernel_launcher.py",
 line 16, in 
DEBUG [2018-05-26 10:28:29,454] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output: 
app.launch_new_instance()
DEBUG [2018-05-26 10:28:29,454] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output:   File 
"/opt/cloudera/parcels/Anaconda/lib/python2.7/site-packages/traitlets/config/application.py",
 line 658, in launch_instance
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output: app.start()
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output: 
ERROR:tornado.general:Uncaught exception in ZMQStream callback
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output: Traceback (most 
recent call last):
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output:   File 
"/opt/cloudera/parcels/Anaconda/lib/python2.7/site-packages/zmq/eventloop/zmqstream.py",
 line 432, in _run_callback
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output: callback(*args, 
**kwargs)
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output:   File 
"/opt/cloudera/parcels/Anaconda/lib/python2.7/site-packages/tornado/stack_context.py",
 line 276, in null_wrapper
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output: return 
fn(*args, **kwargs)
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output:   File 
"/opt/cloudera/parcels/Anaconda/lib/python2.7/site-packages/ipykernel/kernelbase.py",
 line 283, in dispatcher
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output: return 
self.dispatch_shell(stream, msg)
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output:   File 
"/opt/cloudera/parcels/Anaconda/lib/python2.7/site-packages/ipykernel/kernelbase.py",
 line 233, in dispatch_shell
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output: 
self.pre_handler_hook()
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output:   File 
"/opt/cloudera/parcels/Anaconda/lib/python2.7/site-packages/ipykernel/kernelbase.py",
 line 248, in pre_handler_hook
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:411) - Process Output: 
self.saved_sigint_handler = signal(SIGINT, default_int_handler)
DEBUG [2018-05-26 10:28:29,455] ({Exec Stream Pumper} 
IPython

[GitHub] zeppelin issue #2882: ZEPPELIN-3290. Unnecessary message 'IPython is availab...

2018-03-25 Thread felixcheung
Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/2882
  
hey @zjffdu thanks for making all these improvements, could we make sure 
there is at least one review before merging?
@Leemoonsoo 


---


[GitHub] zeppelin pull request #2882: ZEPPELIN-3290. Unnecessary message 'IPython is ...

2018-03-20 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2882


---


[GitHub] zeppelin pull request #2882: ZEPPELIN-3290. Unnecessary message 'IPython is ...

2018-03-20 Thread zjffdu
GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/2882

ZEPPELIN-3290. Unnecessary message 'IPython is available, use IPython for 
PySparkInterpreter'


### What is this PR for?
Trivial PR for removing the unnecessary message


### What type of PR is it?
[Improvement]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3290

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-3290

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2882.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2882


commit 7bf8d6ea423f069fccc8647fab048b7c94c2ab42
Author: Jeff Zhang <zjffdu@...>
Date:   2018-03-20T01:24:20Z

ZEPPELIN-3290. Unnecessary message 'IPython is available, use IPython for 
PySparkInterpreter'




---


[jira] [Created] (ZEPPELIN-3353) Ship IPython prerequisites in PythonInterpreter

2018-03-19 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-3353:


 Summary: Ship IPython prerequisites in PythonInterpreter
 Key: ZEPPELIN-3353
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3353
 Project: Zeppelin
  Issue Type: Improvement
Reporter: Jeff Zhang






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZEPPELIN-3290) Unnecessary message 'IPython is available, use IPython for PySparkInterpreter'

2018-03-04 Thread Andreas Weise (JIRA)
Andreas Weise created ZEPPELIN-3290:
---

 Summary: Unnecessary message 'IPython is available, use IPython 
for PySparkInterpreter'
 Key: ZEPPELIN-3290
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3290
 Project: Zeppelin
  Issue Type: Bug
  Components: pySpark
Affects Versions: 0.8.0, 0.9.0
Reporter: Andreas Weise


When using IPython the following message is printed each and every time an 
IPython interpreter (%python or %pyspark) is started the first time.
{noformat}
IPython is available, use IPython for PySparkInterpreter{noformat}
I would expect to see only a message when ipython is configured but NOT 
working. Of course the error case message already exists, but this positive 
message is kind of annoying.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZEPPELIN-3260) iPython shell (! magic command) doesn't print

2018-02-23 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created ZEPPELIN-3260:
---

 Summary: iPython shell (! magic command) doesn't print
 Key: ZEPPELIN-3260
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3260
 Project: Zeppelin
  Issue Type: Bug
  Components: Core, front-end, pySpark, python-interpreter
Affects Versions: 0.8.0, 0.9.0
Reporter: Ruslan Dautkhanov
 Attachments: image-2018-02-23-10-38-07-304.png

 
{code:java}
%ipyspark
! !echo 1; sleep 1; echo 2
{code}
uses ipython's shell magic command (! - exclamation mark), but in Zeppelin it 
prints just two empty lines:

!image-2018-02-23-10-38-07-304.png!

Should have printed two lines with "1" and "2" in them.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZEPPELIN-3256) ipython backend: capture when backend ipython process dies

2018-02-22 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created ZEPPELIN-3256:
---

 Summary: ipython backend: capture when backend ipython process dies
 Key: ZEPPELIN-3256
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3256
 Project: Zeppelin
  Issue Type: Bug
  Components: Core, pySpark, python-interpreter, zeppelin-interpreter
Affects Versions: 0.7.3, 0.8.0
Reporter: Ruslan Dautkhanov


Using `quit()` in the new ipython interpreter backend leads to ipython backend 
.. exiting, and a new paragraph run gets stuck in 'RUNNING' indefinitely, or at 
least until pySpark interpreter is restarted.

Two suggestions:
 # Ignore `quit()` calls 
 # More importantly - capture when IPython backend process dies (for this any 
other) reason so Spark interpreter would know it has to start a new session, 
and so it would also not show misleading 'RUNNING' state indefinitely on the 
front-end.

First one might be easy to fix using something `def quit(): pass` or something 
as soon as ipython process starts.

But again more importantly it would be great to capture and recognize events 
when ipython process exits or dies for some reason and pass this information up 
to Spark interpreter.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zeppelin pull request #2810: ZEPPELIN-3239. unicode characters in an iPython...

2018-02-20 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2810


---


[GitHub] zeppelin issue #2810: ZEPPELIN-3239. unicode characters in an iPython paragr...

2018-02-20 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2810
  
Awesome,will merge it soon


---


[GitHub] zeppelin issue #2810: ZEPPELIN-3239. unicode characters in an iPython paragr...

2018-02-20 Thread Tagar
Github user Tagar commented on the issue:

https://github.com/apache/zeppelin/pull/2810
  
Verified manually. Works as expected. Thanks a lot @zjffdu 


---


[GitHub] zeppelin issue #2810: ZEPPELIN-3239. unicode characters in an iPython paragr...

2018-02-20 Thread Tagar
Github user Tagar commented on the issue:

https://github.com/apache/zeppelin/pull/2810
  
thanks @zjffdu! will give this a try today.


---


[GitHub] zeppelin issue #2810: ZEPPELIN-3239. unicode characters in an iPython paragr...

2018-02-20 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2810
  
@Tagar Could you help try verify this PR ? Thanks


---


[GitHub] zeppelin pull request #2810: ZEPPELIN-3239. unicode characters in an iPython...

2018-02-20 Thread zjffdu
GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/2810

ZEPPELIN-3239. unicode characters in an iPython paragraph makes Spark 
interpreter irresponsive

### What is this PR for?

Fix the unicode issues in python2.

### What type of PR is it?
[Bug Fix | Improvement ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3239

### How should this be tested?
* Unit test is added

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-3239

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2810.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2810


commit e7c0044b5167c21916eba166fc7d8f6643298e60
Author: Jeff Zhang <zjffdu@...>
Date:   2018-02-20T08:58:47Z

ZEPPELIN-3239. unicode characters in an iPython paragraph makes Spark 
interpreter irrsponsive




---


[jira] [Created] (ZEPPELIN-3239) unicode characters in an iPython paragraph makes Spark interpreter irrsponsive

2018-02-14 Thread Ruslan Dautkhanov (JIRA)
Ruslan Dautkhanov created ZEPPELIN-3239:
---

 Summary: unicode characters in an iPython paragraph makes Spark 
interpreter irrsponsive
 Key: ZEPPELIN-3239
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3239
 Project: Zeppelin
  Issue Type: Bug
Reporter: Ruslan Dautkhanov
 Attachments: Zeppelin-iPython_para_with_Unicode.PNG

An unicode characters in an iPython paragraph makes Spark interpreter 
irresponsive.

To reproduce, type into a new %ipyspark code following phase (yes, it's not a 
valid python code but the imprtant part is that it has a long unicode dash 
character ):
{code}
One following unicide character makes ipythonInterpreter not responding to 
Cancel commands –  
{code}
 DEBUG interpreter log shows following:
{quote}DEBUG [2018-02-15 00:39:45,628] (\{pool-2-thread-2} 
IPythonClient.java[stream_execute]:87) - stream_execute code:
One following unicide character makes ipythonInterpreter not responding to 
Cancel commands –
DEBUG [2018-02-15 00:39:45,632] (\{Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:388) - Process Output: 
ERROR:root:Exception iterating responses: 'ascii' codec can't encode character 
u'\u2013' in position 91: ordinal not in range(128)
DEBUG [2018-02-15 00:39:45,632] (\{Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:388) - Process Output: Traceback (most 
recent call last):
DEBUG [2018-02-15 00:39:45,633] (\{Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:388) - Process Output: File 
"/opt/cloudera/parcels/Anaconda/lib/python2.7/site-packages/grpc/_server.py", 
line 401, in _take_response_from_response_iterator
ERROR [2018-02-15 00:39:45,633] (\{grpc-default-executor-0} 
IPythonClient.java[onError]:138) - Fail to call IPython grpc
io.grpc.StatusRuntimeException: UNKNOWN: Exception iterating responses: 'ascii' 
codec can't encode character u'\u2013' in position 91: ordinal not in range(128)
 at io.grpc.Status.asRuntimeException(Status.java:543)
 at 
io.grpc.stub.ClientCalls$StreamObserverToCallListenerAdapter.onClose(ClientCalls.java:395)
 at io.grpc.internal.ClientCallImpl.closeObserver(ClientCallImpl.java:426)
 at io.grpc.internal.ClientCallImpl.access$100(ClientCallImpl.java:76)
 at 
io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.close(ClientCallImpl.java:512)
 at 
io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl.access$700(ClientCallImpl.java:429)
 at 
io.grpc.internal.ClientCallImpl$ClientStreamListenerImpl$1StreamClosed.runInContext(ClientCallImpl.java:544)
 at io.grpc.internal.ContextRunnable.run(ContextRunnable.java:52)
 at io.grpc.internal.SerializingExecutor.run(SerializingExecutor.java:117)
 at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)
DEBUG [2018-02-15 00:39:45,633] (\{Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:388) - Process Output: return 
next(response_iterator), True
DEBUG [2018-02-15 00:39:45,633] (\{Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:388) - Process Output: File 
"/tmp/zeppelin_ipython1942535087961089556/ipython_server.py", line 54, in 
execute
DEBUG [2018-02-15 00:39:45,633] (\{Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:388) - Process Output: print(request.code)
DEBUG [2018-02-15 00:39:45,634] (\{Exec Stream Pumper} 
IPythonInterpreter.java[processLine]:388) - Process Output: UnicodeEncodeError: 
'ascii' codec can't encode character u'\u2013' in position 91: ordinal not in 
range(128)
 INFO [2018-02-15 00:39:58,894] (\{dispatcher-event-loop-23} 
Logging.scala[logInfo]:54) - Registered executor 
NettyRpcEndpointRef(spark-client://Executor) (10.20.33.75:40434) with ID 2
{quote}
 

Notice 

"Process Output: UnicodeEncodeError: 'ascii' codec can't encode character 
u'\u2013' in position 91: ordinal not in range(128) "

So iPython interpreter breaks on presence of any unicode data.

!Zeppelin-iPython_para_with_Unicode.PNG!

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zeppelin issue #2736: ZEPPELIN-3179. Improve error message when IPython is n...

2018-01-23 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2736
  
More if no more comments


---


[GitHub] zeppelin issue #2736: ZEPPELIN-3179. Improve error message when IPython is n...

2018-01-21 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2736
  
@felixcheung @prabhjyotsingh Could you help review it ? Thanks


---


[jira] [Created] (ZEPPELIN-3179) Improve error message when IPython is not available

2018-01-20 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-3179:


 Summary: Improve error message when IPython is not available
 Key: ZEPPELIN-3179
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3179
 Project: Zeppelin
  Issue Type: Improvement
Reporter: Jeff Zhang






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zeppelin pull request #2725: ZEPPELIN-3136. IPython Code Completion Improvem...

2018-01-13 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2725


---


[GitHub] zeppelin issue #2725: ZEPPELIN-3136. IPython Code Completion Improvement

2018-01-12 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/2725
  
Tried it on local, works well.


---


[GitHub] zeppelin issue #2725: ZEPPELIN-3136. IPython Code Completion Improvement

2018-01-12 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2725
  
Thanks @mebelousov for testing it. 


---


[GitHub] zeppelin issue #2725: ZEPPELIN-3136. IPython Code Completion Improvement

2018-01-12 Thread mebelousov
Github user mebelousov commented on the issue:

https://github.com/apache/zeppelin/pull/2725
  
I have tested.
It's very useful bug fix.
@zjffdu thank you!


---


[GitHub] zeppelin issue #2725: ZEPPELIN-3136. IPython Code Completion Improvement

2018-01-11 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2725
  
@prabhjyotsingh @felixcheung Mind to help review it ?


---


[GitHub] zeppelin pull request #2725: ZPEPELIN-3136. IPython Code Completion Improvem...

2018-01-11 Thread zjffdu
GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/2725

ZPEPELIN-3136. IPython Code Completion Improvement

### What is this PR for?

This is for better code completion support for IPythonInterpreter


### What type of PR is it?
[Improvement ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3136

### How should this be tested?
* Unit test is updated and Manually verified. 

### Screenshots (if appropriate)

![code_completion](https://user-images.githubusercontent.com/164491/34858941-3f28105a-f78e-11e7-8341-2fbfd306ba5b.gif)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-3136

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2725.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2725


commit 1179fc82563b6b5c5251b2c288cb094a4a94bc8f
Author: Jeff Zhang <zjffdu@...>
Date:   2018-01-12T03:45:16Z

ZPEPELIN-3136. IPython Code Completion Improvement




---


[jira] [Created] (ZEPPELIN-2923) ipython related message is displayed when enabling a conda env

2017-09-10 Thread Hoon Park (JIRA)
Hoon Park created ZEPPELIN-2923:
---

 Summary: ipython related message is displayed when enabling a 
conda env 
 Key: ZEPPELIN-2923
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2923
 Project: Zeppelin
  Issue Type: Bug
  Components: python-interpreter
Reporter: Hoon Park
 Fix For: 0.8.0


ipython related message is displayed when enabling a conda env. I attached a 
GIF.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-27 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2474


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-08-27 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
I will merge it if no more comments


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-27 Thread zjffdu
GitHub user zjffdu reopened a pull request:

https://github.com/apache/zeppelin/pull/2474

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

### What is this PR for?
This is the first step for implement IPython Interpreter in Zeppelin.  I 
just use the jupyter_client to create and manage the ipython kernel. We don't 
need to care about python compilation and execution, all the things are 
delegated to ipython kernel. Ideally all the features of ipython should be 
available in Zeppelin as well.  

For now, user can use %python.ipython for IPython Interpreter. And if 
ipython is available, the default python interpreter will use ipython. But user 
can still set `zeppelin.python.useIPython` as false to enforce to use the old 
implementation of python interpreter. 

Main features:
* IPython interpreter support
** All the ipython features are available, including visualization, ipython 
magics. 
* ZeppelinContext support
* Streaming output support
* Support Ipython in PySpark

Regarding the visualization, ideally all the visualization libraries work 
in jupyter should also work here.
In unit test, I only verify the following 3 popular visualization library. 
could add more later.
* matplotlib
* bokeh
* ggplot

### What type of PR is it?
[Feature ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2753

### How should this be tested?
Unit test is added. 

### Screenshots (if appropriate)
Verify bokeh in IPython Interpreter

![image](https://user-images.githubusercontent.com/164491/27999716-756d749e-6552-11e7-90bb-4c6b08f4ab5c.png)

Verify matplotlib

![image](https://user-images.githubusercontent.com/164491/28046960-e881b28e-6619-11e7-9e1f-7f4662f842f3.png)

Verify ZeppelinContext


![image](https://user-images.githubusercontent.com/164491/28119378-4212620c-6747-11e7-89d5-3b5e609593ce.png)

Verify Streaming

![streaming](https://user-images.githubusercontent.com/164491/28950974-8f92fe1e-78fa-11e7-841f-3174da198bb7.gif)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-2753

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2474.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2474


commit b0b5c95a6802c595177c187e8363c08c7e464a54
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-07-02T07:51:14Z

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

commit e869f31d07650685907eb00b0ce2d2c15869232d
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-08-26T03:59:43Z

address comments




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-27 Thread zjffdu
Github user zjffdu closed the pull request at:

https://github.com/apache/zeppelin/pull/2474


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-27 Thread zjffdu
GitHub user zjffdu reopened a pull request:

https://github.com/apache/zeppelin/pull/2474

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

### What is this PR for?
This is the first step for implement IPython Interpreter in Zeppelin.  I 
just use the jupyter_client to create and manage the ipython kernel. We don't 
need to care about python compilation and execution, all the things are 
delegated to ipython kernel. Ideally all the features of ipython should be 
available in Zeppelin as well.  

For now, user can use %python.ipython for IPython Interpreter. And if 
ipython is available, the default python interpreter will use ipython. But user 
can still set `zeppelin.python.useIPython` as false to enforce to use the old 
implementation of python interpreter. 

Main features:
* IPython interpreter support
** All the ipython features are available, including visualization, ipython 
magics. 
* ZeppelinContext support
* Streaming output support
* Support Ipython in PySpark

Regarding the visualization, ideally all the visualization libraries work 
in jupyter should also work here.
In unit test, I only verify the following 3 popular visualization library. 
could add more later.
* matplotlib
* bokeh
* ggplot

### What type of PR is it?
[Feature ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2753

### How should this be tested?
Unit test is added. 

### Screenshots (if appropriate)
Verify bokeh in IPython Interpreter

![image](https://user-images.githubusercontent.com/164491/27999716-756d749e-6552-11e7-90bb-4c6b08f4ab5c.png)

Verify matplotlib

![image](https://user-images.githubusercontent.com/164491/28046960-e881b28e-6619-11e7-9e1f-7f4662f842f3.png)

Verify ZeppelinContext


![image](https://user-images.githubusercontent.com/164491/28119378-4212620c-6747-11e7-89d5-3b5e609593ce.png)

Verify Streaming

![streaming](https://user-images.githubusercontent.com/164491/28950974-8f92fe1e-78fa-11e7-841f-3174da198bb7.gif)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-2753

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2474.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2474


commit b0b5c95a6802c595177c187e8363c08c7e464a54
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-07-02T07:51:14Z

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

commit e869f31d07650685907eb00b0ce2d2c15869232d
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-08-26T03:59:43Z

address comments




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-27 Thread zjffdu
Github user zjffdu closed the pull request at:

https://github.com/apache/zeppelin/pull/2474


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-26 Thread zjffdu
GitHub user zjffdu reopened a pull request:

https://github.com/apache/zeppelin/pull/2474

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

### What is this PR for?
This is the first step for implement IPython Interpreter in Zeppelin.  I 
just use the jupyter_client to create and manage the ipython kernel. We don't 
need to care about python compilation and execution, all the things are 
delegated to ipython kernel. Ideally all the features of ipython should be 
available in Zeppelin as well.  

For now, user can use %python.ipython for IPython Interpreter. And if 
ipython is available, the default python interpreter will use ipython. But user 
can still set `zeppelin.python.useIPython` as false to enforce to use the old 
implementation of python interpreter. 

Main features:
* IPython interpreter support
** All the ipython features are available, including visualization, ipython 
magics. 
* ZeppelinContext support
* Streaming output support
* Support Ipython in PySpark

Regarding the visualization, ideally all the visualization libraries work 
in jupyter should also work here.
In unit test, I only verify the following 3 popular visualization library. 
could add more later.
* matplotlib
* bokeh
* ggplot

### What type of PR is it?
[Feature ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2753

### How should this be tested?
Unit test is added. 

### Screenshots (if appropriate)
Verify bokeh in IPython Interpreter

![image](https://user-images.githubusercontent.com/164491/27999716-756d749e-6552-11e7-90bb-4c6b08f4ab5c.png)

Verify matplotlib

![image](https://user-images.githubusercontent.com/164491/28046960-e881b28e-6619-11e7-9e1f-7f4662f842f3.png)

Verify ZeppelinContext


![image](https://user-images.githubusercontent.com/164491/28119378-4212620c-6747-11e7-89d5-3b5e609593ce.png)

Verify Streaming

![streaming](https://user-images.githubusercontent.com/164491/28950974-8f92fe1e-78fa-11e7-841f-3174da198bb7.gif)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-2753

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2474.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2474


commit b0b5c95a6802c595177c187e8363c08c7e464a54
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-07-02T07:51:14Z

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

commit e869f31d07650685907eb00b0ce2d2c15869232d
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-08-26T03:59:43Z

address comments




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-26 Thread zjffdu
Github user zjffdu closed the pull request at:

https://github.com/apache/zeppelin/pull/2474


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-26 Thread zjffdu
GitHub user zjffdu reopened a pull request:

https://github.com/apache/zeppelin/pull/2474

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

### What is this PR for?
This is the first step for implement IPython Interpreter in Zeppelin.  I 
just use the jupyter_client to create and manage the ipython kernel. We don't 
need to care about python compilation and execution, all the things are 
delegated to ipython kernel. Ideally all the features of ipython should be 
available in Zeppelin as well.  

For now, user can use %python.ipython for IPython Interpreter. And if 
ipython is available, the default python interpreter will use ipython. But user 
can still set `zeppelin.python.useIPython` as false to enforce to use the old 
implementation of python interpreter. 

Main features:
* IPython interpreter support
** All the ipython features are available, including visualization, ipython 
magics. 
* ZeppelinContext support
* Streaming output support
* Support Ipython in PySpark

Regarding the visualization, ideally all the visualization libraries work 
in jupyter should also work here.
In unit test, I only verify the following 3 popular visualization library. 
could add more later.
* matplotlib
* bokeh
* ggplot

### What type of PR is it?
[Feature ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2753

### How should this be tested?
Unit test is added. 

### Screenshots (if appropriate)
Verify bokeh in IPython Interpreter

![image](https://user-images.githubusercontent.com/164491/27999716-756d749e-6552-11e7-90bb-4c6b08f4ab5c.png)

Verify matplotlib

![image](https://user-images.githubusercontent.com/164491/28046960-e881b28e-6619-11e7-9e1f-7f4662f842f3.png)

Verify ZeppelinContext


![image](https://user-images.githubusercontent.com/164491/28119378-4212620c-6747-11e7-89d5-3b5e609593ce.png)

Verify Streaming

![streaming](https://user-images.githubusercontent.com/164491/28950974-8f92fe1e-78fa-11e7-841f-3174da198bb7.gif)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-2753

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2474.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2474


commit b0b5c95a6802c595177c187e8363c08c7e464a54
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-07-02T07:51:14Z

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

commit e869f31d07650685907eb00b0ce2d2c15869232d
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-08-26T03:59:43Z

address comments




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-26 Thread zjffdu
Github user zjffdu closed the pull request at:

https://github.com/apache/zeppelin/pull/2474


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-26 Thread zjffdu
Github user zjffdu closed the pull request at:

https://github.com/apache/zeppelin/pull/2474


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-26 Thread zjffdu
GitHub user zjffdu reopened a pull request:

https://github.com/apache/zeppelin/pull/2474

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

### What is this PR for?
This is the first step for implement IPython Interpreter in Zeppelin.  I 
just use the jupyter_client to create and manage the ipython kernel. We don't 
need to care about python compilation and execution, all the things are 
delegated to ipython kernel. Ideally all the features of ipython should be 
available in Zeppelin as well.  

For now, user can use %python.ipython for IPython Interpreter. And if 
ipython is available, the default python interpreter will use ipython. But user 
can still set `zeppelin.python.useIPython` as false to enforce to use the old 
implementation of python interpreter. 

Main features:
* IPython interpreter support
** All the ipython features are available, including visualization, ipython 
magics. 
* ZeppelinContext support
* Streaming output support
* Support Ipython in PySpark

Regarding the visualization, ideally all the visualization libraries work 
in jupyter should also work here.
In unit test, I only verify the following 3 popular visualization library. 
could add more later.
* matplotlib
* bokeh
* ggplot

### What type of PR is it?
[Feature ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2753

### How should this be tested?
Unit test is added. 

### Screenshots (if appropriate)
Verify bokeh in IPython Interpreter

![image](https://user-images.githubusercontent.com/164491/27999716-756d749e-6552-11e7-90bb-4c6b08f4ab5c.png)

Verify matplotlib

![image](https://user-images.githubusercontent.com/164491/28046960-e881b28e-6619-11e7-9e1f-7f4662f842f3.png)

Verify ZeppelinContext


![image](https://user-images.githubusercontent.com/164491/28119378-4212620c-6747-11e7-89d5-3b5e609593ce.png)

Verify Streaming

![streaming](https://user-images.githubusercontent.com/164491/28950974-8f92fe1e-78fa-11e7-841f-3174da198bb7.gif)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-2753

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2474.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2474


commit b0b5c95a6802c595177c187e8363c08c7e464a54
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-07-02T07:51:14Z

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

commit e869f31d07650685907eb00b0ce2d2c15869232d
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-08-26T03:59:43Z

address comments




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-08-24 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
ping Leemoonsoo @1ambda @felixcheung @prabhjyotsingh for review


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-08-19 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
@Leemoonsoo I have fixed the issue, could you try it again ? Thanks


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-08-08 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
Tried last commit.

I installed jupyter, IPython, ipykernel, grpcio in my conda environment and 
i configured my python interpreter like

![image](https://user-images.githubusercontent.com/1540981/29084421-c7df43a8-7c20-11e7-9299-2d7ab88d17fd.png)

And then i'm getting `No module named py4j.java_gateway` error on first 
`%python.ipython` execution


![image](https://user-images.githubusercontent.com/1540981/29084458-da47f3b4-7c20-11e7-8ab7-6c281f0c3d54.png)

And second execution, `z` is not available.


![image](https://user-images.githubusercontent.com/1540981/29084488-f49a8358-7c20-11e7-8b99-47605981faa3.png)

Looks like py4j library is not in python path. @zjffdu Do you have any idea 
on this?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-04 Thread zjffdu
Github user zjffdu closed the pull request at:

https://github.com/apache/zeppelin/pull/2474


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-08-04 Thread zjffdu
GitHub user zjffdu reopened a pull request:

https://github.com/apache/zeppelin/pull/2474

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

### What is this PR for?
This is the first step for implement IPython Interpreter in Zeppelin.  I 
just use the jupyter_client to create and manage the ipython kernel. We don't 
need to care about python compilation and execution, all the things are 
delegated to ipython kernel. Ideally all the features of ipython should be 
available in Zeppelin as well.  

For now, user can use %python.ipython for IPython Interpreter. And if 
ipython is available, the default python interpreter will use ipython. But user 
can still set `zeppelin.python.useIPython` as false to enforce to use the old 
implementation of python interpreter. 

Main features:
* IPython interpreter support
** All the ipython features are available, including visualization, ipython 
magics. 
* ZeppelinContext support
* Streaming output support
* Support Ipython in PySpark

Regarding the visualization, ideally all the visualization libraries work 
in jupyter should also work here.
In unit test, I only verify the following 3 popular visualization library. 
could add more later.
* matplotlib
* bokeh
* ggplot

### What type of PR is it?
[Feature ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2753

### How should this be tested?
Unit test is added. 

### Screenshots (if appropriate)
Verify bokeh in IPython Interpreter

![image](https://user-images.githubusercontent.com/164491/27999716-756d749e-6552-11e7-90bb-4c6b08f4ab5c.png)

Verify matplotlib

![image](https://user-images.githubusercontent.com/164491/28046960-e881b28e-6619-11e7-9e1f-7f4662f842f3.png)

Verify ZeppelinContext


![image](https://user-images.githubusercontent.com/164491/28119378-4212620c-6747-11e7-89d5-3b5e609593ce.png)

Verify Streaming

![streaming](https://user-images.githubusercontent.com/164491/28950974-8f92fe1e-78fa-11e7-841f-3174da198bb7.gif)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-2753

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2474.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2474


commit 78fde23c39a9fef36cea3d074b09a4748bdc17c9
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-07-02T07:51:14Z

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

commit bb4d35451e3a7e83d20a2a7f66f303f2258bdd16
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-07-17T00:29:59Z

Add cursor for completion

commit 3df231497a2b4b4bd0e3703151d25a0b0a932073
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-07-27T11:10:27Z

use IPython first, otherwise fallback to the old PythonInterpreter

commit 6d1f69bb74639ebe7c826a2ed807acfa8b02619e
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-07-28T07:49:29Z

IPython Support for PySparkInterpreter

commit 3179e9abb71ea63051c1dbb918276c9c24aba6e7
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-07-30T09:54:23Z

Support streaming output

commit 4c129c66e0eca39157a742d20bed7773ffedc0d5
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-08-04T02:01:34Z

add more docs




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-08-03 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
@Leemoonsoo @1ambda @felixcheung @prabhjyotsingh I made several follow up 
commit. All the features in this stage is done. Please help review that. I 
believe it would be a big improvement for python users. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-07-31 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
Push another commit to support streaming output


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-07-30 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
Push another commit to use IPython in PySparkInterpreter if IPython is 
available , otherwise fallback to the old implementation.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-07-27 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
Just push another commit to use IPythonInterpreter first, if it is not 
available, I will fallback it to the old PythonInterpreter. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-07-16 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
@1ambda I did some investtigation on that, and puts some links in 
https://issues.apache.org/jira/browse/ZEPPELIN-2756, hope it would be helpful 
for you.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-07-16 Thread 1ambda
Github user 1ambda commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
Let create a PR to fix the ASCII issue, we can test this PR based on the 
ASCII PR.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-07-16 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
Thanks @Leemoonsoo for catching that. This is due to I miss cursor for code 
completion. Just pushed another commit to fix that and add more unit test for 
it.

```
// there's no completion for 'a.' because it is not recognized by 
compiler for now.
String st = "a='hello'\na.";
completions = interpreter.completion(st, st.length(), 
getInterpreterContext());
assertEquals(0, completions.size());

// define a first
st = "a='hello'";
result = interpreter.interpret(st, getInterpreterContext());
assertEquals(InterpreterResult.Code.SUCCESS, result.code());

// now we can get the completion for `a.`
st = "a.";
completions = interpreter.completion(st, st.length(), 
getInterpreterContext());
// it is differnet for python2 and python3 and may even different for 
different minor version
// so only verify it is larger than 20
assertTrue(completions.size() > 20);

st = "a.ca";
completions = interpreter.completion(st, st.length(), 
getInterpreterContext());
// a.capitalize
// a.casefold
assertEquals(2, completions.size());

// cursor is in the middle of code
st = "a.ca\b='hello";
completions = interpreter.completion(st, 4, getInterpreterContext());
// a.capitalize
// a.casefold
assertEquals(2, completions.size());

```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-07-16 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
Is it expected completion list?

![image](https://user-images.githubusercontent.com/1540981/28252185-32d695a8-6ac9-11e7-9f29-2257700990d0.png)



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-07-16 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
Yes, that works. It is covered in unit test 
(https://github.com/apache/zeppelin/pull/2474/files#diff-d9c8252d37a199d13b7157e88041c0e9R124).
  Also I manually verified it 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-07-16 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
Tested 88a1f2f and ZeppelinContext works well.

Does auto completion supposed to work?



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-2774) Use IPython in PySparkInterpreter

2017-07-14 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-2774:


 Summary: Use IPython in PySparkInterpreter
 Key: ZEPPELIN-2774
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2774
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: Jeff Zhang






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-07-13 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
@Leemoonsoo Regarding the ZeppelinContext, could you try that again ? It is 
covered in unit test, so should be able to work.  I force committed it 
yesterday, the latest commit Id is 956befa4151128b9ee76df2e3eada512ab9e1025


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-07-13 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
Thanks for testing @Leemoonsoo . These special characters are for font 
color, create ZEPPELIN-2756 for that which might need help from @1ambda 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2474: [ZEPPELIN-2753] Basic Implementation of IPython Interp...

2017-07-11 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2474
  
@Leemoonsoo @1ambda @felixcheung @prabhjyotsingh Please help review. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2474: [ZEPPELIN-2753] Basic Implementation of IPython...

2017-07-09 Thread zjffdu
GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/2474

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter

### What is this PR for?
This is the first step for implement IPython Interpreter in Zeppelin.  I 
just use the jupyter_client to create and manage the ipython kernel. We don't 
need to care about python compilation and execution, all the things are 
delegated to ipython kernel. Ideally all the features of ipython should be 
available in Zeppelin as well.  

### What type of PR is it?
[Feature ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-2753

### How should this be tested?
Unit is added. 

### Screenshots (if appropriate)
Verify bokeh in IPython Interpreter

![image](https://user-images.githubusercontent.com/164491/27999716-756d749e-6552-11e7-90bb-4c6b08f4ab5c.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-2753

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2474.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2474


commit e2fbf75e0bf3a814122fa51ea3a88da2823f0487
Author: Jeff Zhang <zjf...@apache.org>
Date:   2017-07-02T07:51:14Z

[ZEPPELIN-2753] Basic Implementation of IPython Interpreter




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-2754) Support ZeppelinContext in IPython Interpreter

2017-07-09 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-2754:


 Summary: Support ZeppelinContext in IPython Interpreter
 Key: ZEPPELIN-2754
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2754
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: Jeff Zhang






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ZEPPELIN-2753) Basic Implementation of IPython Interpreter

2017-07-09 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-2753:


 Summary: Basic Implementation of IPython Interpreter
 Key: ZEPPELIN-2753
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2753
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: Jeff Zhang






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ZEPPELIN-2752) Support IPython in PythonInterpreter

2017-07-09 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-2752:


 Summary: Support IPython in PythonInterpreter
 Key: ZEPPELIN-2752
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2752
 Project: Zeppelin
  Issue Type: New Feature
Reporter: Jeff Zhang






--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[jira] [Created] (ZEPPELIN-2644) Import IPython Or any Databricks supported format Notebooks into Zeppelin

2017-06-13 Thread Nassir (JIRA)
Nassir created ZEPPELIN-2644:


 Summary: Import IPython Or any Databricks supported format 
Notebooks into Zeppelin
 Key: ZEPPELIN-2644
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2644
 Project: Zeppelin
  Issue Type: Bug
Reporter: Nassir


Can anyone help in importing IPython notebooks into Apache Zeppelin.

I also would like to be able to use any of the export formats from Databricks 
such as DBC archive, IPython notebook, HTML, or source file.

can zeppelin import any of these?

Thanks
Nassir



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


<    1   2