[jira] [Created] (ZEPPELIN-4091) Ipython hang when concurrent auto complete / run

2019-03-26 Thread marc hurabielle (JIRA)
marc hurabielle created ZEPPELIN-4091:
-

 Summary: Ipython hang when concurrent auto complete / run
 Key: ZEPPELIN-4091
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4091
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: marc hurabielle
Assignee: marc hurabielle


Ipython / ipython server has a problem when concurrent execution and auto 
complete are execute in same time / parallel. It can make a paragraph hang 
forever (until restart of the ipython server). Maybe related to 
[https://github.com/jupyter/jupyter_client/issues/429]

Overall most of those bug might be related also to some jupyter_client bug or 
wrong usage.
However, those are the action item:
 * synchronize auto complete / paragraph execution for now



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZEPPELIN-4090) Ipython CPU / queue improvement

2019-03-26 Thread marc hurabielle (JIRA)
marc hurabielle created ZEPPELIN-4090:
-

 Summary: Ipython CPU / queue improvement
 Key: ZEPPELIN-4090
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4090
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: marc hurabielle
Assignee: marc hurabielle


Ipython / ipython server has currently a problem of High cpu usage. The loop 
that read from the pub/sub should not try to read everytimes the pub sub. It 
Needs to be debounce.

those are the action item:
 * sleep time to time when there is no message in pub/sub
 * Use only one queue instead of 3



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZEPPELIN-4089) Execution hang after ipython kernel die

2019-03-26 Thread marc hurabielle (JIRA)
marc hurabielle created ZEPPELIN-4089:
-

 Summary: Execution hang after ipython kernel die
 Key: ZEPPELIN-4089
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4089
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: marc hurabielle
Assignee: marc hurabielle


When an ipython paragraph is running, and the ipython kernel is dying. (like an 
out of memory), the interpreter will hang and never complete the execution.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (ZEPPELIN-4078) Ipython improvement

2019-03-18 Thread marc hurabielle (JIRA)
marc hurabielle created ZEPPELIN-4078:
-

 Summary: Ipython improvement
 Key: ZEPPELIN-4078
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4078
 Project: Zeppelin
  Issue Type: Bug
  Components: python-interpreter
Affects Versions: 0.8.1
 Environment: tested in linux / macos. Tested the ipython server 
directly.
Reporter: marc hurabielle


Ipython / ipython server has currently mutliple problem. 


 * Concurrent execution and auto complete can make a paragraph hang forever 
(until restart of the ipython server). Maybe related to 
[https://github.com/jupyter/jupyter_client/issues/429]
 * Out of memory for ipython will make a paragraph hang instead of throw one 
error.
 * High cpu usage. The loop that read from the pub/sub should not try to read 
everytimes the pub sub. Need to be debounce.

Overall most of those bug might be related also to some jupyter_client bug or 
wrong usage.
However, those are the action item:


 * synchronize auto complete / paragraph execution for now
 * check the kernel status when we are checking for the thread
 * sleep time to time when there is no message in pub/sub
 * Use only one queue instead of 3 ?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)