[jira] [Commented] (SPARK-15369) Investigate selectively using Jython for parts of PySpark

[ https://issues.apache.org/jira/browse/SPARK-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707435#comment-15707435 ] holdenk commented on SPARK-15369: - So I'm probably going to be busy until after the 2.1 r

[jira] [Commented] (SPARK-15369) Investigate selectively using Jython for parts of PySpark

[ https://issues.apache.org/jira/browse/SPARK-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707428#comment-15707428 ] Marius Van Niekerk commented on SPARK-15369: Oh yeah, once we have a pip inst

[jira] [Commented] (SPARK-15369) Investigate selectively using Jython for parts of PySpark

[ https://issues.apache.org/jira/browse/SPARK-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707421#comment-15707421 ] holdenk commented on SPARK-15369: - That looks like a great start :) Probably the packagin

[jira] [Commented] (SPARK-15369) Investigate selectively using Jython for parts of PySpark

[ https://issues.apache.org/jira/browse/SPARK-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15707411#comment-15707411 ] Marius Van Niekerk commented on SPARK-15369: I'm in the process of an initial

[jira] [Commented] (SPARK-15369) Investigate selectively using Jython for parts of PySpark

[ https://issues.apache.org/jira/browse/SPARK-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573287#comment-15573287 ] holdenk commented on SPARK-15369: - I can understand the hesitancy to adopt this long term

[jira] [Commented] (SPARK-15369) Investigate selectively using Jython for parts of PySpark

[ https://issues.apache.org/jira/browse/SPARK-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550012#comment-15550012 ] holdenk commented on SPARK-15369: - Certainly we can investigate speeding up the serializa

[jira] [Commented] (SPARK-15369) Investigate selectively using Jython for parts of PySpark

[ https://issues.apache.org/jira/browse/SPARK-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15549990#comment-15549990 ] Reynold Xin commented on SPARK-15369: - So while I'm sure you can improve performance

[jira] [Commented] (SPARK-15369) Investigate selectively using Jython for parts of PySpark

[ https://issues.apache.org/jira/browse/SPARK-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15321684#comment-15321684 ] Apache Spark commented on SPARK-15369: -- User 'holdenk' has created a pull request fo

[jira] [Commented] (SPARK-15369) Investigate selectively using Jython for parts of PySpark

[ https://issues.apache.org/jira/browse/SPARK-15369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319966#comment-15319966 ] holdenk commented on SPARK-15369: - WIP design document https://docs.google.com/document/