[jira] [Updated] (SPARK-35790) Spark Package Python Import does not work for namespace packages

2021-06-21 Thread Mark Hamilton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamilton updated SPARK-35790: -- Priority: Trivial (was: Major) > Spark Package Python Import does not work for namespace

[jira] [Commented] (SPARK-35790) Spark Package Python Import does not work for namespace packages

2021-06-21 Thread Mark Hamilton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17366890#comment-17366890 ] Mark Hamilton commented on SPARK-35790: --- Was able to properly do this and found this was a

[jira] [Updated] (SPARK-35790) Spark Package Python Import does not work for namespace packages

2021-06-17 Thread Mark Hamilton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-35790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamilton updated SPARK-35790: -- Description: If one includes python files within several jars that comprise a python

[jira] [Created] (SPARK-35790) Spark Package Python Import does not work for depenant jars

2021-06-16 Thread Mark Hamilton (Jira)
Mark Hamilton created SPARK-35790: - Summary: Spark Package Python Import does not work for depenant jars Key: SPARK-35790 URL: https://issues.apache.org/jira/browse/SPARK-35790 Project: Spark

[jira] [Updated] (SPARK-34002) Broken UDF Encoding

2021-01-04 Thread Mark Hamilton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamilton updated SPARK-34002: -- Description: UDFs can behave differently depending on if a dataframe is cached, despite the

[jira] [Updated] (SPARK-34002) Broken UDF Encoding

2021-01-04 Thread Mark Hamilton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamilton updated SPARK-34002: -- Description: UDFs can behave differently depending on if a dataframe is cached, despite the

[jira] [Updated] (SPARK-34002) Broken UDF Encoding

2021-01-04 Thread Mark Hamilton (Jira)
[ https://issues.apache.org/jira/browse/SPARK-34002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamilton updated SPARK-34002: -- Description: UDFs can behave differently depending on if a dataframe is cached, despite the

[jira] [Created] (SPARK-34002) Broken UDF behavior

2021-01-04 Thread Mark Hamilton (Jira)
Mark Hamilton created SPARK-34002: - Summary: Broken UDF behavior Key: SPARK-34002 URL: https://issues.apache.org/jira/browse/SPARK-34002 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-27234) Continuous Streaming does not support python UDFs

2019-03-25 Thread Mark Hamilton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800817#comment-16800817 ] Mark Hamilton commented on SPARK-27234: --- Thank you for the quick reply [~hyukjin.kwon] and

[jira] [Updated] (SPARK-27234) Continuous Streaming does not support python UDFs

2019-03-25 Thread Mark Hamilton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamilton updated SPARK-27234: -- Description: Heres a repro: {code:java} from pyspark.sql.functions import col, udf fooUDF =

[jira] [Created] (SPARK-27234) Continuous Streaming does not support python UDFs

2019-03-21 Thread Mark Hamilton (JIRA)
Mark Hamilton created SPARK-27234: - Summary: Continuous Streaming does not support python UDFs Key: SPARK-27234 URL: https://issues.apache.org/jira/browse/SPARK-27234 Project: Spark Issue

[jira] [Commented] (SPARK-25350) Spark Serving

2018-09-05 Thread Mark Hamilton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604842#comment-16604842 ] Mark Hamilton commented on SPARK-25350: --- Hey, [~rxin], we had talked about this contribution at

[jira] [Updated] (SPARK-25350) Spark Serving

2018-09-05 Thread Mark Hamilton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamilton updated SPARK-25350: -- Description: Microsoft has created a new system to turn Structured Streaming jobs into

[jira] [Updated] (SPARK-25350) Spark Serving

2018-09-05 Thread Mark Hamilton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Hamilton updated SPARK-25350: -- Description: Microsoft has created a new system to turn Structured Streaming jobs into

[jira] [Created] (SPARK-25350) Spark Serving

2018-09-05 Thread Mark Hamilton (JIRA)
Mark Hamilton created SPARK-25350: - Summary: Spark Serving Key: SPARK-25350 URL: https://issues.apache.org/jira/browse/SPARK-25350 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

2018-07-12 Thread Mark Hamilton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541606#comment-16541606 ] Mark Hamilton commented on SPARK-24432: --- Thank you for the prompt reply @Anirudh, would love to

[jira] [Commented] (SPARK-24432) Add support for dynamic resource allocation

2018-07-11 Thread Mark Hamilton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541024#comment-16541024 ] Mark Hamilton commented on SPARK-24432: --- Hey [~liyinan926], and [~foxish], I would like to try my

[jira] [Commented] (SPARK-21166) Automated ML persistence

2017-06-22 Thread Mark Hamilton (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16059481#comment-16059481 ] Mark Hamilton commented on SPARK-21166: --- The code is currently being developed here: