[jira] [Created] (SPARK-26251) isnan function not picking non-numeric values

Kunal Rao created SPARK-26251: - Summary: isnan function not picking non-numeric values Key: SPARK-26251 URL: https://issues.apache.org/jira/browse/SPARK-26251 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-26249) Extension Points Enhancements to inject a rule in order and to add a batch

[ https://issues.apache.org/jira/browse/SPARK-26249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunitha Kambhampati updated SPARK-26249: Affects Version/s: (was: 2.4.0) 3.0.0 > Extension

[jira] [Updated] (SPARK-26250) Fail to run dataframe.R examples

[ https://issues.apache.org/jira/browse/SPARK-26250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean Pierre PIN updated SPARK-26250: Description: I get an error=2 running spark-submit examples/src/main/r/dataframe.R the

[jira] [Created] (SPARK-26250) Fail to run dataframe.R examples

Jean Pierre PIN created SPARK-26250: --- Summary: Fail to run dataframe.R examples Key: SPARK-26250 URL: https://issues.apache.org/jira/browse/SPARK-26250 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-26228) OOM issue encountered when computing Gramian matrix

[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706751#comment-16706751 ] Chen Lin commented on SPARK-26228: -- I have tried to set spark.driver.memory from 8g to 16g. It doesn't

[jira] [Commented] (SPARK-26228) OOM issue encountered when computing Gramian matrix

[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706721#comment-16706721 ] shahid commented on SPARK-26228: could you please increase the driver memory and check. > OOM issue

[jira] [Updated] (SPARK-26249) Extension Points Enhancements to inject a rule in order and to add a batch

[ https://issues.apache.org/jira/browse/SPARK-26249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunitha Kambhampati updated SPARK-26249: Description: +Motivation:+   Spark has extension points API to allow third

[jira] [Commented] (SPARK-26249) Extension Points Enhancements to inject a rule in order and to add a batch

[ https://issues.apache.org/jira/browse/SPARK-26249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706720#comment-16706720 ] Sunitha Kambhampati commented on SPARK-26249: - I will post a PR soon.   > Extension Points

[jira] [Updated] (SPARK-26249) Extension Points Enhancements to inject a rule in order and to add a batch

[ https://issues.apache.org/jira/browse/SPARK-26249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunitha Kambhampati updated SPARK-26249: Description: +Motivation:+   Spark has extension points API to allow third

[jira] [Updated] (SPARK-26249) Extension Points Enhancements to inject a rule in order and to add a batch

[ https://issues.apache.org/jira/browse/SPARK-26249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunitha Kambhampati updated SPARK-26249: Description: +Motivation:+   Spark has extension points API to allow third

[jira] [Updated] (SPARK-26249) Extension Points Enhancements to inject a rule in order and to add a batch

[ https://issues.apache.org/jira/browse/SPARK-26249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunitha Kambhampati updated SPARK-26249: Description: +Motivation:+   Spark has extension points API to allow third

[jira] [Created] (SPARK-26249) Extension Points Enhancements to inject a rule in order and to add a batch

Sunitha Kambhampati created SPARK-26249: --- Summary: Extension Points Enhancements to inject a rule in order and to add a batch Key: SPARK-26249 URL: https://issues.apache.org/jira/browse/SPARK-26249

[jira] [Updated] (SPARK-26228) OOM issue encountered when computing Gramian matrix

[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Lin updated SPARK-26228: - Attachment: 1.jpeg > OOM issue encountered when computing Gramian matrix >

[jira] [Commented] (SPARK-26228) OOM issue encountered when computing Gramian matrix

[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706706#comment-16706706 ] Chen Lin commented on SPARK-26228: -- Exception in thread "main" java.lang.OutOfMemoryError: Requested

[jira] [Commented] (SPARK-26228) OOM issue encountered when computing Gramian matrix

[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706701#comment-16706701 ] Chen Lin commented on SPARK-26228: -- [~shahid] I have upload the screenshot of log.   I doubt there

[jira] [Updated] (SPARK-26228) OOM issue encountered when computing Gramian matrix

[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Lin updated SPARK-26228: - Description: {quote}/**  * Computes the Gramian matrix `A^T A`.  *  * @note This cannot be computed

[jira] [Commented] (SPARK-26117) use SparkOutOfMemoryError instead of OutOfMemoryError when catch exception

[ https://issues.apache.org/jira/browse/SPARK-26117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706691#comment-16706691 ] Apache Spark commented on SPARK-26117: -- User 'heary-cao' has created a pull request for this issue:

[jira] [Commented] (SPARK-26117) use SparkOutOfMemoryError instead of OutOfMemoryError when catch exception

[ https://issues.apache.org/jira/browse/SPARK-26117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706690#comment-16706690 ] Apache Spark commented on SPARK-26117: -- User 'heary-cao' has created a pull request for this issue:

[jira] [Updated] (SPARK-26198) Metadata serialize null values throw NPE

[ https://issues.apache.org/jira/browse/SPARK-26198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-26198: -- Fix Version/s: 2.4.1 2.3.3 > Metadata serialize null values throw NPE >

[jira] [Comment Edited] (SPARK-26228) OOM issue encountered when computing Gramian matrix

[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706667#comment-16706667 ] shahid edited comment on SPARK-26228 at 12/3/18 5:25 AM: - Hi [~hibayesian],

[jira] [Commented] (SPARK-26228) OOM issue encountered when computing Gramian matrix

[ https://issues.apache.org/jira/browse/SPARK-26228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706667#comment-16706667 ] shahid commented on SPARK-26228: Hi [~hibayesian], could you please share the full log of the error, if

[jira] [Updated] (SPARK-26247) SPIP - ML Model Extension for no-Spark MLLib Online Serving

[ https://issues.apache.org/jira/browse/SPARK-26247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26247: - Description: This ticket tracks an SPIP to improve model load time and model serving

[jira] [Updated] (SPARK-26247) SPIP - ML Model Extension for no-Spark MLLib Online Serving

[ https://issues.apache.org/jira/browse/SPARK-26247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26247: - Target Version/s: 3.0.0 (was: 2.1.0) > SPIP - ML Model Extension for no-Spark MLLib Online

[jira] [Updated] (SPARK-26247) SPIP - ML Model Extension for no-Spark MLLib Online Serving

[ https://issues.apache.org/jira/browse/SPARK-26247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-26247: - Fix Version/s: (was: 2.1.0) > SPIP - ML Model Extension for no-Spark MLLib Online Serving >

[jira] [Commented] (SPARK-26248) Infer date type from CSV

[ https://issues.apache.org/jira/browse/SPARK-26248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706494#comment-16706494 ] Apache Spark commented on SPARK-26248: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Updated] (SPARK-26248) Infer date type from CSV

[ https://issues.apache.org/jira/browse/SPARK-26248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Gekk updated SPARK-26248: --- Summary: Infer date type from CSV (was: Infer date type from JSON) > Infer date type from CSV >

[jira] [Assigned] (SPARK-26248) Infer date type from CSV

[ https://issues.apache.org/jira/browse/SPARK-26248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26248: Assignee: (was: Apache Spark) > Infer date type from CSV >

[jira] [Assigned] (SPARK-26248) Infer date type from CSV

[ https://issues.apache.org/jira/browse/SPARK-26248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26248: Assignee: Apache Spark > Infer date type from CSV > > >

[jira] [Created] (SPARK-26248) Infer date type from JSON

Maxim Gekk created SPARK-26248: -- Summary: Infer date type from JSON Key: SPARK-26248 URL: https://issues.apache.org/jira/browse/SPARK-26248 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-26247) SPIP - ML Model Extension for no-Spark MLLib Online Serving

Anne Holler created SPARK-26247: --- Summary: SPIP - ML Model Extension for no-Spark MLLib Online Serving Key: SPARK-26247 URL: https://issues.apache.org/jira/browse/SPARK-26247 Project: Spark

[jira] [Commented] (SPARK-26246) Infer date and timestamp types from JSON

[ https://issues.apache.org/jira/browse/SPARK-26246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706466#comment-16706466 ] Apache Spark commented on SPARK-26246: -- User 'MaxGekk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26246) Infer date and timestamp types from JSON

[ https://issues.apache.org/jira/browse/SPARK-26246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26246: Assignee: Apache Spark > Infer date and timestamp types from JSON >

[jira] [Assigned] (SPARK-26246) Infer date and timestamp types from JSON

[ https://issues.apache.org/jira/browse/SPARK-26246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26246: Assignee: (was: Apache Spark) > Infer date and timestamp types from JSON >

[jira] [Created] (SPARK-26246) Infer date and timestamp types from JSON

Maxim Gekk created SPARK-26246: -- Summary: Infer date and timestamp types from JSON Key: SPARK-26246 URL: https://issues.apache.org/jira/browse/SPARK-26246 Project: Spark Issue Type: Improvement

[jira] [Issue Comment Deleted] (SPARK-26139) Support passing shuffle metrics to exchange operator

[ https://issues.apache.org/jira/browse/SPARK-26139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-26139: Comment: was deleted (was: User 'xuanyuanking' has created a pull request for this issue:

[jira] [Resolved] (SPARK-26165) Date and Timestamp column expression is getting converted to string in less than/greater than filter query even though valid date/timestamp string literal is used in th

[ https://issues.apache.org/jira/browse/SPARK-26165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26165. --- Resolution: Won't Fix > Date and Timestamp column expression is getting converted to string in less

[jira] [Commented] (SPARK-26193) Implement shuffle write metrics in SQL

[ https://issues.apache.org/jira/browse/SPARK-26193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706368#comment-16706368 ] Reynold Xin commented on SPARK-26193: - Can we simplify it and add those metrics only to the same

[jira] [Commented] (SPARK-26193) Implement shuffle write metrics in SQL

[ https://issues.apache.org/jira/browse/SPARK-26193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706359#comment-16706359 ] Yuanjian Li commented on SPARK-26193: - cc [~smilegator] [~cloud_fan] and [~rxin], cause the writer

[jira] [Resolved] (SPARK-26198) Metadata serialize null values throw NPE

[ https://issues.apache.org/jira/browse/SPARK-26198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-26198. --- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23164

[jira] [Assigned] (SPARK-26198) Metadata serialize null values throw NPE

[ https://issues.apache.org/jira/browse/SPARK-26198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-26198: - Assignee: Yuming Wang > Metadata serialize null values throw NPE >

[jira] [Commented] (SPARK-26034) Break large mllib/tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706176#comment-16706176 ] Apache Spark commented on SPARK-26034: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-26034) Break large mllib/tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706175#comment-16706175 ] Apache Spark commented on SPARK-26034: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Commented] (SPARK-26033) Break large ml/tests.py files into smaller files

[ https://issues.apache.org/jira/browse/SPARK-26033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706174#comment-16706174 ] Apache Spark commented on SPARK-26033: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Resolved] (SPARK-26242) Leading slash breaks proxying

[ https://issues.apache.org/jira/browse/SPARK-26242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marco Gaido resolved SPARK-26242. - Resolution: Not A Problem > Leading slash breaks proxying > - > >

[jira] [Commented] (SPARK-26242) Leading slash breaks proxying

[ https://issues.apache.org/jira/browse/SPARK-26242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706157#comment-16706157 ] Marco Gaido commented on SPARK-26242: - Let me close this. Please reopen only if you find issues. In

[jira] [Commented] (SPARK-23899) Built-in SQL Function Improvement

[ https://issues.apache.org/jira/browse/SPARK-23899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706156#comment-16706156 ] Arseniy Tashoyan commented on SPARK-23899: -- What do you think about this one: SPARK-23693? >

[jira] [Assigned] (SPARK-26080) Unable to run worker.py on Windows

[ https://issues.apache.org/jira/browse/SPARK-26080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-26080: Assignee: Hyukjin Kwon > Unable to run worker.py on Windows >

[jira] [Resolved] (SPARK-26080) Unable to run worker.py on Windows

[ https://issues.apache.org/jira/browse/SPARK-26080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26080. -- Resolution: Fixed Fix Version/s: 2.4.1 3.0.0 Issue resolved by pull

[jira] [Resolved] (SPARK-26208) Empty dataframe does not roundtrip for csv with header

[ https://issues.apache.org/jira/browse/SPARK-26208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-26208. -- Resolution: Fixed Assignee: Koert Kuipers Fix Version/s: 3.0.0 Fixed in

[jira] [Commented] (SPARK-26245) Add Float literal

[ https://issues.apache.org/jira/browse/SPARK-26245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706146#comment-16706146 ] Apache Spark commented on SPARK-26245: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-26245) Add Float literal

[ https://issues.apache.org/jira/browse/SPARK-26245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706145#comment-16706145 ] Apache Spark commented on SPARK-26245: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-26245) Add Float literal

[ https://issues.apache.org/jira/browse/SPARK-26245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26245: Assignee: Apache Spark > Add Float literal > - > > Key:

[jira] [Assigned] (SPARK-26245) Add Float literal

[ https://issues.apache.org/jira/browse/SPARK-26245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-26245: Assignee: (was: Apache Spark) > Add Float literal > - > >

[jira] [Created] (SPARK-26245) Add Float literal

Yuming Wang created SPARK-26245: --- Summary: Add Float literal Key: SPARK-26245 URL: https://issues.apache.org/jira/browse/SPARK-26245 Project: Spark Issue Type: Improvement