[jira] [Updated] (SPARK-22036) BigDecimal multiplication sometimes returns null

2017-09-17 Thread Olivier Blanvillain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier Blanvillain updated SPARK-22036: Description: The multiplication of two BigDecimal numbers sometimes returns null.

[jira] [Commented] (SPARK-22040) current_date function with timezone id

2017-09-17 Thread Jacek Laskowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169215#comment-16169215 ] Jacek Laskowski commented on SPARK-22040: - That'd be awesome! It's yours, [~mgaido] >

[jira] [Commented] (SPARK-22041) Docker test case failure: `SPARK-16625: General data types to be mapped to Oracle`

2017-09-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169220#comment-16169220 ] Yuming Wang commented on SPARK-22041: - I know the reason, will fix it soon. > Docker test case

[jira] [Created] (SPARK-22045) creating and starting a NetCat in test case programmatically

2017-09-17 Thread bluejoe (JIRA)
bluejoe created SPARK-22045: --- Summary: creating and starting a NetCat in test case programmatically Key: SPARK-22045 URL: https://issues.apache.org/jira/browse/SPARK-22045 Project: Spark Issue

[jira] [Commented] (SPARK-22045) creating and starting a NetCat in test case programmatically

2017-09-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169298#comment-16169298 ] Sean Owen commented on SPARK-22045: --- What is the use of this in Spark? > creating and starting a

[jira] [Commented] (SPARK-22039) Spark 2.1.1 Driver OOM when use interaction for large scale Sparse Vector

2017-09-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169228#comment-16169228 ] Hyukjin Kwon commented on SPARK-22039: -- Please check out https://spark.apache.org/community.html. >

[jira] [Updated] (SPARK-22045) creating and starting a NetCat in test cases programmatically

2017-09-17 Thread bluejoe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bluejoe updated SPARK-22045: Summary: creating and starting a NetCat in test cases programmatically (was: creating and starting a

[jira] [Comment Edited] (SPARK-22045) creating and starting a NetCat in test case programmatically

2017-09-17 Thread bluejoe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169302#comment-16169302 ] bluejoe edited comment on SPARK-22045 at 9/17/17 1:44 PM: -- when testing spark

[jira] [Assigned] (SPARK-22040) current_date function with timezone id

2017-09-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22040: Assignee: (was: Apache Spark) > current_date function with timezone id >

[jira] [Commented] (SPARK-22040) current_date function with timezone id

2017-09-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169272#comment-16169272 ] Apache Spark commented on SPARK-22040: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22040) current_date function with timezone id

2017-09-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22040: Assignee: Apache Spark > current_date function with timezone id >

[jira] [Commented] (SPARK-22045) creating and starting a NetCat in test case programmatically

2017-09-17 Thread bluejoe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169302#comment-16169302 ] bluejoe commented on SPARK-22045: - when testing spark streaming like: {code:java} val lines =

[jira] [Updated] (SPARK-22045) creating and starting a NetCat in test cases programmatically

2017-09-17 Thread bluejoe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] bluejoe updated SPARK-22045: Flags: Patch,Important (was: Patch) > creating and starting a NetCat in test cases programmatically >

[jira] [Commented] (SPARK-16625) Oracle JDBC table creation fails with ORA-00902: invalid datatype

2017-09-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169232#comment-16169232 ] Apache Spark commented on SPARK-16625: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-22041) Docker test case failure: `SPARK-16625: General data types to be mapped to Oracle`

2017-09-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169231#comment-16169231 ] Apache Spark commented on SPARK-22041: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-19318) Docker test case failure: `SPARK-16625: General data types to be mapped to Oracle`

2017-09-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169230#comment-16169230 ] Apache Spark commented on SPARK-19318: -- User 'wangyum' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22041) Docker test case failure: `SPARK-16625: General data types to be mapped to Oracle`

2017-09-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22041: Assignee: (was: Apache Spark) > Docker test case failure: `SPARK-16625: General data

[jira] [Assigned] (SPARK-22041) Docker test case failure: `SPARK-16625: General data types to be mapped to Oracle`

2017-09-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22041: Assignee: Apache Spark > Docker test case failure: `SPARK-16625: General data types to be

[jira] [Assigned] (SPARK-22043) Python profile, show_profiles() and dump_profiles(), should throw an error with a better message

2017-09-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22043: Assignee: (was: Apache Spark) > Python profile, show_profiles() and dump_profiles(),

[jira] [Commented] (SPARK-22043) Python profile, show_profiles() and dump_profiles(), should throw an error with a better message

2017-09-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169267#comment-16169267 ] Apache Spark commented on SPARK-22043: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-22043) Python profile, show_profiles() and dump_profiles(), should throw an error with a better message

2017-09-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22043: Assignee: Apache Spark > Python profile, show_profiles() and dump_profiles(), should

[jira] [Created] (SPARK-22044) explain function with codegen and cost parameters

2017-09-17 Thread Jacek Laskowski (JIRA)
Jacek Laskowski created SPARK-22044: --- Summary: explain function with codegen and cost parameters Key: SPARK-22044 URL: https://issues.apache.org/jira/browse/SPARK-22044 Project: Spark

[jira] [Issue Comment Deleted] (SPARK-22041) Docker test case failure: `SPARK-16625: General data types to be mapped to Oracle`

2017-09-17 Thread Yuming Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuming Wang updated SPARK-22041: Comment: was deleted (was: I know the reason, will fix it soon.) > Docker test case failure:

[jira] [Created] (SPARK-22043) Python profile, show_profiles() and dump_profiles(), should throw an error with a better message

2017-09-17 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-22043: Summary: Python profile, show_profiles() and dump_profiles(), should throw an error with a better message Key: SPARK-22043 URL: https://issues.apache.org/jira/browse/SPARK-22043

[jira] [Resolved] (SPARK-22045) creating and starting a NetCat in test cases programmatically

2017-09-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22045. --- Resolution: Not A Problem The test harness doesn't require this. It's just an example. If somehow

[jira] [Commented] (SPARK-22033) BufferHolder size checks should account for the specific VM array size limitations

2017-09-17 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169318#comment-16169318 ] Kazuaki Ishizaki commented on SPARK-22033: -- I think {{ColumnVector}} and

[jira] [Resolved] (SPARK-21985) PySpark PairDeserializer is broken for double-zipped RDDs

2017-09-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-21985. -- Resolution: Fixed Fix Version/s: 2.1.2 2.3.0 2.2.1

[jira] [Assigned] (SPARK-21985) PySpark PairDeserializer is broken for double-zipped RDDs

2017-09-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-21985: Assignee: Andrew Ray > PySpark PairDeserializer is broken for double-zipped RDDs >

[jira] [Resolved] (SPARK-22032) Speed up StructType.fromInternal

2017-09-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22032. -- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19249

[jira] [Assigned] (SPARK-22032) Speed up StructType.fromInternal

2017-09-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22032: Assignee: Maciej BryƄski > Speed up StructType.fromInternal >

[jira] [Resolved] (SPARK-22043) Python profile, show_profiles() and dump_profiles(), should throw an error with a better message

2017-09-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-22043. -- Resolution: Fixed Fix Version/s: 2.1.2 2.3.0 2.2.1

[jira] [Assigned] (SPARK-22043) Python profile, show_profiles() and dump_profiles(), should throw an error with a better message

2017-09-17 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-22043: Assignee: Hyukjin Kwon > Python profile, show_profiles() and dump_profiles(), should

[jira] [Commented] (SPARK-21802) Make sparkR MLP summary() expose probability column

2017-09-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169575#comment-16169575 ] Felix Cheung commented on SPARK-21802: -- yes if this is from the prediction (with rawPrediction etc)

[jira] [Commented] (SPARK-18131) Support returning Vector/Dense Vector from backend

2017-09-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169579#comment-16169579 ] Felix Cheung commented on SPARK-18131: -- bump. I think this is a real big problem - results from

[jira] [Commented] (SPARK-18406) Race between end-of-task and completion iterator read lock release

2017-09-17 Thread Yongqin Xiao (JIRA)
[ https://issues-test.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167180#comment-16167180 ] Yongqin Xiao commented on SPARK-18406: -- [~cloud_fan], I see there are 3 check-ins for this

[jira] [Commented] (SPARK-18406) Race between end-of-task and completion iterator read lock release

2017-09-17 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169586#comment-16169586 ] Hadoop QA commented on SPARK-18406: --- [

[jira] [Comment Edited] (SPARK-21842) Support Kerberos ticket renewal and creation in Mesos

2017-09-17 Thread Arthur Rand (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16168278#comment-16168278 ] Arthur Rand edited comment on SPARK-21842 at 9/18/17 12:42 AM: --- Hey

[jira] [Assigned] (SPARK-21953) Show both memory and disk bytes spilled if either is present

2017-09-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-21953: --- Assignee: Andrew Ash > Show both memory and disk bytes spilled if either is present >

[jira] [Resolved] (SPARK-21953) Show both memory and disk bytes spilled if either is present

2017-09-17 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-21953. - Resolution: Fixed Fix Version/s: 2.1.2 2.3.0 2.2.1

[jira] [Commented] (SPARK-21802) Make sparkR MLP summary() expose probability column

2017-09-17 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169535#comment-16169535 ] Weichen Xu commented on SPARK-21802: [~felixcheung] The probability cannot be added to the result of

[jira] [Commented] (SPARK-21802) Make sparkR MLP summary() expose probability column

2017-09-17 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169487#comment-16169487 ] Felix Cheung commented on SPARK-21802: -- Can you clarify where you see it? I just ran against the

[jira] [Commented] (SPARK-20221) Port pyspark.mllib.linalg tests in pyspark/mllib/tests.py to pyspark.ml.linalg

2017-09-17 Thread Daniel Imberman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169502#comment-16169502 ] Daniel Imberman commented on SPARK-20221: - Hi [~josephkb], I would like to complete this ticket

[jira] [Comment Edited] (SPARK-21802) Make sparkR MLP summary() expose probability column

2017-09-17 Thread Weichen Xu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169535#comment-16169535 ] Weichen Xu edited comment on SPARK-21802 at 9/18/17 3:42 AM: - [~felixcheung]