[jira] [Updated] (SPARK-27322) DataSourceV2: Select from multiple catalogs

2019-05-25 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge updated SPARK-27322: --- Summary: DataSourceV2: Select from multiple catalogs (was: DataSourceV2: Logical relation in multip

[jira] [Updated] (SPARK-27147) Create new unit test cases for SortShuffleWriter

2019-05-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27147: -- Component/s: Tests > Create new unit test cases for SortShuffleWriter > --

[jira] [Updated] (SPARK-27147) Create new unit test cases for SortShuffleWriter

2019-05-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-27147: -- Issue Type: Improvement (was: Test) > Create new unit test cases for SortShuffleWriter >

[jira] [Resolved] (SPARK-27147) Create new unit test cases for SortShuffleWriter

2019-05-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27147. --- Resolution: Fixed Assignee: wangjiaochun This is resolved via https://github.com/apach

[jira] [Assigned] (SPARK-27841) Improve UTF8String fromString()/toString()/numChars() performance when strings are ASCII

2019-05-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27841: Assignee: Josh Rosen (was: Apache Spark) > Improve UTF8String fromString()/toString()/nu

[jira] [Assigned] (SPARK-27841) Improve UTF8String fromString()/toString()/numChars() performance when strings are ASCII

2019-05-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27841: Assignee: Apache Spark (was: Josh Rosen) > Improve UTF8String fromString()/toString()/nu

[jira] [Resolved] (SPARK-27711) InputFileBlockHolder should be unset at the end of tasks

2019-05-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27711. --- Resolution: Fixed Assignee: Jose Torres Fix Version/s: 3.0.0

[jira] [Created] (SPARK-27841) Improve UTF8String fromString()/toString()/numChars() performance when strings are ASCII

2019-05-25 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-27841: -- Summary: Improve UTF8String fromString()/toString()/numChars() performance when strings are ASCII Key: SPARK-27841 URL: https://issues.apache.org/jira/browse/SPARK-27841

[jira] [Resolved] (SPARK-27801) InMemoryFileIndex.listLeafFiles should use listLocatedStatus for DistributedFileSystem

2019-05-25 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-27801. --- Resolution: Fixed Assignee: Rob Russo Fix Version/s: 3.0.0 This is resolved

[jira] [Resolved] (SPARK-27840) Hadoop attempts to create a temporary folder in root folder

2019-05-25 Thread M. Le Bihan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] M. Le Bihan resolved SPARK-27840. - Resolution: Not A Bug Was mine own bug... > Hadoop attempts to create a temporary folder in roo

[jira] [Created] (SPARK-27840) Hadoop attempts to create a temporary folder in root folder

2019-05-25 Thread M. Le Bihan (JIRA)
M. Le Bihan created SPARK-27840: --- Summary: Hadoop attempts to create a temporary folder in root folder Key: SPARK-27840 URL: https://issues.apache.org/jira/browse/SPARK-27840 Project: Spark Is

[jira] [Commented] (SPARK-27837) Running rand() in SQL with seed of column results in error (rand(col1))

2019-05-25 Thread Jason Ferrell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848200#comment-16848200 ] Jason Ferrell commented on SPARK-27837: --- Is there any way to get this into an enha

[jira] [Commented] (SPARK-27837) Running rand() in SQL with seed of column results in error (rand(col1))

2019-05-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848125#comment-16848125 ] Liang-Chi Hsieh commented on SPARK-27837: - Please see the analysis exception: In

[jira] [Commented] (SPARK-27836) Issue with seeded rand() function in Spark SQL

2019-05-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848124#comment-16848124 ] Liang-Chi Hsieh commented on SPARK-27836: - rand function initializes only once w

[jira] [Commented] (SPARK-27837) Running rand() in SQL with seed of column results in error (rand(col1))

2019-05-25 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848123#comment-16848123 ] Liang-Chi Hsieh commented on SPARK-27837: - The problem isn't that val1 isn't an

[jira] [Commented] (SPARK-24149) Automatic namespaces discovery in HDFS federation

2019-05-25 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848097#comment-16848097 ] Marco Gaido commented on SPARK-24149: - [~Dhruve Ashar] the use case for this change,

[jira] [Assigned] (SPARK-27839) Improve UTF8String.replace() / StringReplace performance

2019-05-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27839: Assignee: Josh Rosen (was: Apache Spark) > Improve UTF8String.replace() / StringReplace

[jira] [Assigned] (SPARK-27839) Improve UTF8String.replace() / StringReplace performance

2019-05-25 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-27839: Assignee: Apache Spark (was: Josh Rosen) > Improve UTF8String.replace() / StringReplace

[jira] [Created] (SPARK-27839) Improve UTF8String.replace() / StringReplace performance

2019-05-25 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-27839: -- Summary: Improve UTF8String.replace() / StringReplace performance Key: SPARK-27839 URL: https://issues.apache.org/jira/browse/SPARK-27839 Project: Spark Issue Ty