[jira] [Updated] (SPARK-23762) UTF8StringBuilder uses MemoryBlock

2018-04-05 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-23762: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-23879 > UTF8StringBuilder

[jira] [Updated] (SPARK-23763) OffHeapColumnVector uses MemoryBlock

2018-04-05 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-23763: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-23879 >

[jira] [Updated] (SPARK-23779) TaskMemoryManager and UnsafeSorter use MemoryBlock

2018-04-05 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-23779: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-23879 > TaskMemoryManager

[jira] [Updated] (SPARK-23879) Introduce MemoryBlock API instead of Platform API with Object

2018-04-05 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Ishizaki updated SPARK-23879: - Component/s: Spark Core > Introduce MemoryBlock API instead of Platform API with Object

[jira] [Assigned] (SPARK-23879) Introduce MemoryBlock API instead of Platform API with Object

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23879: Assignee: (was: Apache Spark) > Introduce MemoryBlock API instead of Platform API

[jira] [Assigned] (SPARK-23879) Introduce MemoryBlock API instead of Platform API with Object

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23879: Assignee: Apache Spark > Introduce MemoryBlock API instead of Platform API with Object >

[jira] [Commented] (SPARK-23879) Introduce MemoryBlock API instead of Platform API with Object

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427965#comment-16427965 ] Apache Spark commented on SPARK-23879: -- User 'kiszk' has created a pull request for this issue:

[jira] [Created] (SPARK-23879) Introduce MemoryBlock API instead of Platform API with Object

2018-04-05 Thread Kazuaki Ishizaki (JIRA)
Kazuaki Ishizaki created SPARK-23879: Summary: Introduce MemoryBlock API instead of Platform API with Object Key: SPARK-23879 URL: https://issues.apache.org/jira/browse/SPARK-23879 Project:

[jira] [Updated] (SPARK-23847) Add asc_nulls_first, asc_nulls_last to PySpark

2018-04-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23847: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-23483 > Add asc_nulls_first,

[jira] [Commented] (SPARK-23856) Spark jdbc setQueryTimeout option

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427890#comment-16427890 ] Xiao Li commented on SPARK-23856: - Yes, this sounds reasonable. Thanks! Please submit the PR to add it.

[jira] [Comment Edited] (SPARK-23878) unable to import col() or lit()

2018-04-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427889#comment-16427889 ] Hyukjin Kwon edited comment on SPARK-23878 at 4/6/18 3:34 AM: -- Hm, I use

[jira] [Commented] (SPARK-23878) unable to import col() or lit()

2018-04-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427889#comment-16427889 ] Hyukjin Kwon commented on SPARK-23878: -- Hm, I use PyCharm and I have been working fine with that

[jira] [Assigned] (SPARK-23856) Spark jdbc setQueryTimeout option

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-23856: --- Assignee: (was: Xiao Li) > Spark jdbc setQueryTimeout option >

[jira] [Assigned] (SPARK-23856) Spark jdbc setQueryTimeout option

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-23856: --- Assignee: Xiao Li > Spark jdbc setQueryTimeout option > - > >

[jira] [Commented] (SPARK-23878) unable to import col() or lit()

2018-04-05 Thread Andrew Davidson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427883#comment-16427883 ] Andrew Davidson commented on SPARK-23878: - Hi Hyukjin you are correct. Most IDE's are primarily

[jira] [Resolved] (SPARK-23817) Migrate ORC file format read path to data source V2

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23817. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.4.0 > Migrate ORC file

[jira] [Updated] (SPARK-23863) Wholetext mode should not add line breaks

2018-04-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-23863: - Fix Version/s: (was: 2.3.1) > Wholetext mode should not add line breaks >

[jira] [Resolved] (SPARK-23863) Wholetext mode should not add line breaks

2018-04-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-23863. -- Resolution: Invalid > Wholetext mode should not add line breaks >

[jira] [Resolved] (SPARK-23823) ResolveReferences loses correct origin

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-23823. - Resolution: Fixed Assignee: Jiahui Jiang Fix Version/s: 2.4.0 2.3.1 >

[jira] [Resolved] (SPARK-23870) Forward RFormula handleInvalid Param to VectorAssembler

2018-04-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-23870. --- Resolution: Fixed Fix Version/s: 2.4.0 Resolved via

[jira] [Assigned] (SPARK-23870) Forward RFormula handleInvalid Param to VectorAssembler

2018-04-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reassigned SPARK-23870: - Assignee: yogesh garg > Forward RFormula handleInvalid Param to

[jira] [Updated] (SPARK-23870) Forward RFormula handleInvalid Param to VectorAssembler

2018-04-05 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-23870: -- Fix Version/s: (was: 2.4.0) > Forward RFormula handleInvalid Param to

[jira] [Commented] (SPARK-23878) unable to import col() or lit()

2018-04-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427812#comment-16427812 ] Hyukjin Kwon commented on SPARK-23878: -- So, just to be clear, it works fine but IDE doesn't detect

[jira] [Assigned] (SPARK-13587) Support virtualenv in PySpark

2018-04-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-13587: Assignee: Jeff Zhang > Support virtualenv in PySpark > - > >

[jira] [Created] (SPARK-23878) unable to import col() or lit()

2018-04-05 Thread Andrew Davidson (JIRA)
Andrew Davidson created SPARK-23878: --- Summary: unable to import col() or lit() Key: SPARK-23878 URL: https://issues.apache.org/jira/browse/SPARK-23878 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427791#comment-16427791 ] Hyukjin Kwon commented on SPARK-23874: -- cc [~ueshin] too > Upgrade apache/arrow to 0.9.0 >

[jira] [Commented] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427746#comment-16427746 ] Apache Spark commented on SPARK-23529: -- User 'madanadit' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23529: Assignee: Anirudh Ramanathan (was: Apache Spark) > Specify hostpath volume and mount the

[jira] [Assigned] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23529: Assignee: Apache Spark (was: Anirudh Ramanathan) > Specify hostpath volume and mount the

[jira] [Assigned] (SPARK-23877) Metadata-only queries do not push down filter conditions

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23877: Assignee: Apache Spark > Metadata-only queries do not push down filter conditions >

[jira] [Assigned] (SPARK-23877) Metadata-only queries do not push down filter conditions

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23877: Assignee: (was: Apache Spark) > Metadata-only queries do not push down filter

[jira] [Commented] (SPARK-23877) Metadata-only queries do not push down filter conditions

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427743#comment-16427743 ] Apache Spark commented on SPARK-23877: -- User 'rdblue' has created a pull request for this issue:

[jira] [Created] (SPARK-23877) Metadata-only queries do not push down filter conditions

2018-04-05 Thread Ryan Blue (JIRA)
Ryan Blue created SPARK-23877: - Summary: Metadata-only queries do not push down filter conditions Key: SPARK-23877 URL: https://issues.apache.org/jira/browse/SPARK-23877 Project: Spark Issue

[jira] [Assigned] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-23874: --- Assignee: Bryan Cutler > Upgrade apache/arrow to 0.9.0 > - > >

[jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427717#comment-16427717 ] Xiao Li commented on SPARK-23874: - Thank you! [~bryanc][~hyukjin.kwon][~shaneknapp] > Upgrade

[jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-05 Thread Bryan Cutler (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427712#comment-16427712 ] Bryan Cutler commented on SPARK-23874: -- I can work on this.  I wasn't able to recreate the linked

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

2018-04-05 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427689#comment-16427689 ] Dilip Biswal commented on SPARK-21274: -- Thank you [~smilegator] Here is the link.

[jira] [Comment Edited] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes

2018-04-05 Thread Adit Madan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427650#comment-16427650 ] Adit Madan edited comment on SPARK-23529 at 4/5/18 9:50 PM: Hi [~foxish], I

[jira] [Commented] (SPARK-23529) Specify hostpath volume and mount the volume in Spark driver and executor pods in Kubernetes

2018-04-05 Thread Adit Madan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427650#comment-16427650 ] Adit Madan commented on SPARK-23529: Hi [~foxish], I also have a use case for using hostpath volumes

[jira] [Assigned] (SPARK-23816) FetchFailedException when killing speculative task

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23816: Assignee: (was: Apache Spark) > FetchFailedException when killing speculative task >

[jira] [Commented] (SPARK-23816) FetchFailedException when killing speculative task

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427633#comment-16427633 ] Apache Spark commented on SPARK-23816: -- User 'squito' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23816) FetchFailedException when killing speculative task

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23816: Assignee: Apache Spark > FetchFailedException when killing speculative task >

[jira] [Commented] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427603#comment-16427603 ] Xiao Li commented on SPARK-21274: - [~dkbiswal] [~ioana-delaney] Could you post your design doc here? >

[jira] [Updated] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21274: Target Version/s: 2.4.0, 3.0.0 (was: 2.4.0) > Implement EXCEPT ALL and INTERSECT ALL >

[jira] [Updated] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21274: Labels: (was: set sql) > Implement EXCEPT ALL and INTERSECT ALL > --

[jira] [Updated] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21274: Target Version/s: 2.4.0 > Implement EXCEPT ALL and INTERSECT ALL > --

[jira] [Updated] (SPARK-21274) Implement EXCEPT ALL and INTERSECT ALL

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21274: Component/s: (was: Optimizer) > Implement EXCEPT ALL and INTERSECT ALL >

[jira] [Commented] (SPARK-23871) add python api for VectorAssembler handleInvalid

2018-04-05 Thread yogesh garg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427543#comment-16427543 ] yogesh garg commented on SPARK-23871: - I hadn't started working on this yet. Feel free to take it. >

[jira] [Commented] (SPARK-23871) add python api for VectorAssembler handleInvalid

2018-04-05 Thread Huaxin Gao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427460#comment-16427460 ] Huaxin Gao commented on SPARK-23871: [~yogeshgarg] Are you working on this yourself? If not, may I

[jira] [Created] (SPARK-23876) OR condition in joins causes results to come back to driver

2018-04-05 Thread Aniket Arun Kulkarni (JIRA)
Aniket Arun Kulkarni created SPARK-23876: Summary: OR condition in joins causes results to come back to driver Key: SPARK-23876 URL: https://issues.apache.org/jira/browse/SPARK-23876 Project:

[jira] [Updated] (SPARK-23864) Add Unsafe* copy methods to UnsafeWriter

2018-04-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell updated SPARK-23864: -- Issue Type: Sub-task (was: Bug) Parent: SPARK-23580 > Add Unsafe* copy

[jira] [Resolved] (SPARK-23582) Add interpreted execution to StaticInvoke expression

2018-04-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23582?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23582. --- Resolution: Fixed Fix Version/s: 2.4.0 > Add interpreted execution to

[jira] [Resolved] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

2018-04-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23593. --- Resolution: Fixed > Add interpreted execution for InitializeJavaBean expression >

[jira] [Commented] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-04-05 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427377#comment-16427377 ] Thomas Graves commented on SPARK-16630: --- the problem is that spark.executor.instances (or dynamic

[jira] [Resolved] (SPARK-23865) Not able to load file from Spark Dataframes

2018-04-05 Thread Renjith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renjith resolved SPARK-23865. - Resolution: Fixed Import package was missing, added. import org.apache.spark.sql.DataFrame > Not able

[jira] [Closed] (SPARK-23865) Not able to load file from Spark Dataframes

2018-04-05 Thread Renjith (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Renjith closed SPARK-23865. --- > Not able to load file from Spark Dataframes > --- > >

[jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-05 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427265#comment-16427265 ] shane knapp commented on SPARK-23874: - yeah, we'll need to update these on the jenkins workers. will

[jira] [Assigned] (SPARK-23264) Support interval values without INTERVAL clauses

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23264: Assignee: Apache Spark (was: Takeshi Yamamuro) > Support interval values without

[jira] [Assigned] (SPARK-23264) Support interval values without INTERVAL clauses

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23264: Assignee: Takeshi Yamamuro (was: Apache Spark) > Support interval values without

[jira] [Assigned] (SPARK-23864) Add Unsafe* copy methods to UnsafeWriter

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23864: Assignee: Herman van Hovell (was: Apache Spark) > Add Unsafe* copy methods to

[jira] [Commented] (SPARK-23864) Add Unsafe* copy methods to UnsafeWriter

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427204#comment-16427204 ] Apache Spark commented on SPARK-23864: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23864) Add Unsafe* copy methods to UnsafeWriter

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23864: Assignee: Apache Spark (was: Herman van Hovell) > Add Unsafe* copy methods to

[jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-05 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427201#comment-16427201 ] Xiao Li commented on SPARK-23874: - [~bryanc] You did the update to 0.8.0 last time.

[jira] [Commented] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-04-05 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427181#comment-16427181 ] Attila Zsolt Piros commented on SPARK-16630: [~tgraves] what about stopping YARN backlisting

[jira] [Commented] (SPARK-16630) Blacklist a node if executors won't launch on it.

2018-04-05 Thread Attila Zsolt Piros (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427123#comment-16427123 ] Attila Zsolt Piros commented on SPARK-16630: [~irashid] I would reuse

[jira] [Resolved] (SPARK-23465) Dataset.withAllColumnsRenamed should map all column names to a new one

2018-04-05 Thread Mihaly Toth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mihaly Toth resolved SPARK-23465. - Resolution: Won't Fix Based on PR feedback I would conclude that this functionality is not very

[jira] [Commented] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427057#comment-16427057 ] Apache Spark commented on SPARK-23593: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23875) Create IndexedSeq wrapper for ArrayData

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23875: Assignee: (was: Apache Spark) > Create IndexedSeq wrapper for ArrayData >

[jira] [Commented] (SPARK-23875) Create IndexedSeq wrapper for ArrayData

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427034#comment-16427034 ] Apache Spark commented on SPARK-23875: -- User 'viirya' has created a pull request for this issue:

[jira] [Assigned] (SPARK-23875) Create IndexedSeq wrapper for ArrayData

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23875: Assignee: Apache Spark > Create IndexedSeq wrapper for ArrayData >

[jira] [Updated] (SPARK-23875) Create IndexedSeq wrapper for ArrayData

2018-04-05 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liang-Chi Hsieh updated SPARK-23875: Description: We don't have a good way to sequentially access {{UnsafeArrayData}} with a

[jira] [Commented] (SPARK-12216) Spark failed to delete temp directory

2018-04-05 Thread Randy Tidd (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427019#comment-16427019 ] Randy Tidd commented on SPARK-12216: This issue is not resolved please fix it.  I am having this

[jira] [Created] (SPARK-23875) Create IndexedSeq wrapper for ArrayData

2018-04-05 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-23875: --- Summary: Create IndexedSeq wrapper for ArrayData Key: SPARK-23875 URL: https://issues.apache.org/jira/browse/SPARK-23875 Project: Spark Issue Type:

[jira] [Commented] (SPARK-23747) Add EpochCoordinator unit tests

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427000#comment-16427000 ] Apache Spark commented on SPARK-23747: -- User 'efimpoberezkin' has created a pull request for this

[jira] [Assigned] (SPARK-23747) Add EpochCoordinator unit tests

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23747: Assignee: Apache Spark > Add EpochCoordinator unit tests >

[jira] [Assigned] (SPARK-23747) Add EpochCoordinator unit tests

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23747: Assignee: (was: Apache Spark) > Add EpochCoordinator unit tests >

[jira] [Assigned] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23593: Assignee: Apache Spark (was: Liang-Chi Hsieh) > Add interpreted execution for

[jira] [Assigned] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23593: Assignee: Liang-Chi Hsieh (was: Apache Spark) > Add interpreted execution for

[jira] [Commented] (SPARK-23874) Upgrade apache/arrow to 0.9.0

2018-04-05 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426857#comment-16426857 ] Hyukjin Kwon commented on SPARK-23874: -- If anyone does this, will help review. If it's open for a

[jira] [Reopened] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

2018-04-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reopened SPARK-23593: --- PR was prematurely merged. > Add interpreted execution for InitializeJavaBean

[jira] [Assigned] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

2018-04-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reassigned SPARK-23593: - Assignee: Liang-Chi Hsieh > Add interpreted execution for InitializeJavaBean

[jira] [Resolved] (SPARK-23593) Add interpreted execution for InitializeJavaBean expression

2018-04-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-23593. --- Resolution: Fixed Fix Version/s: 2.4.0 > Add interpreted execution for

[jira] [Assigned] (SPARK-23859) Initial PR for Instrumentation improvements: UUID and logging levels

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23859: Assignee: Weichen Xu (was: Apache Spark) > Initial PR for Instrumentation improvements:

[jira] [Commented] (SPARK-23859) Initial PR for Instrumentation improvements: UUID and logging levels

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16426727#comment-16426727 ] Apache Spark commented on SPARK-23859: -- User 'WeichenXu123' has created a pull request for this

[jira] [Assigned] (SPARK-23859) Initial PR for Instrumentation improvements: UUID and logging levels

2018-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-23859: Assignee: Apache Spark (was: Weichen Xu) > Initial PR for Instrumentation improvements:

[jira] [Commented] (SPARK-12823) Cannot create UDF with StructType input

2018-04-05 Thread todesking (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1642#comment-1642 ] todesking commented on SPARK-12823: --- I understand currently Spark not supported struct/array types in

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

[jira] [Updated] (SPARK-23872) Can not connect to another metastore uri using two Spark sessions

2018-04-05 Thread Park Chan Min (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Park Chan Min updated SPARK-23872: -- Description: In Spark 2.1.0, two sessions worked normally In 2.3.0, the first session

  1   2   >