[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354440#comment-16354440
]
Tejas Patil commented on SPARK-19256:
-
[~ferdonline] : The feature you are referring to is not in the
[
https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16354429#comment-16354429
]
Tejas Patil commented on SPARK-18067:
-
[~eyalfa] :
Re #1: Theoretically this idea should help
[
https://issues.apache.org/jira/browse/SPARK-23034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321529#comment-16321529
]
Tejas Patil commented on SPARK-23034:
-
[~dongjoon] recommended that the scope of this JIRA could be
Tejas Patil created SPARK-23034:
---
Summary: Display tablename for `HiveTableScan` node in UI
Key: SPARK-23034
URL: https://issues.apache.org/jira/browse/SPARK-23034
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248745#comment-16248745
]
Tejas Patil commented on SPARK-22042:
-
Am trying out the suggestion discussed in
[
https://issues.apache.org/jira/browse/SPARK-21649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil resolved SPARK-21649.
-
Resolution: Duplicate
> Support writing data into hive bucket table.
>
[
https://issues.apache.org/jira/browse/SPARK-21649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16200428#comment-16200428
]
Tejas Patil commented on SPARK-21649:
-
yes. It is duplicate of SPARK-19256
> Support writing data
[
https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195929#comment-16195929
]
Tejas Patil commented on SPARK-0:
-
Does this repro with current spark trunk (over CLI) ? I could
[
https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16195927#comment-16195927
]
Tejas Patil commented on SPARK-0:
-
Whats the full stack trace for `NullPointerException` ?
>
[
https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169148#comment-16169148
]
Tejas Patil edited comment on SPARK-22042 at 9/17/17 1:09 AM:
--
At the core,
[
https://issues.apache.org/jira/browse/SPARK-22042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16169148#comment-16169148
]
Tejas Patil commented on SPARK-22042:
-
At the core, the problem is `ReorderJoinPredicates` expects
Tejas Patil created SPARK-22042:
---
Summary: ReorderJoinPredicates can break when child's partitioning
is not decided
Key: SPARK-22042
URL: https://issues.apache.org/jira/browse/SPARK-22042
Project:
[
https://issues.apache.org/jira/browse/SPARK-20313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148463#comment-16148463
]
Tejas Patil commented on SPARK-20313:
-
I tried to replicate what you shared in the jira but dont see
[
https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141748#comment-16141748
]
Tejas Patil commented on SPARK-18067:
-
PR: https://github.com/apache/spark/pull/19054
>
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134268#comment-16134268
]
Tejas Patil commented on SPARK-19256:
-
Opened a PR which has both reader and writer side changes :
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128305#comment-16128305
]
Tejas Patil commented on SPARK-19256:
-
PR for writer side changes is out :
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16125084#comment-16125084
]
Tejas Patil commented on SPARK-19256:
-
After the refactoring of the insertion plan node has been
[
https://issues.apache.org/jira/browse/SPARK-21595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16114694#comment-16114694
]
Tejas Patil commented on SPARK-21595:
-
[~sreiling] Spilling will happen only when _both_ these are
[
https://issues.apache.org/jira/browse/SPARK-21595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16113622#comment-16113622
]
Tejas Patil commented on SPARK-21595:
-
[~hvanhovell] : I am fine with either options you mentioned.
[
https://issues.apache.org/jira/browse/SPARK-21595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110053#comment-16110053
]
Tejas Patil commented on SPARK-21595:
-
This config was introduced by me in SPARK-13450. The reason
[
https://issues.apache.org/jira/browse/SPARK-21079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16048381#comment-16048381
]
Tejas Patil commented on SPARK-21079:
-
[~ZenWzh] The reason why unit tests won't catch this is
[
https://issues.apache.org/jira/browse/SPARK-15905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil closed SPARK-15905.
---
Resolution: Cannot Reproduce
> Driver hung while writing to console progress bar
>
[
https://issues.apache.org/jira/browse/SPARK-15905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029846#comment-16029846
]
Tejas Patil commented on SPARK-15905:
-
I haven't seen this in a while with Spark 2.0. Closing. If
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019109#comment-16019109
]
Tejas Patil commented on SPARK-19256:
-
[~cloud_fan] : After SPARK-18243, `InsertIntoHiveTable` is a
Tejas Patil created SPARK-20758:
---
Summary: Add Constant propagation optimization
Key: SPARK-20758
URL: https://issues.apache.org/jira/browse/SPARK-20758
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009978#comment-16009978
]
Tejas Patil commented on SPARK-20703:
-
for dynamic partitioned tables, number of partitions produced
[
https://issues.apache.org/jira/browse/SPARK-20703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009977#comment-16009977
]
Tejas Patil commented on SPARK-20703:
-
[~viirya] :
- Would this new operator be a physical plan node
[
https://issues.apache.org/jira/browse/SPARK-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16009165#comment-16009165
]
Tejas Patil commented on SPARK-19122:
-
Thanks for confirming. I have added it in the jira description
[
https://issues.apache.org/jira/browse/SPARK-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-19122:
Description:
`table1` and `table2` are sorted and bucketed on columns `j` and `k` (in
respective
[
https://issues.apache.org/jira/browse/SPARK-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16008266#comment-16008266
]
Tejas Patil commented on SPARK-19122:
-
[~cloud_fan]:
- The test case in the [associated PR
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989560#comment-15989560
]
Tejas Patil commented on SPARK-19256:
-
[~cloud_fan], [~sameerag] : I was looking at trunk and
Tejas Patil created SPARK-20487:
---
Summary: `HiveTableScan` node is quite verbose in explained plan
Key: SPARK-20487
URL: https://issues.apache.org/jira/browse/SPARK-20487
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-20184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966300#comment-15966300
]
Tejas Patil commented on SPARK-20184:
-
Out of curiosity, I tried out a query with ~20 columns
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956353#comment-15956353
]
Tejas Patil commented on SPARK-17495:
-
[~dricard] : this does not intend to break any existing
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15907534#comment-15907534
]
Tejas Patil commented on SPARK-17495:
-
Yes. Thats a better way. At this point all datatypes are
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil reopened SPARK-17495:
-
> Hive hash implementation
>
>
> Key: SPARK-17495
>
Tejas Patil created SPARK-19843:
---
Summary: UTF8String => (int / long) conversion expensive for
invalid inputs
Key: SPARK-19843
URL: https://issues.apache.org/jira/browse/SPARK-19843
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil reopened SPARK-17495:
-
Re-opening. This is not done yet as there are time related datatypes that need
to be handled and
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889645#comment-15889645
]
Tejas Patil commented on SPARK-17495:
-
>> Is it possible to figure out the hashing function based on
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889090#comment-15889090
]
Tejas Patil commented on SPARK-17495:
-
[~rxin]:
>> 1. On the read side we shouldn't care which hash
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883203#comment-15883203
]
Tejas Patil edited comment on SPARK-17495 at 2/24/17 5:57 PM:
--
[~rxin] : No
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883203#comment-15883203
]
Tejas Patil commented on SPARK-17495:
-
[~rxin] : No probs. Any opinion about my comment from
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil reopened SPARK-17495:
-
Re-opening. This is not done yet as there are few datatypes that need to be
handled and making
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882161#comment-15882161
]
Tejas Patil commented on SPARK-17495:
-
I am looking into using hive-hash when `hash()` in called in a
[
https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869314#comment-15869314
]
Tejas Patil commented on SPARK-19326:
-
> You might be able to just write an `if` case that checks
[
https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869112#comment-15869112
]
Tejas Patil commented on SPARK-19326:
-
Thanks for the info !!
[~andrewor14] / [~kayousterhout] : I
Tejas Patil created SPARK-19618:
---
Summary: Inconsistency wrt max. buckets allowed from Dataframe API
vs SQL
Key: SPARK-19618
URL: https://issues.apache.org/jira/browse/SPARK-19618
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868889#comment-15868889
]
Tejas Patil commented on SPARK-19326:
-
[~andrewor14] : Ping !!
> Speculated task attempts do not get
[
https://issues.apache.org/jira/browse/SPARK-19587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-19587:
Description:
This came up in discussion at
Tejas Patil created SPARK-19587:
---
Summary: Disallow when sort columns are part of partitioning
columns
Key: SPARK-19587
URL: https://issues.apache.org/jira/browse/SPARK-19587
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-19493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15863244#comment-15863244
]
Tejas Patil commented on SPARK-19493:
-
+1 for removing Java 7
> Remove Java 7 support
>
[
https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851006#comment-15851006
]
Tejas Patil commented on SPARK-19326:
-
[~kayousterhout] : I have updated the configs in the repro
[
https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-19326:
Description:
Speculated copies of tasks do not get launched in some cases.
Examples:
- All the
[
https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-19326:
Description:
Speculated copies of tasks do not get launched in some cases.
Examples:
- All the
[
https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15850214#comment-15850214
]
Tejas Patil commented on SPARK-19326:
-
ping [~kayousterhout], [~irashid] [~vanzin] !!
> Speculated
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837302#comment-15837302
]
Tejas Patil commented on SPARK-19256:
-
BTW: In its current state, Spark writes data to hive bucketed
[
https://issues.apache.org/jira/browse/SPARK-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837300#comment-15837300
]
Tejas Patil commented on SPARK-19122:
-
[~hvanhovell] : ping !! If you are busy, can you suggest
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15837294#comment-15837294
]
Tejas Patil commented on SPARK-19256:
-
[~cloud_fan] [~hvanhovell] : Are you guys ok with the proposal
[
https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-19326:
Description:
Speculated copies of tasks do not get launched in some cases.
Examples:
- All the
[
https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15833270#comment-15833270
]
Tejas Patil commented on SPARK-19326:
-
cc [~kayousterhout], [~irashid] [~vanzin]
Tejas Patil created SPARK-19326:
---
Summary: Speculated task attempts do not get launched in few
scenarios
Key: SPARK-19326
URL: https://issues.apache.org/jira/browse/SPARK-19326
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-17654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-17654:
Issue Type: Sub-task (was: Bug)
Parent: SPARK-19256
> Propagate bucketing information for
[
https://issues.apache.org/jira/browse/SPARK-17487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-17487:
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-19256
> Configurable bucketing info
[
https://issues.apache.org/jira/browse/SPARK-17570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-17570:
Issue Type: Improvement (was: Sub-task)
Parent: (was: SPARK-18245)
> Avoid Hash and
[
https://issues.apache.org/jira/browse/SPARK-17487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-17487:
Issue Type: Improvement (was: Sub-task)
Parent: (was: SPARK-18245)
> Configurable
[
https://issues.apache.org/jira/browse/SPARK-17570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-17570:
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-19256
> Avoid Hash and Exchange in
[
https://issues.apache.org/jira/browse/SPARK-17729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-17729:
Issue Type: Improvement (was: Sub-task)
Parent: (was: SPARK-18245)
> Enable creating
[
https://issues.apache.org/jira/browse/SPARK-17729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-17729:
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-19256
> Enable creating hive
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-17495:
Issue Type: Sub-task (was: Improvement)
Parent: SPARK-19256
> Hive hash implementation
>
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-17495:
Issue Type: Improvement (was: Sub-task)
Parent: (was: SPARK-18245)
> Hive hash
[
https://issues.apache.org/jira/browse/SPARK-19256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15825494#comment-15825494
]
Tejas Patil commented on SPARK-19256:
-
cc [~cloud_fan] [~hvanhovell] for comments over the proposal
Tejas Patil created SPARK-19256:
---
Summary: Hive bucketing support
Key: SPARK-19256
URL: https://issues.apache.org/jira/browse/SPARK-19256
Project: Spark
Issue Type: Umbrella
[
https://issues.apache.org/jira/browse/SPARK-13450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15812508#comment-15812508
]
Tejas Patil edited comment on SPARK-13450 at 1/9/17 6:48 PM:
-
I have seen
[
https://issues.apache.org/jira/browse/SPARK-13450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-13450:
Attachment: heap-dump-analysis.png
> SortMergeJoin will OOM when join rows have lot of same keys
>
[
https://issues.apache.org/jira/browse/SPARK-13450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil reopened SPARK-13450:
-
I have seen this problem a couple times in prod while trying out jobs over
Spark. There have been
[
https://issues.apache.org/jira/browse/SPARK-13450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-13450:
Affects Version/s: 2.0.2
2.1.0
> SortMergeJoin will OOM when join rows have
[
https://issues.apache.org/jira/browse/SPARK-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-19122:
Description:
`table1` and `table2` are sorted and bucketed on columns `j` and `k` (in
respective
[
https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15808507#comment-15808507
]
Tejas Patil commented on SPARK-18067:
-
[~hvanhovell] :
* You are right about the data distribution.
[
https://issues.apache.org/jira/browse/SPARK-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15808485#comment-15808485
]
Tejas Patil edited comment on SPARK-19122 at 1/8/17 1:44 AM:
-
[~hvanhovell] :
[
https://issues.apache.org/jira/browse/SPARK-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15808485#comment-15808485
]
Tejas Patil commented on SPARK-19122:
-
[~hvanhovell] : In a broader level, I see that when nodes for
[
https://issues.apache.org/jira/browse/SPARK-19122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15808479#comment-15808479
]
Tejas Patil commented on SPARK-19122:
-
When a `SortMergeJoinExec` node is created, the join keys in
Tejas Patil created SPARK-19122:
---
Summary: Unnecessary shuffle+sort added if join predicates
ordering differ from bucketing and sorting order
Key: SPARK-19122
URL: https://issues.apache.org/jira/browse/SPARK-19122
[
https://issues.apache.org/jira/browse/SPARK-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627120#comment-15627120
]
Tejas Patil commented on SPARK-15867:
-
Yes. I am interested in this support.
> TABLESAMPLE BUCKET
[
https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-18067:
Summary: SortMergeJoin adds shuffle if join predicates have non partitioned
columns (was: Adding
[
https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600824#comment-15600824
]
Tejas Patil edited comment on SPARK-18067 at 10/24/16 3:35 AM:
---
[
https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600824#comment-15600824
]
Tejas Patil commented on SPARK-18067:
-
[~hvanhovell] : Tagging you since you have context of this
[
https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600820#comment-15600820
]
Tejas Patil commented on SPARK-18067:
-
The predicate `value1 === value2` is pushed down to the Join
[
https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600788#comment-15600788
]
Tejas Patil edited comment on SPARK-18067 at 10/24/16 3:12 AM:
---
You could
[
https://issues.apache.org/jira/browse/SPARK-18067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600788#comment-15600788
]
Tejas Patil commented on SPARK-18067:
-
You could do :
{norformat}
val joinedOutput =
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599977#comment-15599977
]
Tejas Patil commented on SPARK-17495:
-
[~rxin] : Sorry about that. In my original PR I intentionally
[
https://issues.apache.org/jira/browse/SPARK-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15599965#comment-15599965
]
Tejas Patil commented on SPARK-17495:
-
[~hvanhovell] : There were two datatypes that I had added TODO
[
https://issues.apache.org/jira/browse/SPARK-15453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-15453:
Summary: FileSourceScanExec to extract `outputOrdering` information (was:
Improve join planning
[
https://issues.apache.org/jira/browse/SPARK-18035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-18035:
Summary: Introduce performant and memory efficient APIs to create
ArrayBasedMapData (was:
[
https://issues.apache.org/jira/browse/SPARK-18038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593478#comment-15593478
]
Tejas Patil commented on SPARK-18038:
-
Not sure if this deserves a jira but created one. This is a
Tejas Patil created SPARK-18038:
---
Summary: Move output partitioning definition from UnaryNodeExec to
its children
Key: SPARK-18038
URL: https://issues.apache.org/jira/browse/SPARK-18038
Project: Spark
Tejas Patil created SPARK-18035:
---
Summary: Unwrapping java maps in HiveInspectors allocates
unnecessary buffer
Key: SPARK-18035
URL: https://issues.apache.org/jira/browse/SPARK-18035
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-18035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tejas Patil updated SPARK-18035:
Description:
In HiveInspectors, I saw that converting Java map to Spark's
`ArrayBasedMapData`
[
https://issues.apache.org/jira/browse/SPARK-17954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15579262#comment-15579262
]
Tejas Patil commented on SPARK-17954:
-
I agree with [~srowen]'s comment about this being more of a
[
https://issues.apache.org/jira/browse/SPARK-17487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15563756#comment-15563756
]
Tejas Patil commented on SPARK-17487:
-
[~rxin] : Since Spark native tables and hive tables follow a
Tejas Patil created SPARK-17741:
---
Summary: Grammar to parse top level and nested data fields
separately
Key: SPARK-17741
URL: https://issues.apache.org/jira/browse/SPARK-17741
Project: Spark
1 - 100 of 179 matches
Mail list logo
