caoxuewen created SPARK-26289:
-
Summary: cleanup enablePerfMetrics parameter from BytesToBytesMap
Key: SPARK-26289
URL: https://issues.apache.org/jira/browse/SPARK-26289
Project: Spark
Issue
caoxuewen created SPARK-26271:
-
Summary: remove unuse object SparkPlan
Key: SPARK-26271
URL: https://issues.apache.org/jira/browse/SPARK-26271
Project: Spark
Issue Type: Improvement
caoxuewen created SPARK-26180:
-
Summary: Add a withCreateTempDir function to the SparkCore test
case
Key: SPARK-26180
URL: https://issues.apache.org/jira/browse/SPARK-26180
Project: Spark
Issue
caoxuewen created SPARK-26117:
-
Summary: use SparkOutOfMemoryError instead of OutOfMemoryError
when catch exception
Key: SPARK-26117
URL: https://issues.apache.org/jira/browse/SPARK-26117
Project: Spark
caoxuewen created SPARK-26073:
-
Summary: remove invalid comment as we don't use it anymore
Key: SPARK-26073
URL: https://issues.apache.org/jira/browse/SPARK-26073
Project: Spark
Issue Type:
caoxuewen created SPARK-26072:
-
Summary: remove invalid comment as we don't use it anymore
Key: SPARK-26072
URL: https://issues.apache.org/jira/browse/SPARK-26072
Project: Spark
Issue Type:
caoxuewen created SPARK-26001:
-
Summary: Reduce memory copy when writing decimal
Key: SPARK-26001
URL: https://issues.apache.org/jira/browse/SPARK-26001
Project: Spark
Issue Type: Improvement
caoxuewen created SPARK-25974:
-
Summary: Optimizes Generates bytecode for ordering based on the
given order
Key: SPARK-25974
URL: https://issues.apache.org/jira/browse/SPARK-25974
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-24066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-24066:
--
Description:
Currently, when two adjacent window functions have the same partition and the
same
[
https://issues.apache.org/jira/browse/SPARK-24066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-24066:
--
Summary: Add new optimization rule to eliminate unnecessary sort by
exchanged adjacent Window
caoxuewen created SPARK-25848:
-
Summary: Refactor CSVBenchmarks to use main method
Key: SPARK-25848
URL: https://issues.apache.org/jira/browse/SPARK-25848
Project: Spark
Issue Type: Improvement
caoxuewen created SPARK-25847:
-
Summary: Refactor JSONBenchmarks to use main method
Key: SPARK-25847
URL: https://issues.apache.org/jira/browse/SPARK-25847
Project: Spark
Issue Type: Improvement
caoxuewen created SPARK-25846:
-
Summary: Refactor ExternalAppendOnlyUnsafeRowArrayBenchmark to use
main method
Key: SPARK-25846
URL: https://issues.apache.org/jira/browse/SPARK-25846
Project: Spark
caoxuewen created SPARK-25755:
-
Summary: Supplementation of non-CodeGen unit tested for
BroadcastHashJoinExec
Key: SPARK-25755
URL: https://issues.apache.org/jira/browse/SPARK-25755
Project: Spark
caoxuewen created SPARK-24999:
-
Summary: Reduce unnecessary 'new' memory operations
Key: SPARK-24999
URL: https://issues.apache.org/jira/browse/SPARK-24999
Project: Spark
Issue Type: Improvement
caoxuewen created SPARK-24978:
-
Summary: Add spark.sql.fast.hash.aggregate.row.max.capacity to
configure the capacity of fast aggregation.
Key: SPARK-24978
URL: https://issues.apache.org/jira/browse/SPARK-24978
caoxuewen created SPARK-24901:
-
Summary: Merge the codegen of RegularHashMap and fastHashMap to
reduce compiler maxCodesize when VectorizedHashMap is false
Key: SPARK-24901
URL:
caoxuewen created SPARK-24066:
-
Summary: Add a window exchange rule to eliminate redundant
physical plan SortExec
Key: SPARK-24066
URL: https://issues.apache.org/jira/browse/SPARK-24066
Project: Spark
caoxuewen created SPARK-23676:
-
Summary: Support left join codegen in SortMergeJoinExec
Key: SPARK-23676
URL: https://issues.apache.org/jira/browse/SPARK-23676
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-23609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-23609:
--
Summary: Test EnsureRequirements's test cases to eliminate ShuffleExchange
while is not expected
caoxuewen created SPARK-23609:
-
Summary: Test code does not conform to the test title
Key: SPARK-23609
URL: https://issues.apache.org/jira/browse/SPARK-23609
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-23544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-23544:
--
Description:
Currently, we execute the SQL statement:
select MDTTemp.* from (select * from distinctAgg
[
https://issues.apache.org/jira/browse/SPARK-23544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-23544:
--
Summary: Remove redundancy ShuffleExchange in the planner (was: Remove
repartition operation from
caoxuewen created SPARK-23544:
-
Summary: Remove repartition operation from join in the optimizer
Key: SPARK-23544
URL: https://issues.apache.org/jira/browse/SPARK-23544
Project: Spark
Issue
caoxuewen created SPARK-23356:
-
Summary: Pushes Project to both sides of Union when expression is
non-deterministic
Key: SPARK-23356
URL: https://issues.apache.org/jira/browse/SPARK-23356
Project: Spark
caoxuewen created SPARK-23343:
-
Summary: Increase the exception test for the bind port
Key: SPARK-23343
URL: https://issues.apache.org/jira/browse/SPARK-23343
Project: Spark
Issue Type: Test
caoxuewen created SPARK-23311:
-
Summary: add FilterFunction test case for test CombineTypedFilters
Key: SPARK-23311
URL: https://issues.apache.org/jira/browse/SPARK-23311
Project: Spark
Issue
caoxuewen created SPARK-23247:
-
Summary: combines Unsafe operations and statistics operations in
Scan Data Source
Key: SPARK-23247
URL: https://issues.apache.org/jira/browse/SPARK-23247
Project: Spark
caoxuewen created SPARK-23199:
-
Summary: improved Removes repetition from group expressions in
Aggregate
Key: SPARK-23199
URL: https://issues.apache.org/jira/browse/SPARK-23199
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-22035:
--
Summary: the value of statistical logicalPlan.stats.sizeInBytes which is
not expected (was: Improving
[
https://issues.apache.org/jira/browse/SPARK-22035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-22035:
--
Description:
Currently, assume there will be the same number of rows as child has.
statistics
caoxuewen created SPARK-22035:
-
Summary: Improving the value of statistical
logicalPlan.stats.sizeInBytes which is not expected
Key: SPARK-22035
URL: https://issues.apache.org/jira/browse/SPARK-22035
caoxuewen created SPARK-21963:
-
Summary: create temp file should be delete after use
Key: SPARK-21963
URL: https://issues.apache.org/jira/browse/SPARK-21963
Project: Spark
Issue Type: Bug
[
https://issues.apache.org/jira/browse/SPARK-21932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen closed SPARK-21932.
-
Resolution: Resolved
> Add test CartesianProduct join case and BroadcastNestedLoop join case in
>
[
https://issues.apache.org/jira/browse/SPARK-21932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-21932:
--
Priority: Minor (was: Major)
> Add test CartesianProduct join case and BroadcastNestedLoop join case
[
https://issues.apache.org/jira/browse/SPARK-21932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-21932:
--
Description:
this issue to fix two problems：
1. add new two test case. test CartesianProduct join
[
https://issues.apache.org/jira/browse/SPARK-21932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen reopened SPARK-21932:
---
> Add test CartesianProduct join case and BroadcastNestedLoop join case in
> JoinBenchmark
>
[
https://issues.apache.org/jira/browse/SPARK-21932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-21932:
--
Summary: Add test CartesianProduct join case and BroadcastNestedLoop join
case in JoinBenchmark (was:
caoxuewen created SPARK-21932:
-
Summary: remove package name similar 'logical.Join' to 'Join' in
JoinSelection
Key: SPARK-21932
URL: https://issues.apache.org/jira/browse/SPARK-21932
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen closed SPARK-21746.
-
Resolution: Not A Problem
> nondeterministic expressions incorrectly for filter predicates
>
[
https://issues.apache.org/jira/browse/SPARK-21746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-21746:
--
Summary: nondeterministic expressions incorrectly for filter predicates
(was: nondeterministic
caoxuewen created SPARK-21746:
-
Summary: nondeterministic expressions correctly for filter
predicates
Key: SPARK-21746
URL: https://issues.apache.org/jira/browse/SPARK-21746
Project: Spark
caoxuewen created SPARK-21707:
-
Summary: Improvement a special case for non-deterministic filters
in optimizer
Key: SPARK-21707
URL: https://issues.apache.org/jira/browse/SPARK-21707
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-21520:
--
Description:
Currently, Did a lot of special handling for non-deterministic projects and
filters in
[
https://issues.apache.org/jira/browse/SPARK-21520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-21520:
--
Summary: Improvement a special case for non-deterministic projects in
optimizer (was: Improvement a
caoxuewen created SPARK-21705:
-
Summary: Add spark.internal.config parameter description
Key: SPARK-21705
URL: https://issues.apache.org/jira/browse/SPARK-21705
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-21520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-21520:
--
Description:
Currently, Did a lot of special handling for non-deterministic projects and
filters in
[
https://issues.apache.org/jira/browse/SPARK-21520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119617#comment-16119617
]
caoxuewen commented on SPARK-21520:
---
User 'heary-cao' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-21520:
--
Description:
Currently, Did a lot of special handling for non-deterministic projects and
filters in
[
https://issues.apache.org/jira/browse/SPARK-21520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-21520:
--
Summary: Improvement a special case for non-deterministic projects and
filters in optimizer (was:
[
https://issues.apache.org/jira/browse/SPARK-21520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-21520:
--
Description:
Currently, when the rand function is present in the SQL statement, hivetable
searches
caoxuewen created SPARK-21520:
-
Summary: Hivetable scan for all the columns the SQL statement
contains the 'rand'
Key: SPARK-21520
URL: https://issues.apache.org/jira/browse/SPARK-21520
Project: Spark
caoxuewen created SPARK-21353:
-
Summary: add checkValue in spark.internal.config about how to
correctly set configurations
Key: SPARK-21353
URL: https://issues.apache.org/jira/browse/SPARK-21353
Project:
[
https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20950:
--
Description:
This PR Improvement in two:
1.With spark.shuffle.spill.diskWriteBufferSize configure
[
https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20950:
--
Description:
This PR Improvement in two:
1.With spark.shuffle.spill.diskWriteBufferSize configure
[
https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20950:
--
Description:
This PR Improvement in two:
1.With spark.shuffle.spill.diskWriteBufferSize configure
[
https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20950:
--
Description:
This PR Improvement in two:
1.With spark.shuffle.spill.diskWriteBufferSize configure
[
https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20950:
--
Description:
This PR Improvement in two:
1.With spark.shuffle.spill.diskWriteBufferSize configure
[
https://issues.apache.org/jira/browse/SPARK-20999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen closed SPARK-20999.
-
Not A Problem
> No failure Stages, no log 'DAGScheduler: failed: Set()' output.
>
caoxuewen created SPARK-20999:
-
Summary: No failure Stages, no log 'DAGScheduler: failed: Set()'
output.
Key: SPARK-20999
URL: https://issues.apache.org/jira/browse/SPARK-20999
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20950:
--
Description:
1.With spark.shuffle.spill.diskWriteBufferSize configure diskWriteBufferSize of
[
https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20950:
--
Summary: Improve diskWriteBufferSize configurable (was: Improve
Serializerbuffersize configurable)
>
[
https://issues.apache.org/jira/browse/SPARK-20959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16034466#comment-16034466
]
caoxuewen commented on SPARK-20959:
---
thanks for modify Priority
> Add a parameter to
[
https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20950:
--
Component/s: (was: SQL)
> Improve Serializerbuffersize configurable
>
caoxuewen created SPARK-20959:
-
Summary: Add a parameter to UnsafeExternalSorter to configure
filebuffersize
Key: SPARK-20959
URL: https://issues.apache.org/jira/browse/SPARK-20959
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20950:
--
Description:
1.With spark.shuffle.sort.initialSerBufferSize configure SerializerBufferSize
of
[
https://issues.apache.org/jira/browse/SPARK-20950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20950:
--
Summary: Improve Serializerbuffersize configurable (was: Improve
Serializerbuffersize and
caoxuewen created SPARK-20950:
-
Summary: Improve Serializerbuffersize and filebuffersize
configurable
Key: SPARK-20950
URL: https://issues.apache.org/jira/browse/SPARK-20950
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-20850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen resolved SPARK-20850.
---
Resolution: Fixed
> Improve division and multiplication mixing process the data
>
caoxuewen created SPARK-20850:
-
Summary: Improve division and multiplication mixing process the
data
Key: SPARK-20850
URL: https://issues.apache.org/jira/browse/SPARK-20850
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-20786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20786:
--
Summary: Improve ceil and floor handle the value which is not expected
(was: Improve ceil handle the
caoxuewen created SPARK-20786:
-
Summary: Improve ceil handle the value which is not expected
Key: SPARK-20786
URL: https://issues.apache.org/jira/browse/SPARK-20786
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-20607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20607:
--
Priority: Minor (was: Trivial)
> Add new unit tests to ShuffleSuite
>
[
https://issues.apache.org/jira/browse/SPARK-20607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20607:
--
Priority: Trivial (was: Major)
> Add new unit tests to ShuffleSuite
>
[
https://issues.apache.org/jira/browse/SPARK-20607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20607:
--
Issue Type: Test (was: Bug)
> Add new unit tests to ShuffleSuite
> --
[
https://issues.apache.org/jira/browse/SPARK-20609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20609:
--
Priority: Minor (was: Major)
> Run the SortShuffleSuite unit tests have residual spark_* system
[
https://issues.apache.org/jira/browse/SPARK-20739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20739:
--
Issue Type: Test (was: Improvement)
> Supplement the new unit tests to
[
https://issues.apache.org/jira/browse/SPARK-20739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20739:
--
Issue Type: Improvement (was: Test)
> Supplement the new unit tests to
[
https://issues.apache.org/jira/browse/SPARK-20739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20739:
--
Priority: Minor (was: Trivial)
> Supplement the new unit tests to SparkContextSchedulerCreationSuite
[
https://issues.apache.org/jira/browse/SPARK-20739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20739:
--
Issue Type: Test (was: Improvement)
> Supplement the new unit tests to
[
https://issues.apache.org/jira/browse/SPARK-20739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010147#comment-16010147
]
caoxuewen edited comment on SPARK-20739 at 5/15/17 8:26 AM:
ok
thanks,
was
[
https://issues.apache.org/jira/browse/SPARK-20739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16010147#comment-16010147
]
caoxuewen commented on SPARK-20739:
---
ok
thansk,
> Supplement the new unit tests to
[
https://issues.apache.org/jira/browse/SPARK-20739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
caoxuewen updated SPARK-20739:
--
Summary: Supplement the new unit tests to
SparkContextSchedulerCreationSuite (was: Unit testing
caoxuewen created SPARK-20739:
-
Summary: Unit testing support for 'spark://' format
Key: SPARK-20739
URL: https://issues.apache.org/jira/browse/SPARK-20739
Project: Spark
Issue Type: Bug
caoxuewen created SPARK-20609:
-
Summary: Run the SortShuffleSuite unit tests have residual spark_*
system directory
Key: SPARK-20609
URL: https://issues.apache.org/jira/browse/SPARK-20609
Project: Spark
caoxuewen created SPARK-20607:
-
Summary: Add new unit tests to ShuffleSuite
Key: SPARK-20607
URL: https://issues.apache.org/jira/browse/SPARK-20607
Project: Spark
Issue Type: Bug
caoxuewen created SPARK-20518:
-
Summary: Supplement the new blockidsuite unit tests
Key: SPARK-20518
URL: https://issues.apache.org/jira/browse/SPARK-20518
Project: Spark
Issue Type: Test
caoxuewen created SPARK-20471:
-
Summary: Remove AggregateBenchmark testsuite warning: Two level
hashmap is disabled but vectorized hashmap is enabled.
Key: SPARK-20471
URL:
88 matches
Mail list logo
