Xianyang Liu created SPARK-21621:
Summary: Reset numRecordsWritten after
DiskBlockObjectWriter.commitAndGet called
Key: SPARK-21621
URL: https://issues.apache.org/jira/browse/SPARK-21621
Project:
[
https://issues.apache.org/jira/browse/SPARK-21455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-21455:
-
Description:
Currently, when there is a `RpcFailure` need be sent back to client, we call
[
https://issues.apache.org/jira/browse/SPARK-21455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-21455:
-
Description:
Currently, when there is a `RpcFailure` need be sent back to client, we call
[
https://issues.apache.org/jira/browse/SPARK-21455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-21455:
-
Description:
Currently, when there is a `RpcFailure` need be sent back to client, we call
Xianyang Liu created SPARK-21455:
Summary: RpcFailure should be call on RpcResponseCallback.onFailure
Key: SPARK-21455
URL: https://issues.apache.org/jira/browse/SPARK-21455
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-21455:
-
Description:
Currently, when there is a `RpcFailure` need be sent back to client, we call
[
https://issues.apache.org/jira/browse/SPARK-21455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-21455:
-
Description:
Currently, when there is a `RpcFailure` need be sent back to client, we call
[
https://issues.apache.org/jira/browse/SPARK-21455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-21455:
-
Description:
Currently, when there is a `RpcFailure` need be sent back to client, we call
[
https://issues.apache.org/jira/browse/SPARK-21455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-21455:
-
Description:
Currently, when there is a `RpcFailure` need be sent back to client, we call
Xianyang Liu created SPARK-22068:
Summary: Reduce the duplicate code between putIteratorAsValues and
putIteratorAsBytes
Key: SPARK-22068
URL: https://issues.apache.org/jira/browse/SPARK-22068
[
https://issues.apache.org/jira/browse/SPARK-22097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-22097:
-
Summary: Request an accurate memory after we unrolled the block (was: Call
[
https://issues.apache.org/jira/browse/SPARK-22097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-22097:
-
Description: We only need request bbos.size - unrollMemoryUsedByThisBlock
after unrolled the
Xianyang Liu created SPARK-22097:
Summary: Call serializationStream.close after we requested enough
memory
Key: SPARK-22097
URL: https://issues.apache.org/jira/browse/SPARK-22097
Project: Spark
Xianyang Liu created SPARK-22293:
Summary: Avoid unnecessary traversal in ResolveReferences
Key: SPARK-22293
URL: https://issues.apache.org/jira/browse/SPARK-22293
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-21923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-21923:
-
Summary: Avoid calling reserveUnrollMemoryForThisTask for every record
(was: Avoid call
Xianyang Liu created SPARK-21923:
Summary: Avoid call reserveUnrollMemoryForThisTask every record
Key: SPARK-21923
URL: https://issues.apache.org/jira/browse/SPARK-21923
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-21923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-21923:
-
Description:
When Spark persist data to Unsafe memory, we call the method
Xianyang Liu created SPARK-22838:
Summary: Avoid unnecessary copying of data
Key: SPARK-22838
URL: https://issues.apache.org/jira/browse/SPARK-22838
Project: Spark
Issue Type: Improvement
Xianyang Liu created SPARK-22450:
Summary: Safely register class for mllib
Key: SPARK-22450
URL: https://issues.apache.org/jira/browse/SPARK-22450
Project: Spark
Issue Type: Improvement
Xianyang Liu created SPARK-22367:
Summary: Separate the serialization of class and object for iteraor
Key: SPARK-22367
URL: https://issues.apache.org/jira/browse/SPARK-22367
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-22367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-22367:
-
Description:
Becuase they are all the same class for an iterator. So there is no need write
Xianyang Liu created SPARK-25386:
Summary: Don't need to synchronize the IndexShuffleBlockResolver
for each writeIndexFileAndCommit
Key: SPARK-25386
URL: https://issues.apache.org/jira/browse/SPARK-25386
[
https://issues.apache.org/jira/browse/SPARK-25386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-25386:
-
Summary: Don't need to synchronize the IndexShuffleBlockResolver for each
[
https://issues.apache.org/jira/browse/SPARK-25386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-25386:
-
Description: Now, we need synchronize the instance of
IndexShuffleBlockResolver in order to
Xianyang Liu created SPARK-23707:
Summary: Fresh 'initRange' name to avoid method name conflicts
Key: SPARK-23707
URL: https://issues.apache.org/jira/browse/SPARK-23707
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-23707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-23707:
-
Description: Just like #20726. There is no need 'Exchange' when
`spark.range` produce only one
[
https://issues.apache.org/jira/browse/SPARK-23707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-23707:
-
Summary: Don't need shuffle exchange with single partition for
'spark.range' (was: Fresh
Xianyang Liu created SPARK-27350:
Summary: Support create table on data source V2
Key: SPARK-27350
URL: https://issues.apache.org/jira/browse/SPARK-27350
Project: Spark
Issue Type: Bug
Xianyang Liu created SPARK-27319:
Summary: Filter out dir based on PathFilter before listing them
Key: SPARK-27319
URL: https://issues.apache.org/jira/browse/SPARK-27319
Project: Spark
Issue
Xianyang Liu created SPARK-26952:
Summary: Row count statics should respect the data reported by
data source
Key: SPARK-26952
URL: https://issues.apache.org/jira/browse/SPARK-26952
Project: Spark
Xianyang Liu created SPARK-26763:
Summary: Using fileStatus cache when filterPartitions
Key: SPARK-26763
URL: https://issues.apache.org/jira/browse/SPARK-26763
Project: Spark
Issue Type:
Xianyang Liu created SPARK-28751:
Summary: Imporve java serializer deserialization performance
Key: SPARK-28751
URL: https://issues.apache.org/jira/browse/SPARK-28751
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-28751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-28751:
-
Description:
Improve the performance of java serializer deserialization by caching the
Xianyang Liu created SPARK-29582:
Summary: Unify the behavior of pyspark.TaskContext with spark core
Key: SPARK-29582
URL: https://issues.apache.org/jira/browse/SPARK-29582
Project: Spark
Xianyang Liu created SPARK-29499:
Summary: Add mapPartitionsWithIndex for RDDBarrier
Key: SPARK-29499
URL: https://issues.apache.org/jira/browse/SPARK-29499
Project: Spark
Issue Type: Bug
Xianyang Liu created SPARK-29236:
Summary: Access 'executorDataMap' out of 'DriverEndpoint' should
be protected by lock
Key: SPARK-29236
URL: https://issues.apache.org/jira/browse/SPARK-29236
Xianyang Liu created SPARK-32899:
Summary: Support submit application with user-defined cluster
manager
Key: SPARK-32899
URL: https://issues.apache.org/jira/browse/SPARK-32899
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-32899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-32899:
-
Description:
We have supported users to define the customed cluster manager with
Xianyang Liu created SPARK-44930:
Summary: Deterministic ApplyFunctionExpression should be foldable
Key: SPARK-44930
URL: https://issues.apache.org/jira/browse/SPARK-44930
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-44930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-44930:
-
Description: Currently, ApplyFunctionExpression is unfoldable because
inherits the default
[
https://issues.apache.org/jira/browse/SPARK-44930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xianyang Liu updated SPARK-44930:
-
Description: Currently, ApplyFunctionExpression is unfoldable because
inherits the default
Xianyang Liu created SPARK-44913:
Summary: DS V2 supports push down V2 UDF that has magic method
Key: SPARK-44913
URL: https://issues.apache.org/jira/browse/SPARK-44913
Project: Spark
Issue
Xianyang Liu created SPARK-40137:
Summary: Combines limits after projection
Key: SPARK-40137
URL: https://issues.apache.org/jira/browse/SPARK-40137
Project: Spark
Issue Type: Improvement
Xianyang Liu created SPARK-40227:
Summary: Data Source V2: Support creating table with the duplicate
transform with different arguments
Key: SPARK-40227
URL: https://issues.apache.org/jira/browse/SPARK-40227
44 matches
Mail list logo
