[jira] [Updated] (SPARK-30953) InsertAdaptiveSparkPlan should apply AQE on child plan of write commands

2020-04-10 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-30953: - Summary: InsertAdaptiveSparkPlan should apply AQE on child plan of write commands (was:

[jira] [Created] (SPARK-31409) Fix failed tests due to result order changing when we enable AQE

2020-04-10 Thread wuyi (Jira)
wuyi created SPARK-31409: Summary: Fix failed tests due to result order changing when we enable AQE Key: SPARK-31409 URL: https://issues.apache.org/jira/browse/SPARK-31409 Project: Spark Issue

[jira] [Created] (SPARK-31407) Fix hive/SQLQuerySuite.derived from Hive query file: drop_database_removes_partition_dirs.q

2020-04-10 Thread wuyi (Jira)
wuyi created SPARK-31407: Summary: Fix hive/SQLQuerySuite.derived from Hive query file: drop_database_removes_partition_dirs.q Key: SPARK-31407 URL: https://issues.apache.org/jira/browse/SPARK-31407 Project:

[jira] [Created] (SPARK-31391) Add AdaptiveTestUtils to ease the test of AQE

2020-04-09 Thread wuyi (Jira)
wuyi created SPARK-31391: Summary: Add AdaptiveTestUtils to ease the test of AQE Key: SPARK-31391 URL: https://issues.apache.org/jira/browse/SPARK-31391 Project: Spark Issue Type: Test

[jira] [Updated] (SPARK-31384) NPE in OptimizeSkewedJoin when there's a inputRDD of plan has 0 partition

2020-04-08 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31384: - Summary: NPE in OptimizeSkewedJoin when there's a inputRDD of plan has 0 partition (was: Fix NPE in

[jira] [Created] (SPARK-31384) Fix NPE in OptimizeSkewedJoin

2020-04-08 Thread wuyi (Jira)
wuyi created SPARK-31384: Summary: Fix NPE in OptimizeSkewedJoin Key: SPARK-31384 URL: https://issues.apache.org/jira/browse/SPARK-31384 Project: Spark Issue Type: Bug Components: SQL

[jira] [Created] (SPARK-31379) Fix flaky test: o.a.s.scheduler.CoarseGrainedSchedulerBackendSuite.extra resources from executor

2020-04-07 Thread wuyi (Jira)
wuyi created SPARK-31379: Summary: Fix flaky test: o.a.s.scheduler.CoarseGrainedSchedulerBackendSuite.extra resources from executor Key: SPARK-31379 URL: https://issues.apache.org/jira/browse/SPARK-31379

[jira] [Created] (SPARK-31344) Polish implementation of barrier() and allGather()

2020-04-03 Thread wuyi (Jira)
wuyi created SPARK-31344: Summary: Polish implementation of barrier() and allGather() Key: SPARK-31344 URL: https://issues.apache.org/jira/browse/SPARK-31344 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-31259) Fix log error of curRequestSize in ShuffleBlockFetcherIterator

2020-03-25 Thread wuyi (Jira)
wuyi created SPARK-31259: Summary: Fix log error of curRequestSize in ShuffleBlockFetcherIterator Key: SPARK-31259 URL: https://issues.apache.org/jira/browse/SPARK-31259 Project: Spark Issue Type:

[jira] [Created] (SPARK-31242) Clone SparkSession should respect spark.sql.legacy.sessionInitWithConfigDefaults

2020-03-24 Thread wuyi (Jira)
wuyi created SPARK-31242: Summary: Clone SparkSession should respect spark.sql.legacy.sessionInitWithConfigDefaults Key: SPARK-31242 URL: https://issues.apache.org/jira/browse/SPARK-31242 Project: Spark

[jira] [Created] (SPARK-31206) AQE will use the same SubqueryExec even if subqueryReuseEnabled=false

2020-03-20 Thread wuyi (Jira)
wuyi created SPARK-31206: Summary: AQE will use the same SubqueryExec even if subqueryReuseEnabled=false Key: SPARK-31206 URL: https://issues.apache.org/jira/browse/SPARK-31206 Project: Spark Issue

[jira] [Created] (SPARK-31190) ScalaReflection should erasure non user defined AnyVal type

2020-03-19 Thread wuyi (Jira)
wuyi created SPARK-31190: Summary: ScalaReflection should erasure non user defined AnyVal type Key: SPARK-31190 URL: https://issues.apache.org/jira/browse/SPARK-31190 Project: Spark Issue Type:

[jira] [Updated] (SPARK-31175) Avoid creating reverse comparator for each compare in InterpretedOrdering

2020-03-17 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31175: - Summary: Avoid creating reverse comparator for each compare in InterpretedOrdering (was: Avoid creating new

[jira] [Created] (SPARK-31175) Avoid creating new reverse comparator per compare in InterpretedOrdering

2020-03-17 Thread wuyi (Jira)
wuyi created SPARK-31175: Summary: Avoid creating new reverse comparator per compare in InterpretedOrdering Key: SPARK-31175 URL: https://issues.apache.org/jira/browse/SPARK-31175 Project: Spark

[jira] [Created] (SPARK-31163) acl/permission should handle non-existed path when truncating table

2020-03-16 Thread wuyi (Jira)
wuyi created SPARK-31163: Summary: acl/permission should handle non-existed path when truncating table Key: SPARK-31163 URL: https://issues.apache.org/jira/browse/SPARK-31163 Project: Spark Issue

[jira] [Updated] (SPARK-31081) Make the display of stageId/stageAttemptId/taskId of sql metrics configurable in UI

2020-03-11 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31081: - Summary: Make the display of stageId/stageAttemptId/taskId of sql metrics configurable in UI (was: Make

[jira] [Created] (SPARK-31082) MapOutputTrackerMaster.getMapLocation can't handle last mapIndex

2020-03-08 Thread wuyi (Jira)
wuyi created SPARK-31082: Summary: MapOutputTrackerMaster.getMapLocation can't handle last mapIndex Key: SPARK-31082 URL: https://issues.apache.org/jira/browse/SPARK-31082 Project: Spark Issue

[jira] [Created] (SPARK-31081) Make SQLMetrics more readable from UI

2020-03-08 Thread wuyi (Jira)
wuyi created SPARK-31081: Summary: Make SQLMetrics more readable from UI Key: SPARK-31081 URL: https://issues.apache.org/jira/browse/SPARK-31081 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-31054) Turn on deprecation in Scala REPL/spark-shell by default

2020-03-05 Thread wuyi (Jira)
wuyi created SPARK-31054: Summary: Turn on deprecation in Scala REPL/spark-shell by default Key: SPARK-31054 URL: https://issues.apache.org/jira/browse/SPARK-31054 Project: Spark Issue Type:

[jira] [Created] (SPARK-31052) Fix flaky test of SPARK-30388

2020-03-05 Thread wuyi (Jira)
wuyi created SPARK-31052: Summary: Fix flaky test of SPARK-30388 Key: SPARK-31052 URL: https://issues.apache.org/jira/browse/SPARK-31052 Project: Spark Issue Type: Bug Components: Spark

[jira] [Updated] (SPARK-31050) Disable flaky KafkaDelegationTokenSuite

2020-03-05 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31050: - Description: Disable flaky KafkaDelegationTokenSuite since it's too flaky. > Disable flaky

[jira] [Updated] (SPARK-31050) Disable flaky KafkaDelegationTokenSuite

2020-03-05 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31050: - Environment: (was: Disable flaky KafkaDelegationTokenSuite since it's too flaky.) > Disable flaky

[jira] [Created] (SPARK-31050) Disable flaky KafkaDelegationTokenSuite

2020-03-04 Thread wuyi (Jira)
wuyi created SPARK-31050: Summary: Disable flaky KafkaDelegationTokenSuite Key: SPARK-31050 URL: https://issues.apache.org/jira/browse/SPARK-31050 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-30541) Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite

2020-03-04 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-30541: - Priority: Blocker (was: Major) > Flaky test: org.apache.spark.sql.kafka010.KafkaDelegationTokenSuite >

[jira] [Created] (SPARK-31034) ShuffleBlockFetcherIterator may can't create request for last group

2020-03-03 Thread wuyi (Jira)
wuyi created SPARK-31034: Summary: ShuffleBlockFetcherIterator may can't create request for last group Key: SPARK-31034 URL: https://issues.apache.org/jira/browse/SPARK-31034 Project: Spark Issue

[jira] [Updated] (SPARK-31018) Deprecate support of multiple workers on the same host in Standalone

2020-03-03 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-31018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-31018: - Summary: Deprecate support of multiple workers on the same host in Standalone (was: Deprecate support of

[jira] [Created] (SPARK-31018) Deprecate support of multiple workers on the same host in Standalone.

2020-03-03 Thread wuyi (Jira)
wuyi created SPARK-31018: Summary: Deprecate support of multiple workers on the same host in Standalone. Key: SPARK-31018 URL: https://issues.apache.org/jira/browse/SPARK-31018 Project: Spark Issue

[jira] [Created] (SPARK-31017) Test for shuffle requests packaging with different size and numBlocks limit

2020-03-02 Thread wuyi (Jira)
wuyi created SPARK-31017: Summary: Test for shuffle requests packaging with different size and numBlocks limit Key: SPARK-31017 URL: https://issues.apache.org/jira/browse/SPARK-31017 Project: Spark

[jira] [Created] (SPARK-30999) Don't cancel a QueryStageExec when it's already finished

2020-03-01 Thread wuyi (Jira)
wuyi created SPARK-30999: Summary: Don't cancel a QueryStageExec when it's already finished Key: SPARK-30999 URL: https://issues.apache.org/jira/browse/SPARK-30999 Project: Spark Issue Type:

[jira] [Created] (SPARK-30972) PruneHiveTablePartitions should be executed as earlyScanPushDownRules

2020-02-27 Thread wuyi (Jira)
wuyi created SPARK-30972: Summary: PruneHiveTablePartitions should be executed as earlyScanPushDownRules Key: SPARK-30972 URL: https://issues.apache.org/jira/browse/SPARK-30972 Project: Spark Issue

[jira] [Created] (SPARK-30969) Remove resource coordination support from Standalone

2020-02-27 Thread wuyi (Jira)
wuyi created SPARK-30969: Summary: Remove resource coordination support from Standalone Key: SPARK-30969 URL: https://issues.apache.org/jira/browse/SPARK-30969 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-30947) Log better message when accelerate resource is empty

2020-02-26 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-30947: - Summary: Log better message when accelerate resource is empty (was: Don't log accelerate resources when it's

[jira] [Created] (SPARK-30953) InsertAdaptiveSparkPlan should also skip v2 command

2020-02-25 Thread wuyi (Jira)
wuyi created SPARK-30953: Summary: InsertAdaptiveSparkPlan should also skip v2 command Key: SPARK-30953 URL: https://issues.apache.org/jira/browse/SPARK-30953 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-30947) Don't log accelerate resources when it's empty

2020-02-25 Thread wuyi (Jira)
wuyi created SPARK-30947: Summary: Don't log accelerate resources when it's empty Key: SPARK-30947 URL: https://issues.apache.org/jira/browse/SPARK-30947 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-30937) Migration guide for Hive 2.3

2020-02-24 Thread wuyi (Jira)
wuyi created SPARK-30937: Summary: Migration guide for Hive 2.3 Key: SPARK-30937 URL: https://issues.apache.org/jira/browse/SPARK-30937 Project: Spark Issue Type: Sub-task Components: SQL

[jira] [Created] (SPARK-30903) Fail fast on duplicate columns when analyze columns

2020-02-20 Thread wuyi (Jira)
wuyi created SPARK-30903: Summary: Fail fast on duplicate columns when analyze columns Key: SPARK-30903 URL: https://issues.apache.org/jira/browse/SPARK-30903 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-30863) Distinguish Cast and AnsiCast in toString()

2020-02-17 Thread wuyi (Jira)
wuyi created SPARK-30863: Summary: Distinguish Cast and AnsiCast in toString() Key: SPARK-30863 URL: https://issues.apache.org/jira/browse/SPARK-30863 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-30846) Add AccumulatorV2 API in JavaSparkContext

2020-02-16 Thread wuyi (Jira)
wuyi created SPARK-30846: Summary: Add AccumulatorV2 API in JavaSparkContext Key: SPARK-30846 URL: https://issues.apache.org/jira/browse/SPARK-30846 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-30844) Static partition should also follow StoreAssignmentPolicy when insert into table

2020-02-16 Thread wuyi (Jira)
wuyi created SPARK-30844: Summary: Static partition should also follow StoreAssignmentPolicy when insert into table Key: SPARK-30844 URL: https://issues.apache.org/jira/browse/SPARK-30844 Project: Spark

[jira] [Created] (SPARK-30812) Revise boolean config name according to new config naming policy

2020-02-13 Thread wuyi (Jira)
wuyi created SPARK-30812: Summary: Revise boolean config name according to new config naming policy Key: SPARK-30812 URL: https://issues.apache.org/jira/browse/SPARK-30812 Project: Spark Issue

[jira] [Created] (SPARK-30744) Optimize AnalyzePartitionCommand by calculating location sizes in parallel

2020-02-05 Thread wuyi (Jira)
wuyi created SPARK-30744: Summary: Optimize AnalyzePartitionCommand by calculating location sizes in parallel Key: SPARK-30744 URL: https://issues.apache.org/jira/browse/SPARK-30744 Project: Spark

[jira] [Created] (SPARK-30729) Eagerly filter out zombie TaskSetManager before offering resources

2020-02-04 Thread wuyi (Jira)
wuyi created SPARK-30729: Summary: Eagerly filter out zombie TaskSetManager before offering resources Key: SPARK-30729 URL: https://issues.apache.org/jira/browse/SPARK-30729 Project: Spark Issue

[jira] [Created] (SPARK-30594) Do not post SparkListenerBlockUpdated when updateBlockInfo returns false

2020-01-21 Thread wuyi (Jira)
wuyi created SPARK-30594: Summary: Do not post SparkListenerBlockUpdated when updateBlockInfo returns false Key: SPARK-30594 URL: https://issues.apache.org/jira/browse/SPARK-30594 Project: Spark

[jira] [Created] (SPARK-30578) Explicitly set conf to use datasource v2 for v2.3/OrcFilterSuite

2020-01-19 Thread wuyi (Jira)
wuyi created SPARK-30578: Summary: Explicitly set conf to use datasource v2 for v2.3/OrcFilterSuite Key: SPARK-30578 URL: https://issues.apache.org/jira/browse/SPARK-30578 Project: Spark Issue

[jira] [Created] (SPARK-30518) Precision and scale should be same for values between -1.0 and 1.0 in Decimal

2020-01-15 Thread wuyi (Jira)
wuyi created SPARK-30518: Summary: Precision and scale should be same for values between -1.0 and 1.0 in Decimal Key: SPARK-30518 URL: https://issues.apache.org/jira/browse/SPARK-30518 Project: Spark

[jira] [Created] (SPARK-30508) Add DataFrameReader.executeCommand API for external datasource

2020-01-14 Thread wuyi (Jira)
wuyi created SPARK-30508: Summary: Add DataFrameReader.executeCommand API for external datasource Key: SPARK-30508 URL: https://issues.apache.org/jira/browse/SPARK-30508 Project: Spark Issue Type:

[jira] [Created] (SPARK-30459) Fix ignoreMissingFiles/ignoreCorruptFiles in DSv2

2020-01-08 Thread wuyi (Jira)
wuyi created SPARK-30459: Summary: Fix ignoreMissingFiles/ignoreCorruptFiles in DSv2 Key: SPARK-30459 URL: https://issues.apache.org/jira/browse/SPARK-30459 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-30402) Support push down for filters with cast expression

2020-01-08 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-30402. -- Resolution: Won't Do > Support push down for filters with cast expression >

[jira] [Commented] (SPARK-30440) Flaky test: org.apache.spark.scheduler.TaskSetManagerSuite.reset

2020-01-06 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009427#comment-17009427 ] wuyi commented on SPARK-30440: -- [~kabhwan] thanks for reporting it. Let me take a look. > Flaky test:

[jira] [Updated] (SPARK-30433) Make conflict attributes resolution more scalable in ResolveReferences

2020-01-06 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-30433: - Summary: Make conflict attributes resolution more scalable in ResolveReferences (was: Make conflict attributes

[jira] [Created] (SPARK-30433) Make conflict attributes resolution more scalable

2020-01-06 Thread wuyi (Jira)
wuyi created SPARK-30433: Summary: Make conflict attributes resolution more scalable Key: SPARK-30433 URL: https://issues.apache.org/jira/browse/SPARK-30433 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-30402) Support push down for filters with cast expression

2020-01-01 Thread wuyi (Jira)
wuyi created SPARK-30402: Summary: Support push down for filters with cast expression Key: SPARK-30402 URL: https://issues.apache.org/jira/browse/SPARK-30402 Project: Spark Issue Type: Improvement

[jira] [Updated] (SPARK-30385) WebUI occasionally throw IOException on stop()

2019-12-30 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-30385: - Description: While using ./bin/spark-shell, recently, I occasionally see IOException when I try to quit:

[jira] [Updated] (SPARK-30385) WebUI occasionally throw IOException on stop()

2019-12-30 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-30385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-30385: - Description: While using ./bin/spark-shell, recently, I occasionally see IOException when I try to quit:

[jira] [Created] (SPARK-30385) WebUI occasionally throw IOException on stop()

2019-12-30 Thread wuyi (Jira)
wuyi created SPARK-30385: Summary: WebUI occasionally throw IOException on stop() Key: SPARK-30385 URL: https://issues.apache.org/jira/browse/SPARK-30385 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-30373) Avoid unnecessary sort for ParquetUtils.splitFiles

2019-12-28 Thread wuyi (Jira)
wuyi created SPARK-30373: Summary: Avoid unnecessary sort for ParquetUtils.splitFiles Key: SPARK-30373 URL: https://issues.apache.org/jira/browse/SPARK-30373 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-30359) Do not clear executorsPendingToRemove in CoarseGrainedSchedulerBackend.reset

2019-12-26 Thread wuyi (Jira)
wuyi created SPARK-30359: Summary: Do not clear executorsPendingToRemove in CoarseGrainedSchedulerBackend.reset Key: SPARK-30359 URL: https://issues.apache.org/jira/browse/SPARK-30359 Project: Spark

[jira] [Created] (SPARK-30355) Unify isExecutorActive between CoarseGrainedSchedulerBackend and DriverEndpoint

2019-12-25 Thread wuyi (Jira)
wuyi created SPARK-30355: Summary: Unify isExecutorActive between CoarseGrainedSchedulerBackend and DriverEndpoint Key: SPARK-30355 URL: https://issues.apache.org/jira/browse/SPARK-30355 Project: Spark

[jira] [Created] (SPARK-30252) Disallow negative scale of Decimal under ansi mode

2019-12-13 Thread wuyi (Jira)
wuyi created SPARK-30252: Summary: Disallow negative scale of Decimal under ansi mode Key: SPARK-30252 URL: https://issues.apache.org/jira/browse/SPARK-30252 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-30151) Issue better error message when user-specified schema not match relation schema

2019-12-06 Thread wuyi (Jira)
wuyi created SPARK-30151: Summary: Issue better error message when user-specified schema not match relation schema Key: SPARK-30151 URL: https://issues.apache.org/jira/browse/SPARK-30151 Project: Spark

[jira] [Created] (SPARK-30098) Use default datasource as provider for CREATE TABLE syntax

2019-12-02 Thread wuyi (Jira)
wuyi created SPARK-30098: Summary: Use default datasource as provider for CREATE TABLE syntax Key: SPARK-30098 URL: https://issues.apache.org/jira/browse/SPARK-30098 Project: Spark Issue Type:

[jira] [Created] (SPARK-29956) A literal number with an exponent should be converted into Double

2019-11-18 Thread wuyi (Jira)
wuyi created SPARK-29956: Summary: A literal number with an exponent should be converted into Double Key: SPARK-29956 URL: https://issues.apache.org/jira/browse/SPARK-29956 Project: Spark Issue

[jira] [Created] (SPARK-29871) Flaky test: ImageFileFormatTest.test_read_images

2019-11-12 Thread wuyi (Jira)
wuyi created SPARK-29871: Summary: Flaky test: ImageFileFormatTest.test_read_images Key: SPARK-29871 URL: https://issues.apache.org/jira/browse/SPARK-29871 Project: Spark Issue Type: Test

[jira] [Commented] (SPARK-29838) PostgreSQL dialect: cast to timestamp

2019-11-11 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971570#comment-16971570 ] wuyi commented on SPARK-29838: -- Hey guys, what's going on here ? I see [~aman_omer] you has commented

[jira] [Updated] (SPARK-29837) PostgreSQL dialect: cast to boolean

2019-11-11 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-29837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-29837: - Parent: SPARK-29836 Issue Type: Sub-task (was: Task) > PostgreSQL dialect: cast to boolean >

[jira] [Created] (SPARK-29837) PostgreSQL dialect: cast to boolean

2019-11-11 Thread wuyi (Jira)
wuyi created SPARK-29837: Summary: PostgreSQL dialect: cast to boolean Key: SPARK-29837 URL: https://issues.apache.org/jira/browse/SPARK-29837 Project: Spark Issue Type: Task Components:

[jira] [Created] (SPARK-29836) PostgreSQL dialect: cast

2019-11-11 Thread wuyi (Jira)
wuyi created SPARK-29836: Summary: PostgreSQL dialect: cast Key: SPARK-29836 URL: https://issues.apache.org/jira/browse/SPARK-29836 Project: Spark Issue Type: Improvement Components: SQL

[jira] [Created] (SPARK-29537) throw exception when user defined a wrong base path

2019-10-21 Thread wuyi (Jira)
wuyi created SPARK-29537: Summary: throw exception when user defined a wrong base path Key: SPARK-29537 URL: https://issues.apache.org/jira/browse/SPARK-29537 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-28867) InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-10-13 Thread wuyi (Jira)
[ https://issues.apache.org/jira/browse/SPARK-28867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16950307#comment-16950307 ] wuyi commented on SPARK-28867: -- [~irashid] Thanks for putting this as a related issue to  SPARK-20656.  

[jira] [Created] (SPARK-29261) Support recover live entities from KVStore for (SQL)AppStatusListener

2019-09-26 Thread wuyi (Jira)
wuyi created SPARK-29261: Summary: Support recover live entities from KVStore for (SQL)AppStatusListener Key: SPARK-29261 URL: https://issues.apache.org/jira/browse/SPARK-29261 Project: Spark Issue

[jira] [Created] (SPARK-28867) InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-08-25 Thread wuyi (Jira)
wuyi created SPARK-28867: Summary: InMemoryStore checkpoint to speed up replay log file in HistoryServer Key: SPARK-28867 URL: https://issues.apache.org/jira/browse/SPARK-28867 Project: Spark Issue

[jira] [Commented] (SPARK-27492) GPU scheduling - High level user documentation

2019-08-08 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903081#comment-16903081 ] wuyi commented on SPARK-27492: -- I'm wondering would it be possible or better if we could use accelerator

[jira] [Updated] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-28302: - Description: When using SparkLauncher to submit applications concurrently with a thread pool under *Windows*,

[jira] [Updated] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-28302: - Attachment: Main.scala > SparkLauncher: The process cannot access the file because it is being used by >

[jira] [Updated] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-28302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-28302: - Description: When using SparkLauncher to submit applications concurrently with a thread pool under *Windows*,

[jira] [Created] (SPARK-28302) SparkLauncher: The process cannot access the file because it is being used by another process

2019-07-08 Thread wuyi (JIRA)
wuyi created SPARK-28302: Summary: SparkLauncher: The process cannot access the file because it is being used by another process Key: SPARK-28302 URL: https://issues.apache.org/jira/browse/SPARK-28302

[jira] [Commented] (SPARK-27360) Standalone cluster mode support for GPU-aware scheduling

2019-06-11 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16860951#comment-16860951 ] wuyi commented on SPARK-27360: -- oops...I happened to find that sub-task 2 has changed to what I want after

[jira] [Created] (SPARK-27999) setup resources when Standalone Worker starts up

2019-06-11 Thread wuyi (JIRA)
wuyi created SPARK-27999: Summary: setup resources when Standalone Worker starts up Key: SPARK-27999 URL: https://issues.apache.org/jira/browse/SPARK-27999 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-27666) Do not release lock while TaskContext already completed

2019-05-28 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-27666: - Description: {code:java} Exception in thread "Thread-14" java.lang.AssertionError: assertion failed: Block

[jira] [Updated] (SPARK-27666) Do not release lock while TaskContext already completed

2019-05-28 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-27666: - Description: We're facing an issue reported by SPARK-18406 and SPARK-25139. And

[jira] [Updated] (SPARK-27666) Do not release lock while TaskContext already completed

2019-05-28 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-27666: - Description: We're facing an issue reported by SPARK-18406 and SPARK-25139. And

[jira] [Updated] (SPARK-27666) Do not release lock while TaskContext already completed

2019-05-28 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-27666: - Summary: Do not release lock while TaskContext already completed (was: Stop python runner threads when task

[jira] [Commented] (SPARK-23191) Workers registration failes in case of network drop

2019-05-12 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16838237#comment-16838237 ] wuyi commented on SPARK-23191: -- Hi [~neeraj20gupta]  Can you explain more about the part of _running

[jira] [Commented] (SPARK-23191) Workers registration failes in case of network drop

2019-05-07 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16834703#comment-16834703 ] wuyi commented on SPARK-23191: -- Hi [~neeraj20gupta] What do you mean by _multiple driver running in some

[jira] [Commented] (SPARK-23191) Workers registration failes in case of network drop

2019-04-29 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16829272#comment-16829272 ] wuyi commented on SPARK-23191: -- [~cloud_fan] Ok, I'll have a deep look after 5.1 holiday. > Workers

[jira] [Created] (SPARK-27568) readLock leaked when method take() called on a cached rdd

2019-04-25 Thread wuyi (JIRA)
wuyi created SPARK-27568: Summary: readLock leaked when method take() called on a cached rdd Key: SPARK-27568 URL: https://issues.apache.org/jira/browse/SPARK-27568 Project: Spark Issue Type:

[jira] [Commented] (SPARK-27520) Introduce a global config system to replace hadoopConfiguration

2019-04-19 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16821916#comment-16821916 ] wuyi commented on SPARK-27520: -- [~jiangxb1987] okay, let me try it. thanks. > Introduce a global config

[jira] [Created] (SPARK-27510) Master fall into dead loop while launching executor failed in Worker

2019-04-18 Thread wuyi (JIRA)
wuyi created SPARK-27510: Summary: Master fall into dead loop while launching executor failed in Worker Key: SPARK-27510 URL: https://issues.apache.org/jira/browse/SPARK-27510 Project: Spark Issue

[jira] [Updated] (SPARK-27193) CodeFormatter should format multi comment lines correctly

2019-03-18 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-27193: - Description: when enable `spark.sql.codegen.comments`,  there will be multiple comment lines. However,

[jira] [Created] (SPARK-27193) CodeFormatter should format multi comment lines correctly

2019-03-18 Thread wuyi (JIRA)
wuyi created SPARK-27193: Summary: CodeFormatter should format multi comment lines correctly Key: SPARK-27193 URL: https://issues.apache.org/jira/browse/SPARK-27193 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26927) Race condition may cause dynamic allocation not working

2019-02-26 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16778048#comment-16778048 ] wuyi commented on SPARK-26927: -- I got it, thank you. > Race condition may cause dynamic allocation not

[jira] [Commented] (SPARK-26927) Race condition may cause dynamic allocation not working

2019-02-24 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16776309#comment-16776309 ] wuyi commented on SPARK-26927: -- [~liupengcheng] I can not understand the issue clearly by your desc. Can

[jira] [Resolved] (SPARK-26814) Avoid unnecessary block concatenation while empty block exists

2019-02-02 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi resolved SPARK-26814. -- Resolution: Won't Fix > Avoid unnecessary block concatenation while empty block exists >

[jira] [Created] (SPARK-26814) Avoid unnecessary block concatenation while empty block exists

2019-02-02 Thread wuyi (JIRA)
wuyi created SPARK-26814: Summary: Avoid unnecessary block concatenation while empty block exists Key: SPARK-26814 URL: https://issues.apache.org/jira/browse/SPARK-26814 Project: Spark Issue Type:

[jira] [Updated] (SPARK-26730) Strip redundant AssertNotNull expression for ExpressionEncoder's serializer

2019-01-25 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-26730: - Description: For types like Product, we've already add AssertNotNull when we construct serializer(pls see the

[jira] [Updated] (SPARK-26730) Strip redundant AssertNotNull expression for ExpressionEncoder's serializer

2019-01-25 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-26730: - Description: For types like Product, we've already add AssertNotNull when we construct serializer(pls see the

[jira] [Created] (SPARK-26730) Strip redundant AssertNotNull expression for ExpressionEncoder's serializer

2019-01-25 Thread wuyi (JIRA)
wuyi created SPARK-26730: Summary: Strip redundant AssertNotNull expression for ExpressionEncoder's serializer Key: SPARK-26730 URL: https://issues.apache.org/jira/browse/SPARK-26730 Project: Spark

[jira] [Commented] (SPARK-26439) Introduce WorkerOffer reservation mechanism for Barrier TaskSet

2019-01-07 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736687#comment-16736687 ] wuyi commented on SPARK-26439: -- [~srowen] ok. > Introduce WorkerOffer reservation mechanism for Barrier

[jira] [Updated] (SPARK-26439) Introduce WorkerOffer reservation mechanism for Barrier TaskSet

2018-12-26 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-26439: - Description: Currently, Barrier TaskSet has a hard requirement that tasks can only be launched in a single

[jira] [Updated] (SPARK-26439) Introduce WorkerOffer reservation mechanism for Barrier TaskSet

2018-12-26 Thread wuyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-26439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wuyi updated SPARK-26439: - Summary: Introduce WorkerOffer reservation mechanism for Barrier TaskSet (was: Introduce WorkOffer reservation

<    1   2   3   4   5   >