[spark] branch master updated (e645125 -> be4faaf)
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from e645125 [SPARK-30267][SQL] Avro arrays can be of any List add be4faaf Revert "[SPARK-23264][SQL] Make INTERVAL keyword optional when ANSI enabled" No new revisions were added by this update. Summary of changes: docs/sql-keywords.md | 14 +- .../apache/spark/sql/catalyst/parser/SqlBase.g4| 52 +--- .../catalyst/parser/ExpressionParserSuite.scala| 36 + .../parser/TableIdentifierParserSuite.scala| 28 +--- .../resources/sql-tests/inputs/ansi/interval.sql | 18 +-- .../sql-tests/results/ansi/interval.sql.out| 148 + .../resources/sql-tests/results/interval.sql.out | 8 +- 7 files changed, 16 insertions(+), 288 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (e645125 -> be4faaf)
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from e645125 [SPARK-30267][SQL] Avro arrays can be of any List add be4faaf Revert "[SPARK-23264][SQL] Make INTERVAL keyword optional when ANSI enabled" No new revisions were added by this update. Summary of changes: docs/sql-keywords.md | 14 +- .../apache/spark/sql/catalyst/parser/SqlBase.g4| 52 +--- .../catalyst/parser/ExpressionParserSuite.scala| 36 + .../parser/TableIdentifierParserSuite.scala| 28 +--- .../resources/sql-tests/inputs/ansi/interval.sql | 18 +-- .../sql-tests/results/ansi/interval.sql.out| 148 + .../resources/sql-tests/results/interval.sql.out | 8 +- 7 files changed, 16 insertions(+), 288 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (d32ed25 -> e645125)
This is an automated email from the ASF dual-hosted git repository. gengliang pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from d32ed25 [SPARK-30144][ML][PYSPARK] Make MultilayerPerceptronClassificationModel extend MultilayerPerceptronParams add e645125 [SPARK-30267][SQL] Avro arrays can be of any List No new revisions were added by this update. Summary of changes: .../apache/spark/sql/avro/AvroDeserializer.scala | 5 +- .../sql/avro/AvroCatalystDataConversionSuite.scala | 67 ++ 2 files changed, 69 insertions(+), 3 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (6196c20 -> d32ed25)
This is an automated email from the ASF dual-hosted git repository.
srowen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 6196c20 [SPARK-30358][ML][PYSPARK][FOLLOWUP] ML expose predictRaw and
predictProbability on Python side
add d32ed25 [SPARK-30144][ML][PYSPARK] Make
MultilayerPerceptronClassificationModel extend MultilayerPerceptronParams
No new revisions were added by this update.
Summary of changes:
.../MultilayerPerceptronClassifier.scala | 51 +++--
.../r/MultilayerPerceptronClassifierWrapper.scala | 2 +-
.../hashingTF-2.4.4/metadata/._SUCCESS.crc | Bin 0 -> 8 bytes
.../hashingTF-2.4.4/metadata/.part-0.crc | Bin 0 -> 12 bytes
.../ml-models/hashingTF-2.4.4/metadata/_SUCCESS| 0
.../ml-models/hashingTF-2.4.4/metadata/part-0 | 1 +
.../ml-models/mlp-2.4.4/data/._SUCCESS.crc | Bin 0 -> 8 bytes
...-4b90-8231-eb5f6ac12138-c000.snappy.parquet.crc | Bin 0 -> 24 bytes
.../resources/ml-models/mlp-2.4.4/data/_SUCCESS| 0
...d8df-4b90-8231-eb5f6ac12138-c000.snappy.parquet | Bin 0 -> 2004 bytes
.../ml-models/mlp-2.4.4/metadata/._SUCCESS.crc | Bin 0 -> 8 bytes
.../ml-models/mlp-2.4.4/metadata/.part-0.crc | Bin 0 -> 12 bytes
.../ml-models/mlp-2.4.4/metadata/_SUCCESS | 0
.../ml-models/mlp-2.4.4/metadata/part-0| 1 +
.../strIndexerModel-2.4.4/data/._SUCCESS.crc | Bin 0 -> 8 bytes
...-4756-b9ca-c5e505dcd898-c000.snappy.parquet.crc | Bin 0 -> 12 bytes
.../ml-models/strIndexerModel-2.4.4/data/_SUCCESS | 0
...e17-4756-b9ca-c5e505dcd898-c000.snappy.parquet} | Bin 478 -> 478 bytes
.../strIndexerModel-2.4.4/metadata/._SUCCESS.crc | Bin 0 -> 8 bytes
.../strIndexerModel-2.4.4/metadata/.part-0.crc | Bin 0 -> 12 bytes
.../strIndexerModel-2.4.4/metadata/_SUCCESS| 0
.../strIndexerModel-2.4.4/metadata/part-0 | 1 +
.../hashingTF-pre3.0/metadata/.part-0.crc | Bin 12 -> 0 bytes
.../test-data/hashingTF-pre3.0/metadata/_SUCCESS | 0
.../test-data/hashingTF-pre3.0/metadata/part-0 | 1 -
.../test-data/strIndexerModel/metadata/part-0 | 1 -
.../MultilayerPerceptronClassifierSuite.scala | 13 ++
.../apache/spark/ml/feature/HashingTFSuite.scala | 4 +-
.../spark/ml/feature/StringIndexerSuite.scala | 4 +-
project/MimaExcludes.scala | 4 ++
python/pyspark/ml/classification.py| 19 +++-
31 files changed, 58 insertions(+), 44 deletions(-)
create mode 100644
mllib/src/test/resources/ml-models/hashingTF-2.4.4/metadata/._SUCCESS.crc
create mode 100644
mllib/src/test/resources/ml-models/hashingTF-2.4.4/metadata/.part-0.crc
copy
sql/hive/src/test/resources/ql/src/test/queries/clientpositive/groupby_mutli_insert_common_distinct.q
=> mllib/src/test/resources/ml-models/hashingTF-2.4.4/metadata/_SUCCESS (100%)
create mode 100644
mllib/src/test/resources/ml-models/hashingTF-2.4.4/metadata/part-0
create mode 100644
mllib/src/test/resources/ml-models/mlp-2.4.4/data/._SUCCESS.crc
create mode 100644
mllib/src/test/resources/ml-models/mlp-2.4.4/data/.part-0-fa18aaf6-d8df-4b90-8231-eb5f6ac12138-c000.snappy.parquet.crc
copy
sql/hive/src/test/resources/ql/src/test/queries/clientpositive/groupby_mutli_insert_common_distinct.q
=> mllib/src/test/resources/ml-models/mlp-2.4.4/data/_SUCCESS (100%)
create mode 100644
mllib/src/test/resources/ml-models/mlp-2.4.4/data/part-0-fa18aaf6-d8df-4b90-8231-eb5f6ac12138-c000.snappy.parquet
create mode 100644
mllib/src/test/resources/ml-models/mlp-2.4.4/metadata/._SUCCESS.crc
create mode 100644
mllib/src/test/resources/ml-models/mlp-2.4.4/metadata/.part-0.crc
copy
sql/hive/src/test/resources/ql/src/test/queries/clientpositive/groupby_mutli_insert_common_distinct.q
=> mllib/src/test/resources/ml-models/mlp-2.4.4/metadata/_SUCCESS (100%)
create mode 100644
mllib/src/test/resources/ml-models/mlp-2.4.4/metadata/part-0
create mode 100644
mllib/src/test/resources/ml-models/strIndexerModel-2.4.4/data/._SUCCESS.crc
create mode 100644
mllib/src/test/resources/ml-models/strIndexerModel-2.4.4/data/.part-0-f09b03f6-6e17-4756-b9ca-c5e505dcd898-c000.snappy.parquet.crc
copy
sql/hive/src/test/resources/ql/src/test/queries/clientpositive/groupby_mutli_insert_common_distinct.q
=> mllib/src/test/resources/ml-models/strIndexerModel-2.4.4/data/_SUCCESS
(100%)
rename
mllib/src/test/resources/{test-data/strIndexerModel/data/part-0-cfefeb56-2980-4c42-b8a7-a5a94265c479-c000.snappy.parquet
=>
ml-models/strIndexerModel-2.4.4/data/part-0-f09b03f6-6e17-4756-b9ca-c5e505dcd898-c000.snappy.parquet}
(66%)
create mode 100644
mllib/src/test/resources/ml-models/strIndexerModel-2.4.4/metadata/._SUCCESS.crc
create mode 100644
mllib/src/test/resources/ml-models/strIndexerModel-2.4.4/metadata/.part-0.crc
copy
[spark] branch master updated (7002932 -> 6196c20)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 7002932 [SPARK-30406] OneForOneStreamManager ensure that compound operations on shared variables are atomic add 6196c20 [SPARK-30358][ML][PYSPARK][FOLLOWUP] ML expose predictRaw and predictProbability on Python side No new revisions were added by this update. Summary of changes: python/pyspark/ml/classification.py | 44 + 1 file changed, 44 insertions(+) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (7002932 -> 6196c20)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 7002932 [SPARK-30406] OneForOneStreamManager ensure that compound operations on shared variables are atomic add 6196c20 [SPARK-30358][ML][PYSPARK][FOLLOWUP] ML expose predictRaw and predictProbability on Python side No new revisions were added by this update. Summary of changes: python/pyspark/ml/classification.py | 44 + 1 file changed, 44 insertions(+) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (7002932 -> 6196c20)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 7002932 [SPARK-30406] OneForOneStreamManager ensure that compound operations on shared variables are atomic add 6196c20 [SPARK-30358][ML][PYSPARK][FOLLOWUP] ML expose predictRaw and predictProbability on Python side No new revisions were added by this update. Summary of changes: python/pyspark/ml/classification.py | 44 + 1 file changed, 44 insertions(+) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (4a09317 -> 7002932)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4a09317 [SPARK-30359][CORE] Don't clear executorsPendingToRemove at the beginning of CoarseGrainedSchedulerBackend.reset add 7002932 [SPARK-30406] OneForOneStreamManager ensure that compound operations on shared variables are atomic No new revisions were added by this update. Summary of changes: .../org/apache/spark/network/server/OneForOneStreamManager.java | 8 1 file changed, 4 insertions(+), 4 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (4a09317 -> 7002932)
This is an automated email from the ASF dual-hosted git repository. srowen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 4a09317 [SPARK-30359][CORE] Don't clear executorsPendingToRemove at the beginning of CoarseGrainedSchedulerBackend.reset add 7002932 [SPARK-30406] OneForOneStreamManager ensure that compound operations on shared variables are atomic No new revisions were added by this update. Summary of changes: .../org/apache/spark/network/server/OneForOneStreamManager.java | 8 1 file changed, 4 insertions(+), 4 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (568ad4e -> 4a09317)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 568ad4e [SPARK-29947][SQL] Improve ResolveRelations performance add 4a09317 [SPARK-30359][CORE] Don't clear executorsPendingToRemove at the beginning of CoarseGrainedSchedulerBackend.reset No new revisions were added by this update. Summary of changes: .../cluster/CoarseGrainedSchedulerBackend.scala| 8 +-- .../spark/scheduler/TaskSetManagerSuite.scala | 65 +- .../scheduler/cluster/YarnSchedulerBackend.scala | 2 +- 3 files changed, 69 insertions(+), 6 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (e38964c -> 568ad4e)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from e38964c [SPARK-29768][SQL][FOLLOW-UP] Improve handling non-deterministic filter of ScanOperation add 568ad4e [SPARK-29947][SQL] Improve ResolveRelations performance No new revisions were added by this update. Summary of changes: .../org/apache/spark/sql/catalyst/analysis/Analyzer.scala| 12 +--- 1 file changed, 9 insertions(+), 3 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (cb9fc4b -> e38964c)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from cb9fc4b [SPARK-30225][CORE] Correct read() behavior past EOF in NioBufferedFileInputStream add e38964c [SPARK-29768][SQL][FOLLOW-UP] Improve handling non-deterministic filter of ScanOperation No new revisions were added by this update. Summary of changes: .../spark/sql/catalyst/planning/patterns.scala | 20 +++- .../execution/datasources/FileSourceStrategy.scala | 3 ++- .../apache/spark/sql/sources/PrunedScanSuite.scala | 4 ++-- 3 files changed, 15 insertions(+), 12 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (cb9fc4b -> e38964c)
This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from cb9fc4b [SPARK-30225][CORE] Correct read() behavior past EOF in NioBufferedFileInputStream add e38964c [SPARK-29768][SQL][FOLLOW-UP] Improve handling non-deterministic filter of ScanOperation No new revisions were added by this update. Summary of changes: .../spark/sql/catalyst/planning/patterns.scala | 20 +++- .../execution/datasources/FileSourceStrategy.scala | 3 ++- .../apache/spark/sql/sources/PrunedScanSuite.scala | 4 ++-- 3 files changed, 15 insertions(+), 12 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-2.4 updated (16f8fae -> f935e4d)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git. from 16f8fae [SPARK-30285][CORE] Fix deadlock between LiveListenerBus#stop and AsyncEventQueue#removeListenerOnError add f935e4d [SPARK-30225][CORE] Correct read() behavior past EOF in NioBufferedFileInputStream No new revisions were added by this update. Summary of changes: .../org/apache/spark/io/NioBufferedFileInputStream.java | 2 +- .../apache/spark/io/GenericFileInputStreamSuite.java| 17 - 2 files changed, 17 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (c49388a -> cb9fc4b)
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from c49388a [SPARK-30214][SQL] A new framework to resolve v2 commands add cb9fc4b [SPARK-30225][CORE] Correct read() behavior past EOF in NioBufferedFileInputStream No new revisions were added by this update. Summary of changes: .../org/apache/spark/io/NioBufferedFileInputStream.java | 2 +- .../apache/spark/io/GenericFileInputStreamSuite.java| 17 - 2 files changed, 17 insertions(+), 2 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (4f9d3dc -> c49388a)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 4f9d3dc [SPARK-30384][WEBUI] Needs to improve the Column name and Add
tooltips for the Fair Scheduler Pool Table
add c49388a [SPARK-30214][SQL] A new framework to resolve v2 commands
No new revisions were added by this update.
Summary of changes:
.../apache/spark/sql/catalyst/parser/SqlBase.g4| 3 +
.../spark/sql/catalyst/analysis/Analyzer.scala | 34 ++-
.../sql/catalyst/analysis/CheckAnalysis.scala | 6 ++
.../spark/sql/catalyst/analysis/namespace.scala} | 20 +++
.../spark/sql/catalyst/analysis/table.scala} | 22
.../spark/sql/catalyst/parser/AstBuilder.scala | 18 ++
.../sql/catalyst/plans/logical/v2Commands.scala| 32 ++-
.../spark/sql/catalyst/parser/DDLParserSuite.scala | 21 ++-
.../datasources/v2/DataSourceV2Strategy.scala | 16 +-
.../datasources/v2/V2SessionCatalog.scala | 4 +-
.../sql-tests/results/postgreSQL/comments.sql.out | 18 +++---
.../spark/sql/connector/DataSourceV2SQLSuite.scala | 65 ++
12 files changed, 220 insertions(+), 39 deletions(-)
copy
sql/{core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DeleteFromTableExec.scala
=>
catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/namespace.scala}
(66%)
copy
sql/{core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/RefreshTableExec.scala
=> catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/table.scala}
(67%)
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (4f9d3dc -> c49388a)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 4f9d3dc [SPARK-30384][WEBUI] Needs to improve the Column name and Add
tooltips for the Fair Scheduler Pool Table
add c49388a [SPARK-30214][SQL] A new framework to resolve v2 commands
No new revisions were added by this update.
Summary of changes:
.../apache/spark/sql/catalyst/parser/SqlBase.g4| 3 +
.../spark/sql/catalyst/analysis/Analyzer.scala | 34 ++-
.../sql/catalyst/analysis/CheckAnalysis.scala | 6 ++
.../spark/sql/catalyst/analysis/namespace.scala} | 20 +++
.../spark/sql/catalyst/analysis/table.scala} | 22
.../spark/sql/catalyst/parser/AstBuilder.scala | 18 ++
.../sql/catalyst/plans/logical/v2Commands.scala| 32 ++-
.../spark/sql/catalyst/parser/DDLParserSuite.scala | 21 ++-
.../datasources/v2/DataSourceV2Strategy.scala | 16 +-
.../datasources/v2/V2SessionCatalog.scala | 4 +-
.../sql-tests/results/postgreSQL/comments.sql.out | 18 +++---
.../spark/sql/connector/DataSourceV2SQLSuite.scala | 65 ++
12 files changed, 220 insertions(+), 39 deletions(-)
copy
sql/{core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/DeleteFromTableExec.scala
=>
catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/namespace.scala}
(66%)
copy
sql/{core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/RefreshTableExec.scala
=> catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/table.scala}
(67%)
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
