Repository: spark Updated Branches: refs/heads/branch-2.4 5d7444996 -> aff6aedf9
[SPARK-25384][SQL] Clarify fromJsonForceNullableSchema will be removed in Spark 3.0 See above. This should go into the 2.4 release. Closes #22509 from rxin/SPARK-25384. Authored-by: Reynold Xin <[email protected]> Signed-off-by: Wenchen Fan <[email protected]> (cherry picked from commit fb3276a54a2b7339e5e0fb62fb01cbefcc330c8b) Signed-off-by: Wenchen Fan <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/aff6aedf Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/aff6aedf Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/aff6aedf Branch: refs/heads/branch-2.4 Commit: aff6aedf9f4d5d4a4c961f5138bff893b4b1cb08 Parents: 5d74449 Author: Reynold Xin <[email protected]> Authored: Fri Sep 21 14:17:34 2018 +0800 Committer: Wenchen Fan <[email protected]> Committed: Fri Sep 21 14:18:00 2018 +0800 ---------------------------------------------------------------------- .../src/main/scala/org/apache/spark/sql/internal/SQLConf.scala | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/spark/blob/aff6aedf/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala ---------------------------------------------------------------------- diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala index e63dbba..4b8ce74 100644 --- a/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala +++ b/sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala @@ -585,7 +585,7 @@ object SQLConf { .internal() .doc("When true, force the output schema of the from_json() function to be nullable " + "(including all the fields). Otherwise, the schema might not be compatible with" + - "actual data, which leads to curruptions.") + "actual data, which leads to corruptions. This config will be removed in Spark 3.0.") .booleanConf .createWithDefault(true) --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
