dongjoon-hyun commented on code in PR #39098:
URL: https://github.com/apache/spark/pull/39098#discussion_r1056874918
##########
python/pyspark/pandas/generic.py:
##########
@@ -900,8 +900,8 @@ def to_json(
.. note:: pandas-on-Spark writes JSON files into the directory,
`path`, and writes
multiple `part-...` files in the directory when `path` is
specified.
- This behavior was inherited from Apache Spark. The number of files
can
- be controlled by `num_files`.
+ This behavior was inherited from Apache Spark. The number of
partitions can
+ be controlled by `num_files`. This is deprecated use `repartition`.
Review Comment:
ditto.
##########
python/pyspark/pandas/generic.py:
##########
@@ -927,8 +927,8 @@ def to_json(
A string representing the compression to use in the output file,
only used when the first argument is a filename. By default, the
compression is inferred from the filename.
- num_files: the number of files to be written in `path` directory when
- this is a path.
+ num_files: the number of partitions to be written in `path` directory
when
+ this is a path. This is deprecated use `repartition`.
Review Comment:
ditto
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
