Github user HyukjinKwon commented on the issue:
https://github.com/apache/spark/pull/15879
Hi @sarutak and @moomindani, I happened to look thought this just for my
curiosity.
```
./docs/programming-guide.md:* The `textFile` method also takes an optional
second argument for controlling the number of partitions of the file. By
default, Spark creates one partition for each block of the file (blocks being
64MB by default in HDFS), but you can also ask for a higher number of
partitions by passing a larger value. Note that you cannot have fewer
partitions than blocks.
./docs/programming-guide.md:* The `textFile` method also takes an optional
second argument for controlling the number of partitions of the file. By
default, Spark creates one partition for each block of the file (blocks being
64MB by default in HDFS), but you can also ask for a higher number of
partitions by passing a larger value. Note that you cannot have fewer
partitions than blocks.
./docs/programming-guide.md:* The `textFile` method also takes an optional
second argument for controlling the number of partitions of the file. By
default, Spark creates one partition for each block of the file (blocks being
64MB by default in HDFS), but you can also ask for a higher number of
partitions by passing a larger value. Note that you cannot have fewer
partitions than blocks.
```
It seems there are three same instances with this. Should we correct them
too?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
