[
https://issues.apache.org/jira/browse/SPARK-1192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14169649#comment-14169649
]
Sean Owen commented on SPARK-1192:
----------------------------------
PR is actually at https://github.com/apache/spark/pull/2312 and is misnamed. Is
this still live though?
> Around 30 parameters in Spark are used but undocumented and some are having
> confusing name
> ------------------------------------------------------------------------------------------
>
> Key: SPARK-1192
> URL: https://issues.apache.org/jira/browse/SPARK-1192
> Project: Spark
> Issue Type: Improvement
> Components: Documentation
> Affects Versions: 1.0.0
> Reporter: Nan Zhu
> Assignee: Nan Zhu
>
> I grep the code in core component, I found that around 30 parameters in the
> implementation is actually used but undocumented. By reading the source code,
> I found that some of them are actually very useful for the user.
> I suggest to make a complete document on the parameters.
> Also some parameters are having confusing names
> spark.shuffle.copier.threads - this parameters is to control how many threads
> you will use when you start a Netty-based shuffle service....but from the
> name, we cannot get this information
> spark.shuffle.sender.port - the similar problem with the above one, when you
> use Netty-based shuffle receiver, you will have to setup a Netty-based
> sender...this parameter is to setup the port used by the Netty sender, but
> the name cannot convey this information
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
