[
https://issues.apache.org/jira/browse/SPARK-7721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16284795#comment-16284795
]
Hyukjin Kwon commented on SPARK-7721:
-------------------------------------
[~rxin] Yup, it is. coverage from worker side is missed too as described above.
So, there are currently two problems:
1. worker side coverage is not covered:
I couldn't figure out how to track worker processes too with {{daemon.py}} and
{{fork()}} as Josh described. I think it became somehow important now in
particular for some recent changes like Pandas udfs.
One way I could do is some manual fixes / changes in our codebase for the
Python worker side to force it working. It's ugly but I think we could make
this working at least.
2. Doctest seems missed:
I think I also need a manual fix to run this with coverage. I could not figure
out a clear way to run this but at least I think I can make this working
> Generate test coverage report from Python
> -----------------------------------------
>
> Key: SPARK-7721
> URL: https://issues.apache.org/jira/browse/SPARK-7721
> Project: Spark
> Issue Type: Test
> Components: PySpark, Tests
> Reporter: Reynold Xin
>
> Would be great to have test coverage report for Python. Compared with Scala,
> it is tricker to understand the coverage without coverage reports in Python
> because we employ both docstring tests and unit tests in test files.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
