[jira] [Updated] (SPARK-35375) Use Jinja2 < 3.0.0 for linter dependency in GA

2021-05-11 Thread Kousuke Saruta (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-35375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kousuke Saruta updated SPARK-35375:
---
Description: 
>From a few hours ago, Python linter fails in GA.
The latest Jinja 3.0.0 seems to cause this failure.
https://pypi.org/project/Jinja2/

{code}
Run ./dev/lint-python
starting python compilation test...
python compilation succeeded.

starting pycodestyle test...
pycodestyle checks passed.

starting flake8 test...
flake8 checks passed.

starting mypy test...
mypy checks passed.

starting sphinx-build tests...
sphinx-build checks failed:
Running Sphinx v3.0.4
making output directory... done
[autosummary] generating autosummary for: development/contributing.rst, 
development/debugging.rst, development/index.rst, development/setting_ide.rst, 
development/testing.rst, getting_started/index.rst, 
getting_started/install.rst, getting_started/quickstart.ipynb, index.rst, 
migration_guide/index.rst, ..., reference/pyspark.ml.rst, 
reference/pyspark.mllib.rst, reference/pyspark.resource.rst, 
reference/pyspark.rst, reference/pyspark.sql.rst, reference/pyspark.ss.rst, 
reference/pyspark.streaming.rst, user_guide/arrow_pandas.rst, 
user_guide/index.rst, user_guide/python_packaging.rst

Exception occurred:
  File 
"/__w/spark/spark/python/docs/source/_templates/autosummary/class_with_docs.rst",
 line 26, in top-level template code
{% if '__init__' in methods %}
jinja2.exceptions.UndefinedError: 'methods' is undefined
The full traceback has been saved in /tmp/sphinx-err-ypgyi75y.log, if you want 
to report the issue to the developers.
Please also report this if it was a user error, so that a better error message 
can be provided next time.
A bug report can be filed in the tracker at 
. Thanks!
make: *** [Makefile:20: html] Error 2

re-running make html to print full warning list:
Running Sphinx v3.0.4
making output directory... done
[autosummary] generating autosummary for: development/contributing.rst, 
development/debugging.rst, development/index.rst, development/setting_ide.rst, 
development/testing.rst, getting_started/index.rst, 
getting_started/install.rst, getting_started/quickstart.ipynb, index.rst, 
migration_guide/index.rst, ..., reference/pyspark.ml.rst, 
reference/pyspark.mllib.rst, reference/pyspark.resource.rst, 
reference/pyspark.rst, reference/pyspark.sql.rst, reference/pyspark.ss.rst, 
reference/pyspark.streaming.rst, user_guide/arrow_pandas.rst, 
user_guide/index.rst, user_guide/python_packaging.rst

Exception occurred:
  File 
"/__w/spark/spark/python/docs/source/_templates/autosummary/class_with_docs.rst",
 line 26, in top-level template code
{% if '__init__' in methods %}
jinja2.exceptions.UndefinedError: 'methods' is undefined
The full traceback has been saved in /tmp/sphinx-err-fvtmvvwv.log, if you want 
to report the issue to the developers.
Please also report this if it was a user error, so that a better error message 
can be provided next time.
A bug report can be filed in the tracker at 
. Thanks!
make: *** [Makefile:20: html] Error 2
Error: Process completed with exit code 2.
{code}

  was:
>From a few hours ago, Python linter fails in GA.
The latest Jinja 3.0.0 seems to cause this failure.

{code}
Run ./dev/lint-python
starting python compilation test...
python compilation succeeded.

starting pycodestyle test...
pycodestyle checks passed.

starting flake8 test...
flake8 checks passed.

starting mypy test...
mypy checks passed.

starting sphinx-build tests...
sphinx-build checks failed:
Running Sphinx v3.0.4
making output directory... done
[autosummary] generating autosummary for: development/contributing.rst, 
development/debugging.rst, development/index.rst, development/setting_ide.rst, 
development/testing.rst, getting_started/index.rst, 
getting_started/install.rst, getting_started/quickstart.ipynb, index.rst, 
migration_guide/index.rst, ..., reference/pyspark.ml.rst, 
reference/pyspark.mllib.rst, reference/pyspark.resource.rst, 
reference/pyspark.rst, reference/pyspark.sql.rst, reference/pyspark.ss.rst, 
reference/pyspark.streaming.rst, user_guide/arrow_pandas.rst, 
user_guide/index.rst, user_guide/python_packaging.rst

Exception occurred:
  File 
"/__w/spark/spark/python/docs/source/_templates/autosummary/class_with_docs.rst",
 line 26, in top-level template code
{% if '__init__' in methods %}
jinja2.exceptions.UndefinedError: 'methods' is undefined
The full traceback has been saved in /tmp/sphinx-err-ypgyi75y.log, if you want 
to report the issue to the developers.
Please also report this if it was a user error, so that a better error message 
can be provided next time.
A bug report can be filed in the tracker at 
. Thanks!
make: *** [Makefile:20: html] Error 2

re-running make html to print full warning list:
Running Sphinx 

[jira] [Updated] (SPARK-35375) Use Jinja2 < 3.0.0 for linter dependency in GA

2021-05-11 Thread Kousuke Saruta (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-35375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kousuke Saruta updated SPARK-35375:
---
Description: 
>From a few hours ago, Python linter fails in GA.
The latest Jinja 3.0.0 seems to cause this failure.

{code}
Run ./dev/lint-python
starting python compilation test...
python compilation succeeded.

starting pycodestyle test...
pycodestyle checks passed.

starting flake8 test...
flake8 checks passed.

starting mypy test...
mypy checks passed.

starting sphinx-build tests...
sphinx-build checks failed:
Running Sphinx v3.0.4
making output directory... done
[autosummary] generating autosummary for: development/contributing.rst, 
development/debugging.rst, development/index.rst, development/setting_ide.rst, 
development/testing.rst, getting_started/index.rst, 
getting_started/install.rst, getting_started/quickstart.ipynb, index.rst, 
migration_guide/index.rst, ..., reference/pyspark.ml.rst, 
reference/pyspark.mllib.rst, reference/pyspark.resource.rst, 
reference/pyspark.rst, reference/pyspark.sql.rst, reference/pyspark.ss.rst, 
reference/pyspark.streaming.rst, user_guide/arrow_pandas.rst, 
user_guide/index.rst, user_guide/python_packaging.rst

Exception occurred:
  File 
"/__w/spark/spark/python/docs/source/_templates/autosummary/class_with_docs.rst",
 line 26, in top-level template code
{% if '__init__' in methods %}
jinja2.exceptions.UndefinedError: 'methods' is undefined
The full traceback has been saved in /tmp/sphinx-err-ypgyi75y.log, if you want 
to report the issue to the developers.
Please also report this if it was a user error, so that a better error message 
can be provided next time.
A bug report can be filed in the tracker at 
. Thanks!
make: *** [Makefile:20: html] Error 2

re-running make html to print full warning list:
Running Sphinx v3.0.4
making output directory... done
[autosummary] generating autosummary for: development/contributing.rst, 
development/debugging.rst, development/index.rst, development/setting_ide.rst, 
development/testing.rst, getting_started/index.rst, 
getting_started/install.rst, getting_started/quickstart.ipynb, index.rst, 
migration_guide/index.rst, ..., reference/pyspark.ml.rst, 
reference/pyspark.mllib.rst, reference/pyspark.resource.rst, 
reference/pyspark.rst, reference/pyspark.sql.rst, reference/pyspark.ss.rst, 
reference/pyspark.streaming.rst, user_guide/arrow_pandas.rst, 
user_guide/index.rst, user_guide/python_packaging.rst

Exception occurred:
  File 
"/__w/spark/spark/python/docs/source/_templates/autosummary/class_with_docs.rst",
 line 26, in top-level template code
{% if '__init__' in methods %}
jinja2.exceptions.UndefinedError: 'methods' is undefined
The full traceback has been saved in /tmp/sphinx-err-fvtmvvwv.log, if you want 
to report the issue to the developers.
Please also report this if it was a user error, so that a better error message 
can be provided next time.
A bug report can be filed in the tracker at 
. Thanks!
make: *** [Makefile:20: html] Error 2
Error: Process completed with exit code 2.
{code}

  was:
>From a few hours ago, Python linter fails in GA.

The latest Jinja 3.0.0 seems to cause this failure.


> Use Jinja2 < 3.0.0 for linter dependency in GA
> --
>
> Key: SPARK-35375
> URL: https://issues.apache.org/jira/browse/SPARK-35375
> Project: Spark
>  Issue Type: Bug
>  Components: Project Infra
>Affects Versions: 3.2.0
>Reporter: Kousuke Saruta
>Assignee: Kousuke Saruta
>Priority: Major
>
> From a few hours ago, Python linter fails in GA.
> The latest Jinja 3.0.0 seems to cause this failure.
> {code}
> Run ./dev/lint-python
> starting python compilation test...
> python compilation succeeded.
> starting pycodestyle test...
> pycodestyle checks passed.
> starting flake8 test...
> flake8 checks passed.
> starting mypy test...
> mypy checks passed.
> starting sphinx-build tests...
> sphinx-build checks failed:
> Running Sphinx v3.0.4
> making output directory... done
> [autosummary] generating autosummary for: development/contributing.rst, 
> development/debugging.rst, development/index.rst, 
> development/setting_ide.rst, development/testing.rst, 
> getting_started/index.rst, getting_started/install.rst, 
> getting_started/quickstart.ipynb, index.rst, migration_guide/index.rst, ..., 
> reference/pyspark.ml.rst, reference/pyspark.mllib.rst, 
> reference/pyspark.resource.rst, reference/pyspark.rst, 
> reference/pyspark.sql.rst, reference/pyspark.ss.rst, 
> reference/pyspark.streaming.rst, user_guide/arrow_pandas.rst, 
> user_guide/index.rst, user_guide/python_packaging.rst
> Exception occurred:
>   File 
>