[jira] [Assigned] (AIRFLOW-4364) Integrate Pylint

2020-03-12 Thread Tzu-Li (Gordon) Tai (Jira)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tzu-Li (Gordon) Tai reassigned AIRFLOW-4364:


Assignee: (was: Tzu-Li (Gordon) Tai)

> Integrate Pylint
> 
>
> Key: AIRFLOW-4364
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4364
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: pylint
>Affects Versions: 2.0.0
>Reporter: Bas Harenslak
>Priority: Major
>
> After a [vote on the mailing 
> list|https://lists.apache.org/thread.html/f4940d36e98ded96a2473bb2ccdfa4cc648faa2c1334b2aa901c0bba@%3Cdev.airflow.apache.org%3E]
>  everybody voted for pylint integration.
> Making the whole project Pylint compatible is a lot of work and big change. 
> Therefore we split up all the work in subissues under this issue. The 
> approach is as follows:
> All files are currently blacklisted from Pylint. The blacklist is stored in 
> scripts/ci/pylint_todo.txt. Every subissue relates to one or more files on 
> the blacklist. Once you start on an issue:
>  # (running scripts/ci/ci_pylint.sh on master should produce no messages)
>  # Remove the files mentioned in your issue from the blacklist
>  # Run scripts/ci/ci_pylint.sh to see all messages on the no longer 
> blacklisted files
>  # Fix all messages and create PR
> *Why a separate blacklist file and not use Pylint's --ignore-pattern to 
> ignore files?*
>  --ignore-pattern only works on base filenames, not paths.
> *Why don't you blacklist patterns, where 1 line relates to 1 JIRA issue?*
>  Creating a list of non-overlapping patterns proved difficult, this was the 
> pragmatic solution.
> *Rule X is too strict. Can we disable it?*
> In the first PR ([https://github.com/apache/airflow/pull/5238]) we made a 
> choice on every error found on Airflow master back then. While at occasions 
> it might seem harsh to be strict on the code, Airflow is an open source 
> project with many contributors from all over the world. Others read the code 
> without the thought process you put into the code and it helps to have e.g. 
> descriptive variable names, docstrings and sticking to Python conventions. 
> This helps the collaboration between everybody and even your future self. 
> Typically, this question suggests one is trying to lower the boundaries. If 
> you believe there is a valid reason for doing so, please add it to the PR and 
> explain the reason.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Assigned] (AIRFLOW-4364) Integrate Pylint

2020-03-12 Thread Tzu-Li (Gordon) Tai (Jira)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tzu-Li (Gordon) Tai reassigned AIRFLOW-4364:


Assignee: Tzu-Li (Gordon) Tai

> Integrate Pylint
> 
>
> Key: AIRFLOW-4364
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4364
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: pylint
>Affects Versions: 2.0.0
>Reporter: Bas Harenslak
>Assignee: Tzu-Li (Gordon) Tai
>Priority: Major
>
> After a [vote on the mailing 
> list|https://lists.apache.org/thread.html/f4940d36e98ded96a2473bb2ccdfa4cc648faa2c1334b2aa901c0bba@%3Cdev.airflow.apache.org%3E]
>  everybody voted for pylint integration.
> Making the whole project Pylint compatible is a lot of work and big change. 
> Therefore we split up all the work in subissues under this issue. The 
> approach is as follows:
> All files are currently blacklisted from Pylint. The blacklist is stored in 
> scripts/ci/pylint_todo.txt. Every subissue relates to one or more files on 
> the blacklist. Once you start on an issue:
>  # (running scripts/ci/ci_pylint.sh on master should produce no messages)
>  # Remove the files mentioned in your issue from the blacklist
>  # Run scripts/ci/ci_pylint.sh to see all messages on the no longer 
> blacklisted files
>  # Fix all messages and create PR
> *Why a separate blacklist file and not use Pylint's --ignore-pattern to 
> ignore files?*
>  --ignore-pattern only works on base filenames, not paths.
> *Why don't you blacklist patterns, where 1 line relates to 1 JIRA issue?*
>  Creating a list of non-overlapping patterns proved difficult, this was the 
> pragmatic solution.
> *Rule X is too strict. Can we disable it?*
> In the first PR ([https://github.com/apache/airflow/pull/5238]) we made a 
> choice on every error found on Airflow master back then. While at occasions 
> it might seem harsh to be strict on the code, Airflow is an open source 
> project with many contributors from all over the world. Others read the code 
> without the thought process you put into the code and it helps to have e.g. 
> descriptive variable names, docstrings and sticking to Python conventions. 
> This helps the collaboration between everybody and even your future self. 
> Typically, this question suggests one is trying to lower the boundaries. If 
> you believe there is a valid reason for doing so, please add it to the PR and 
> explain the reason.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Assigned] (AIRFLOW-4364) Integrate Pylint

2019-06-09 Thread Jarek Potiuk (JIRA)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jarek Potiuk reassigned AIRFLOW-4364:
-

Assignee: Jarek Potiuk

> Integrate Pylint
> 
>
> Key: AIRFLOW-4364
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4364
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: ci
>Affects Versions: 2.0.0
>Reporter: Bas Harenslak
>Assignee: Jarek Potiuk
>Priority: Major
>
> After a [vote on the mailing 
> list|https://lists.apache.org/thread.html/f4940d36e98ded96a2473bb2ccdfa4cc648faa2c1334b2aa901c0bba@%3Cdev.airflow.apache.org%3E]
>  everybody voted for pylint integration.
> Making the whole project Pylint compatible is a lot of work and big change. 
> Therefore we split up all the work in subissues under this issue. The 
> approach is as follows:
> All files are currently blacklisted from Pylint. The blacklist is stored in 
> scripts/ci/pylint_todo.txt. Every subissue relates to one or more files on 
> the blacklist. Once you start on an issue:
>  # (running scripts/ci/ci_pylint.sh on master should produce no messages)
>  # Remove the files mentioned in your issue from the blacklist
>  # Run scripts/ci/ci_pylint.sh to see all messages on the no longer 
> blacklisted files
>  # Fix all messages and create PR
> *Why a separate blacklist file and not use Pylint's --ignore-pattern to 
> ignore files?*
>  --ignore-pattern only works on base filenames, not paths.
> *Why don't you blacklist patterns, where 1 line relates to 1 JIRA issue?*
>  Creating a list of non-overlapping patterns proved difficult, this was the 
> pragmatic solution.
> *Rule X is too strict. Can we disable it?*
> In the first PR ([https://github.com/apache/airflow/pull/5238]) we made a 
> choice on every error found on Airflow master back then. While at occasions 
> it might seem harsh to be strict on the code, Airflow is an open source 
> project with many contributors from all over the world. Others read the code 
> without the thought process you put into the code and it helps to have e.g. 
> descriptive variable names, docstrings and sticking to Python conventions. 
> This helps the collaboration between everybody and even your future self. 
> Typically, this question suggests one is trying to lower the boundaries. If 
> you believe there is a valid reason for doing so, please add it to the PR and 
> explain the reason.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (AIRFLOW-4364) Integrate Pylint

2019-06-09 Thread Jarek Potiuk (JIRA)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jarek Potiuk reassigned AIRFLOW-4364:
-

Assignee: (was: Jarek Potiuk)

> Integrate Pylint
> 
>
> Key: AIRFLOW-4364
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4364
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: ci
>Affects Versions: 2.0.0
>Reporter: Bas Harenslak
>Priority: Major
>
> After a [vote on the mailing 
> list|https://lists.apache.org/thread.html/f4940d36e98ded96a2473bb2ccdfa4cc648faa2c1334b2aa901c0bba@%3Cdev.airflow.apache.org%3E]
>  everybody voted for pylint integration.
> Making the whole project Pylint compatible is a lot of work and big change. 
> Therefore we split up all the work in subissues under this issue. The 
> approach is as follows:
> All files are currently blacklisted from Pylint. The blacklist is stored in 
> scripts/ci/pylint_todo.txt. Every subissue relates to one or more files on 
> the blacklist. Once you start on an issue:
>  # (running scripts/ci/ci_pylint.sh on master should produce no messages)
>  # Remove the files mentioned in your issue from the blacklist
>  # Run scripts/ci/ci_pylint.sh to see all messages on the no longer 
> blacklisted files
>  # Fix all messages and create PR
> *Why a separate blacklist file and not use Pylint's --ignore-pattern to 
> ignore files?*
>  --ignore-pattern only works on base filenames, not paths.
> *Why don't you blacklist patterns, where 1 line relates to 1 JIRA issue?*
>  Creating a list of non-overlapping patterns proved difficult, this was the 
> pragmatic solution.
> *Rule X is too strict. Can we disable it?*
> In the first PR ([https://github.com/apache/airflow/pull/5238]) we made a 
> choice on every error found on Airflow master back then. While at occasions 
> it might seem harsh to be strict on the code, Airflow is an open source 
> project with many contributors from all over the world. Others read the code 
> without the thought process you put into the code and it helps to have e.g. 
> descriptive variable names, docstrings and sticking to Python conventions. 
> This helps the collaboration between everybody and even your future self. 
> Typically, this question suggests one is trying to lower the boundaries. If 
> you believe there is a valid reason for doing so, please add it to the PR and 
> explain the reason.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (AIRFLOW-4364) Integrate Pylint

2019-06-02 Thread Andrii Soldatenko (JIRA)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrii Soldatenko reassigned AIRFLOW-4364:
--

Assignee: (was: Andrii Soldatenko)

> Integrate Pylint
> 
>
> Key: AIRFLOW-4364
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4364
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: ci
>Affects Versions: 2.0.0
>Reporter: Bas Harenslak
>Priority: Major
>
> After a [vote on the mailing 
> list|https://lists.apache.org/thread.html/f4940d36e98ded96a2473bb2ccdfa4cc648faa2c1334b2aa901c0bba@%3Cdev.airflow.apache.org%3E]
>  everybody voted for pylint integration.
> Making the whole project Pylint compatible is a lot of work and big change. 
> Therefore we split up all the work in subissues under this issue. The 
> approach is as follows:
> All files are currently blacklisted from Pylint. The blacklist is stored in 
> scripts/ci/pylint_todo.txt. Every subissue relates to one or more files on 
> the blacklist. Once you start on an issue:
>  # (running scripts/ci/ci_pylint.sh on master should produce no messages)
>  # Remove the files mentioned in your issue from the blacklist
>  # Run scripts/ci/ci_pylint.sh to see all messages on the no longer 
> blacklisted files
>  # Fix all messages and create PR
> *Why a separate blacklist file and not use Pylint's --ignore-pattern to 
> ignore files?*
>  --ignore-pattern only works on base filenames, not paths.
> *Why don't you blacklist patterns, where 1 line relates to 1 JIRA issue?*
>  Creating a list of non-overlapping patterns proved difficult, this was the 
> pragmatic solution.
> *Rule X is too strict. Can we disable it?*
> In the first PR ([https://github.com/apache/airflow/pull/5238]) we made a 
> choice on every error found on Airflow master back then. While at occasions 
> it might seem harsh to be strict on the code, Airflow is an open source 
> project with many contributors from all over the world. Others read the code 
> without the thought process you put into the code and it helps to have e.g. 
> descriptive variable names, docstrings and sticking to Python conventions. 
> This helps the collaboration between everybody and even your future self. 
> Typically, this question suggests one is trying to lower the boundaries. If 
> you believe there is a valid reason for doing so, please add it to the PR and 
> explain the reason.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (AIRFLOW-4364) Integrate Pylint

2019-06-02 Thread Andrii Soldatenko (JIRA)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Andrii Soldatenko reassigned AIRFLOW-4364:
--

Assignee: Andrii Soldatenko

> Integrate Pylint
> 
>
> Key: AIRFLOW-4364
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4364
> Project: Apache Airflow
>  Issue Type: Improvement
>  Components: ci
>Affects Versions: 2.0.0
>Reporter: Bas Harenslak
>Assignee: Andrii Soldatenko
>Priority: Major
>
> After a [vote on the mailing 
> list|https://lists.apache.org/thread.html/f4940d36e98ded96a2473bb2ccdfa4cc648faa2c1334b2aa901c0bba@%3Cdev.airflow.apache.org%3E]
>  everybody voted for pylint integration.
> Making the whole project Pylint compatible is a lot of work and big change. 
> Therefore we split up all the work in subissues under this issue. The 
> approach is as follows:
> All files are currently blacklisted from Pylint. The blacklist is stored in 
> scripts/ci/pylint_todo.txt. Every subissue relates to one or more files on 
> the blacklist. Once you start on an issue:
>  # (running scripts/ci/ci_pylint.sh on master should produce no messages)
>  # Remove the files mentioned in your issue from the blacklist
>  # Run scripts/ci/ci_pylint.sh to see all messages on the no longer 
> blacklisted files
>  # Fix all messages and create PR
> *Why a separate blacklist file and not use Pylint's --ignore-pattern to 
> ignore files?*
>  --ignore-pattern only works on base filenames, not paths.
> *Why don't you blacklist patterns, where 1 line relates to 1 JIRA issue?*
>  Creating a list of non-overlapping patterns proved difficult, this was the 
> pragmatic solution.
> *Rule X is too strict. Can we disable it?*
> In the first PR ([https://github.com/apache/airflow/pull/5238]) we made a 
> choice on every error found on Airflow master back then. While at occasions 
> it might seem harsh to be strict on the code, Airflow is an open source 
> project with many contributors from all over the world. Others read the code 
> without the thought process you put into the code and it helps to have e.g. 
> descriptive variable names, docstrings and sticking to Python conventions. 
> This helps the collaboration between everybody and even your future self. 
> Typically, this question suggests one is trying to lower the boundaries. If 
> you believe there is a valid reason for doing so, please add it to the PR and 
> explain the reason.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (AIRFLOW-4364) Integrate Pylint

2019-04-28 Thread Bas Harenslak (JIRA)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bas Harenslak reassigned AIRFLOW-4364:
--

Assignee: Bas Harenslak

> Integrate Pylint
> 
>
> Key: AIRFLOW-4364
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4364
> Project: Apache Airflow
>  Issue Type: Improvement
>Reporter: Bas Harenslak
>Assignee: Bas Harenslak
>Priority: Major
>
> After a [vote on the mailing 
> list|https://lists.apache.org/thread.html/f4940d36e98ded96a2473bb2ccdfa4cc648faa2c1334b2aa901c0bba@%3Cdev.airflow.apache.org%3E]
>  everybody voted for pylint integration. It involves a big change to the 
> codebase, so let's do it in 2 steps:
>  # Check pylint only on changed code in the CI.
>  # After a while we should have a good pylint config, and the remaining 
> non-checked code should be made compatible with pylint, i.e. enable pylint in 
> the CI on the full project.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Assigned] (AIRFLOW-4364) Integrate Pylint

2019-04-28 Thread Bas Harenslak (JIRA)


 [ 
https://issues.apache.org/jira/browse/AIRFLOW-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Bas Harenslak reassigned AIRFLOW-4364:
--

Assignee: (was: Bas Harenslak)

> Integrate Pylint
> 
>
> Key: AIRFLOW-4364
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4364
> Project: Apache Airflow
>  Issue Type: Improvement
>Reporter: Bas Harenslak
>Priority: Major
>
> After a [vote on the mailing 
> list|https://lists.apache.org/thread.html/f4940d36e98ded96a2473bb2ccdfa4cc648faa2c1334b2aa901c0bba@%3Cdev.airflow.apache.org%3E]
>  everybody voted for pylint integration. It involves a big change to the 
> codebase, so let's do it in 2 steps:
>  # Check pylint only on changed code in the CI.
>  # After a while we should have a good pylint config, and the remaining 
> non-checked code should be made compatible with pylint, i.e. enable pylint in 
> the CI on the full project.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)