[jira] [Updated] (BEAM-7790) Make debugging subprocess workers easier

2020-06-01 Thread Kenneth Knowles (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles updated BEAM-7790:
--
Labels: stale-assigned  (was: )

> Make debugging subprocess workers easier
> 
>
> Key: BEAM-7790
> URL: https://issues.apache.org/jira/browse/BEAM-7790
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-harness
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: P3
>  Labels: stale-assigned
>
> [ ] The output of the SDK workers is currently invisible due to the output 
> and logging setup.
> [ ] The dockerized version of the Python SDK worker sets up an HTTP server to 
> let the user view stack traces for all of the worker's threads [1]. It would 
> be useful if this was available for other execution modes as well.
> [x] BEAM-7676 Make the above items more usable with multiple subprocesses by 
> identifying them with worker ids.
>  
> [1] 
> [https://github.com/apache/beam/blob/9f4ce1c6fc2fb195e218783a6e9ce6104ddb4d1e/sdks/python/apache_beam/runners/worker/sdk_worker_main.py#L46-L89]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Updated] (BEAM-7790) Make debugging subprocess workers easier

2019-08-19 Thread Kyle Weaver (Jira)


 [ 
https://issues.apache.org/jira/browse/BEAM-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kyle Weaver updated BEAM-7790:
--
Description: 
[ ] The output of the SDK workers is currently invisible due to the output and 
logging setup.

[ ] The dockerized version of the Python SDK worker sets up an HTTP server to 
let the user view stack traces for all of the worker's threads [1]. It would be 
useful if this was available for other execution modes as well.

[x] BEAM-7676 Make the above items more usable with multiple subprocesses by 
identifying them with worker ids.

 

[1] 
[https://github.com/apache/beam/blob/9f4ce1c6fc2fb195e218783a6e9ce6104ddb4d1e/sdks/python/apache_beam/runners/worker/sdk_worker_main.py#L46-L89]

  was:
1. The output of the SDK workers is currently invisible due to the output and 
logging setup.

2. The dockerized version of the Python SDK worker sets up an HTTP server to 
let the user view stack traces for all of the worker's threads [1]. It would be 
useful if this was available for other execution modes as well.

3. Make the above items more usable with multiple subprocesses by identifying 
them with worker ids.

 

[1] 
[https://github.com/apache/beam/blob/9f4ce1c6fc2fb195e218783a6e9ce6104ddb4d1e/sdks/python/apache_beam/runners/worker/sdk_worker_main.py#L46-L89]


> Make debugging subprocess workers easier
> 
>
> Key: BEAM-7790
> URL: https://issues.apache.org/jira/browse/BEAM-7790
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-harness
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: Minor
>
> [ ] The output of the SDK workers is currently invisible due to the output 
> and logging setup.
> [ ] The dockerized version of the Python SDK worker sets up an HTTP server to 
> let the user view stack traces for all of the worker's threads [1]. It would 
> be useful if this was available for other execution modes as well.
> [x] BEAM-7676 Make the above items more usable with multiple subprocesses by 
> identifying them with worker ids.
>  
> [1] 
> [https://github.com/apache/beam/blob/9f4ce1c6fc2fb195e218783a6e9ce6104ddb4d1e/sdks/python/apache_beam/runners/worker/sdk_worker_main.py#L46-L89]



--
This message was sent by Atlassian Jira
(v8.3.2#803003)


[jira] [Updated] (BEAM-7790) Make debugging subprocess workers easier

2019-07-23 Thread JIRA


 [ 
https://issues.apache.org/jira/browse/BEAM-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ismaël Mejía updated BEAM-7790:
---
Status: Open  (was: Triage Needed)

> Make debugging subprocess workers easier
> 
>
> Key: BEAM-7790
> URL: https://issues.apache.org/jira/browse/BEAM-7790
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-harness
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: Minor
>
> 1. The output of the SDK workers is currently invisible due to the output and 
> logging setup.
> 2. The dockerized version of the Python SDK worker sets up an HTTP server to 
> let the user view stack traces for all of the worker's threads [1]. It would 
> be useful if this was available for other execution modes as well.
> 3. Make the above items more usable with multiple subprocesses by identifying 
> them with worker ids.
>  
> [1] 
> [https://github.com/apache/beam/blob/9f4ce1c6fc2fb195e218783a6e9ce6104ddb4d1e/sdks/python/apache_beam/runners/worker/sdk_worker_main.py#L46-L89]



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)


[jira] [Updated] (BEAM-7790) Make debugging subprocess workers easier

2019-07-20 Thread Kyle Weaver (JIRA)


 [ 
https://issues.apache.org/jira/browse/BEAM-7790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kyle Weaver updated BEAM-7790:
--
Description: 
1. The output of the SDK workers is currently invisible due to the output and 
logging setup.

2. The dockerized version of the Python SDK worker sets up an HTTP server to 
let the user view stack traces for all of the worker's threads [1]. It would be 
useful if this was available for other execution modes as well.

3. Make the above items more usable with multiple subprocesses by identifying 
them with worker ids.

 

[1] 
[https://github.com/apache/beam/blob/9f4ce1c6fc2fb195e218783a6e9ce6104ddb4d1e/sdks/python/apache_beam/runners/worker/sdk_worker_main.py#L46-L89]

  was:
1. The output of the SDK workers is currently invisible [1].

2. The dockerized version of the Python SDK worker sets up an HTTP server to 
let the user view stack traces for all of the worker's threads [2]. It would be 
useful if this was available for other execution modes as well.

3. Make the above items more usable with multiple subprocesses by identifying 
them with worker ids. 


> Make debugging subprocess workers easier
> 
>
> Key: BEAM-7790
> URL: https://issues.apache.org/jira/browse/BEAM-7790
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-py-harness
>Reporter: Kyle Weaver
>Assignee: Kyle Weaver
>Priority: Minor
>
> 1. The output of the SDK workers is currently invisible due to the output and 
> logging setup.
> 2. The dockerized version of the Python SDK worker sets up an HTTP server to 
> let the user view stack traces for all of the worker's threads [1]. It would 
> be useful if this was available for other execution modes as well.
> 3. Make the above items more usable with multiple subprocesses by identifying 
> them with worker ids.
>  
> [1] 
> [https://github.com/apache/beam/blob/9f4ce1c6fc2fb195e218783a6e9ce6104ddb4d1e/sdks/python/apache_beam/runners/worker/sdk_worker_main.py#L46-L89]



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)