Re: Structured Logging in python
Thanks! I opened https://github.com/apache/beam/issues/30978 . Feel free to self-assign when you have time to work on it. On Mon, Apr 15, 2024 at 1:43 PM Geddy Schellevis wrote: > The “custom_data” field didn’t work. > I am Happy with helping with the implementation of this. > > Op ma 15 apr 2024 om 22:10 schreef Ahmet Altay via dev < > dev@beam.apache.org> > >> Is there an open github issue for this? Perhaps it would be a good >> project to implement in Python, using the java version as a >> reference implementation? >> >> On Thu, Apr 11, 2024 at 12:04 PM Udi Meiri wrote: >> >>> Hi, >>> >>> I believe this wasn't implemented for Python (only Java). You can try >>> adding structured data (extra keyword) under the key "custom_data" and that >>> might work. >>> >>> On 2024/04/11 17:49:43 Valentyn Tymofieiev wrote: >>> > Thanks for reaching out. There was a proposal a while back: >>> > https://s.apache.org/beam-structured-logging >>> > >>> > /cc: @u...@apache.org - do you know the current status? >>> > >>> > Thanks a lot! >>> > >>> > On Thu, Apr 11, 2024 at 8:29 AM Geddy Schellevis < >>> geddyschelle...@gmail.com> >>> > wrote: >>> > >>> > > Hi all, >>> > > >>> > > I would like to know if it is possible to have structured logging in >>> > > Dataflow. >>> > > In the attached file, you can find the code that I am trying to do. >>> > > >>> > > I see the logs are appearing in gcp log explorer, but I cannot see >>> the >>> > > extra fields. >>> > > >>> > > Best regards, >>> > > >>> > >>> >>
Re: Structured Logging in python
The “custom_data” field didn’t work. I am Happy with helping with the implementation of this. Op ma 15 apr 2024 om 22:10 schreef Ahmet Altay via dev > Is there an open github issue for this? Perhaps it would be a good project > to implement in Python, using the java version as a > reference implementation? > > On Thu, Apr 11, 2024 at 12:04 PM Udi Meiri wrote: > >> Hi, >> >> I believe this wasn't implemented for Python (only Java). You can try >> adding structured data (extra keyword) under the key "custom_data" and that >> might work. >> >> On 2024/04/11 17:49:43 Valentyn Tymofieiev wrote: >> > Thanks for reaching out. There was a proposal a while back: >> > https://s.apache.org/beam-structured-logging >> > >> > /cc: @u...@apache.org - do you know the current status? >> > >> > Thanks a lot! >> > >> > On Thu, Apr 11, 2024 at 8:29 AM Geddy Schellevis < >> geddyschelle...@gmail.com> >> > wrote: >> > >> > > Hi all, >> > > >> > > I would like to know if it is possible to have structured logging in >> > > Dataflow. >> > > In the attached file, you can find the code that I am trying to do. >> > > >> > > I see the logs are appearing in gcp log explorer, but I cannot see the >> > > extra fields. >> > > >> > > Best regards, >> > > >> > >> >
Re: Structured Logging in python
Is there an open github issue for this? Perhaps it would be a good project to implement in Python, using the java version as a reference implementation? On Thu, Apr 11, 2024 at 12:04 PM Udi Meiri wrote: > Hi, > > I believe this wasn't implemented for Python (only Java). You can try > adding structured data (extra keyword) under the key "custom_data" and that > might work. > > On 2024/04/11 17:49:43 Valentyn Tymofieiev wrote: > > Thanks for reaching out. There was a proposal a while back: > > https://s.apache.org/beam-structured-logging > > > > /cc: @u...@apache.org - do you know the current status? > > > > Thanks a lot! > > > > On Thu, Apr 11, 2024 at 8:29 AM Geddy Schellevis < > geddyschelle...@gmail.com> > > wrote: > > > > > Hi all, > > > > > > I would like to know if it is possible to have structured logging in > > > Dataflow. > > > In the attached file, you can find the code that I am trying to do. > > > > > > I see the logs are appearing in gcp log explorer, but I cannot see the > > > extra fields. > > > > > > Best regards, > > > > > >
Re: Structured Logging in python
Hi, I believe this wasn't implemented for Python (only Java). You can try adding structured data (extra keyword) under the key "custom_data" and that might work. On 2024/04/11 17:49:43 Valentyn Tymofieiev wrote: > Thanks for reaching out. There was a proposal a while back: > https://s.apache.org/beam-structured-logging > > /cc: @u...@apache.org - do you know the current status? > > Thanks a lot! > > On Thu, Apr 11, 2024 at 8:29 AM Geddy Schellevis > wrote: > > > Hi all, > > > > I would like to know if it is possible to have structured logging in > > Dataflow. > > In the attached file, you can find the code that I am trying to do. > > > > I see the logs are appearing in gcp log explorer, but I cannot see the > > extra fields. > > > > Best regards, > > >
Re: Structured Logging in python
Thanks for reaching out. There was a proposal a while back: https://s.apache.org/beam-structured-logging /cc: @u...@apache.org - do you know the current status? Thanks a lot! On Thu, Apr 11, 2024 at 8:29 AM Geddy Schellevis wrote: > Hi all, > > I would like to know if it is possible to have structured logging in > Dataflow. > In the attached file, you can find the code that I am trying to do. > > I see the logs are appearing in gcp log explorer, but I cannot see the > extra fields. > > Best regards, >