Re: Structured Logging in python

2024-04-15 Thread Valentyn Tymofieiev via dev
Thanks! I opened https://github.com/apache/beam/issues/30978 . Feel free to
self-assign when you have time to work on it.

On Mon, Apr 15, 2024 at 1:43 PM Geddy Schellevis 
wrote:

> The “custom_data” field didn’t work.
> I am Happy with helping with the implementation of  this.
>
> Op ma 15 apr 2024 om 22:10 schreef Ahmet Altay via dev <
> dev@beam.apache.org>
>
>> Is there an open github issue for this? Perhaps it would be a good
>> project to implement in Python, using the java version as a
>> reference implementation?
>>
>> On Thu, Apr 11, 2024 at 12:04 PM Udi Meiri  wrote:
>>
>>> Hi,
>>>
>>> I believe this wasn't implemented for Python (only Java). You can try
>>> adding structured data (extra keyword) under the key "custom_data" and that
>>> might work.
>>>
>>> On 2024/04/11 17:49:43 Valentyn Tymofieiev wrote:
>>> > Thanks for reaching out. There was a proposal a while back:
>>> > https://s.apache.org/beam-structured-logging
>>> >
>>> > /cc: @u...@apache.org - do you know the current status?
>>> >
>>> > Thanks a lot!
>>> >
>>> > On Thu, Apr 11, 2024 at 8:29 AM Geddy Schellevis <
>>> geddyschelle...@gmail.com>
>>> > wrote:
>>> >
>>> > > Hi all,
>>> > >
>>> > > I would like to know if it is possible to have structured logging in
>>> > > Dataflow.
>>> > > In the attached file, you can find the code that I am trying to do.
>>> > >
>>> > > I see the logs are appearing in gcp log explorer, but I cannot see
>>> the
>>> > > extra fields.
>>> > >
>>> > > Best regards,
>>> > >
>>> >
>>>
>>


Re: Structured Logging in python

2024-04-15 Thread Geddy Schellevis
The “custom_data” field didn’t work.
I am Happy with helping with the implementation of  this.

Op ma 15 apr 2024 om 22:10 schreef Ahmet Altay via dev 

> Is there an open github issue for this? Perhaps it would be a good project
> to implement in Python, using the java version as a
> reference implementation?
>
> On Thu, Apr 11, 2024 at 12:04 PM Udi Meiri  wrote:
>
>> Hi,
>>
>> I believe this wasn't implemented for Python (only Java). You can try
>> adding structured data (extra keyword) under the key "custom_data" and that
>> might work.
>>
>> On 2024/04/11 17:49:43 Valentyn Tymofieiev wrote:
>> > Thanks for reaching out. There was a proposal a while back:
>> > https://s.apache.org/beam-structured-logging
>> >
>> > /cc: @u...@apache.org - do you know the current status?
>> >
>> > Thanks a lot!
>> >
>> > On Thu, Apr 11, 2024 at 8:29 AM Geddy Schellevis <
>> geddyschelle...@gmail.com>
>> > wrote:
>> >
>> > > Hi all,
>> > >
>> > > I would like to know if it is possible to have structured logging in
>> > > Dataflow.
>> > > In the attached file, you can find the code that I am trying to do.
>> > >
>> > > I see the logs are appearing in gcp log explorer, but I cannot see the
>> > > extra fields.
>> > >
>> > > Best regards,
>> > >
>> >
>>
>


Re: Structured Logging in python

2024-04-15 Thread Ahmet Altay via dev
Is there an open github issue for this? Perhaps it would be a good project
to implement in Python, using the java version as a
reference implementation?

On Thu, Apr 11, 2024 at 12:04 PM Udi Meiri  wrote:

> Hi,
>
> I believe this wasn't implemented for Python (only Java). You can try
> adding structured data (extra keyword) under the key "custom_data" and that
> might work.
>
> On 2024/04/11 17:49:43 Valentyn Tymofieiev wrote:
> > Thanks for reaching out. There was a proposal a while back:
> > https://s.apache.org/beam-structured-logging
> >
> > /cc: @u...@apache.org - do you know the current status?
> >
> > Thanks a lot!
> >
> > On Thu, Apr 11, 2024 at 8:29 AM Geddy Schellevis <
> geddyschelle...@gmail.com>
> > wrote:
> >
> > > Hi all,
> > >
> > > I would like to know if it is possible to have structured logging in
> > > Dataflow.
> > > In the attached file, you can find the code that I am trying to do.
> > >
> > > I see the logs are appearing in gcp log explorer, but I cannot see the
> > > extra fields.
> > >
> > > Best regards,
> > >
> >
>


Re: Structured Logging in python

2024-04-11 Thread Udi Meiri
Hi,

I believe this wasn't implemented for Python (only Java). You can try adding 
structured data (extra keyword) under the key "custom_data" and that might work.

On 2024/04/11 17:49:43 Valentyn Tymofieiev wrote:
> Thanks for reaching out. There was a proposal a while back:
> https://s.apache.org/beam-structured-logging
> 
> /cc: @u...@apache.org - do you know the current status?
> 
> Thanks a lot!
> 
> On Thu, Apr 11, 2024 at 8:29 AM Geddy Schellevis 
> wrote:
> 
> > Hi all,
> >
> > I would like to know if it is possible to have structured logging in
> > Dataflow.
> > In the attached file, you can find the code that I am trying to do.
> >
> > I see the logs are appearing in gcp log explorer, but I cannot see the
> > extra fields.
> >
> > Best regards,
> >
> 


Re: Structured Logging in python

2024-04-11 Thread Valentyn Tymofieiev
Thanks for reaching out. There was a proposal a while back:
https://s.apache.org/beam-structured-logging

/cc: @u...@apache.org - do you know the current status?

Thanks a lot!

On Thu, Apr 11, 2024 at 8:29 AM Geddy Schellevis 
wrote:

> Hi all,
>
> I would like to know if it is possible to have structured logging in
> Dataflow.
> In the attached file, you can find the code that I am trying to do.
>
> I see the logs are appearing in gcp log explorer, but I cannot see the
> extra fields.
>
> Best regards,
>