Hi everyone!!

I'm building a pipeline to store items from a Google PubSub subscription
into GCS buckets. In order to do it I'm using both stateful and timely
processing and after building and testing the project locally I tried to
run it on Google Dataflow and I started getting those errors.

The full stack trace is here: https://pastebin.com/LqecPhsq

The item I'm trying to serialize is a KV[String, MessageWithAttributes] and
MessageWithAttributes is a case class defined as (content: String, attrs:
Map[String, String])

The underlying clause is java.io.NotSerializableException:
com.spotify.scio.util.JMapWrapper$$anon$2 (yes, I'm using Spotify's Scio as
well) which may suggest that the issue is on serializing the Map, but to be
honest, I don't know what does it mean and how to fix it.

Can anyone help me, please?
Thanks!

Reply via email to