Re: Flink Shaded dependencies and extending Flink APIs

Hi all thanks for the responses. > Create a module let's say "wikimedia-event-utilities-shaded" This actually doesn't help me, as wikimedia-event-utilities is used as an API by non Flink stuff too, so I don't want to use the shaded ObjectNode in the API params. > Another solution is that you can

Re: Flink Shaded dependencies and extending Flink APIs

Can we find a more robust way to support this? Both flink-shaded, any relocation pattern and JsonRowDataSerializationSchema are Flink internals that users shouldn't use/rely on. On 13/06/2022 12:26, Qingsheng Ren wrote: Hi Andrew, This is indeed a tricky case since Flink doesn't provide

Re: Flink Shaded dependencies and extending Flink APIs

Hi Andrew, This is indeed a tricky case since Flink doesn't provide non-shaded JAR for flink-json. One hacky solution in my mind is like: 1. Create a module let's say "wikimedia-event-utilities-shaded" that relocates Jackson in the same way and uses the same Jackson version as

Flink Shaded dependencies and extending Flink APIs

Hi all, I'm working on an integration project trying to write some library code that will allow us at the Wikimedia Foundation to use Flink with our 'Event Platform '. Specifically, I'm trying to write a reusable step near the end of a pipeline