Hey everybody, I’ve created the following and would love some feedback. One
place where this could be of use would be to say hashing the key used as an
identifier for inserting into elasticsearch (which has a size limit) or
obfuscating sensitive values like say passwords or ssn.
and the
sample PR I’ve submitted.
Thanks!
-Brandon Brown
Just wanted to give another bump on this and see if anyone had any comments.
Thanks!
Brandon Brown
> On Oct 1, 2020, at 9:11 AM, "bran...@bbrownsound.com"
> wrote:
>
> Hey Kafka Developers,
>
> I’ve created the following KIP and updated it based on
Bumping this thread.
Please take a look at the KIP and vote or let me know if you have any feedback.
KIP:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-665%3A+Kafka+Connect+Hash+SMT
Proposed: https://github.com/apache/kafka/pull/9057
Thanks
Brandon Brown
> On Oct 8, 2020, at 10:30
ctions
> would be MD5, SHA1, SHA256. which are all supported via MessageDigest.
Given this take on things do you still think there would be value in this smt?
Brandon Brown
> On Oct 15, 2020, at 12:36 PM, Ning Zhang wrote:
>
> Hello, I think this SMT feature is parallel to
>
I like this proposal a lot! +1 by me.
Brandon Brown
> On Oct 15, 2020, at 11:12 AM, Mickael Maison wrote:
>
> Bumping this thread.
> Please take a look at the KIP and vote or let me know if you have any
> feedback.
> Thanks
>
>> On Thu, Sep 24, 2020 at 4:53 P
I love that idea, black is a really great formatter (opinionated with minimal
config).
Brandon Brown
> On Oct 9, 2020, at 5:55 AM, Nikolay Izhikov wrote:
>
> Hello!
>
> Kafka uses relatively strict code style for Java code.
> Code style enforces during project build.
>
I’d like to request permission to create a KIP. My username is brbrown35.
Thanks,
Brandon
Brandon Brown
(240) 506-8335 (m)
Thanks! I was able to make my first KIP.
-Brandon
Brandon Brown
(240) 506-8335 (m)
> On Aug 27, 2020, at 4:19 PM, Jun Rao wrote:
>
> Hi, Brandon,
>
> Thanks for your interest. Just gave you the wiki permission.
>
> Jun
>
>> On Thu, Aug 27, 2020 at 1
be supported as well?
Thanks,
Brandon Brown
> On Sep 18, 2020, at 12:00 PM, Mickael Maison wrote:
>
> Thanks Brandon for the KIP.
>
> There's already a built-in transformation (MaskField) that can
> obfuscate fields. In the motivation section, it would be nice to
> expla
and letting it be configured with the
exact name. What do you think Mickael?
Brandon Brown
> On Sep 21, 2020, at 3:42 AM, Tom Bentley wrote:
>
> Hi Brandon and Mickael,
>
> Is it necessary to fix the supported digest? We could just support whatever
> the JVM's MessageDigest s
Gonna give this another little bump. :)
Brandon Brown
> On Oct 15, 2020, at 12:51 PM, Brandon Brown wrote:
>
>
> As I mentioned in the KIP, this transformer is slightly different from the
> current MaskField SMT.
>
>> Currently there exists a MaskField SMT but that
I like option 2.
Brandon Brown
> On Oct 15, 2020, at 1:36 AM, Dongjin Lee wrote:
>
> Hello. I hope to open a discussion about the import order in Java code.
>
> As Nikolay stated recently[^1], Kafka uses a relatively strict code style
> for Java code. However, it misses
+1 (non binding)
Brandon Brown
> On Oct 22, 2020, at 5:03 AM, Mickael Maison wrote:
>
> +1 (binding)
> Thanks
>
>> On Sun, Oct 11, 2020 at 8:09 AM Dongjin Lee wrote:
>>
>> Binding: 2 (John, Gwen)
>> Non-binding: 1 (Dongjin)
>>
>> We ne
I’ve update the KIP with suggestions from Gunnar. I’d like to bring this up for
a vote.
Brandon Brown
> On Oct 22, 2020, at 12:53 PM, Brandon Brown wrote:
>
> Hey Gunnar,
>
> Those are great questions!
>
> 1) I went with it only selecting top level fields since
and the serialized form that is written to Kafka. This controls the format of
the values in messages written to or read from Kafka, and since this is
independent of connectors it allows any connector to work with any
serialization format. Examples of common formats include JSON and Avro.
Brandon Brown
I’d like to give this one another friendly bump. If there are no disagreements
I can update my existing Pr with the latest KIP changes.
Thanks,
-Brandon
Brandon Brown
> On Oct 26, 2020, at 8:29 PM, Brandon Brown wrote:
>
> I’ve update the KIP with suggestions from Gunnar. I’d like
Brandon Brown
> On Nov 7, 2020, at 11:11 AM, Joshua Grisham wrote:
>
> Hello everyone!
> (Thanks to Tom Bentley for directing me in this direction!)
>
> I have made a series of changes to some of the standard Connect transforms
> to meet some of the challenges at my compan
be a valid option
as well.
I think I’ll update the KIP to reflect those suggestions. One more, do you
think this should allow a regex for fields or stick with the explicit naming of
the fields?
Thanks for the great feedback
Brandon Brown
> On Oct 22, 2020, at 12:40 PM, Gunnar Morling
>
Thanks!
Brandon Brown
> On Jan 5, 2021, at 6:07 PM, Justine Olshan wrote:
>
> The user has been blocked. https://issues.apache.org/jira/browse/INFRA-21268
>
>> On Tue, Jan 5, 2021 at 2:52 PM Brandon Brown
>> wrote:
>>
>> Is there any way to block Tim
Is there any way to block Tim van der Kooi from making issues? I’m getting
about 10 new email issues created a minute.
Brandon Brown
I agree, if the desire is to keep the internal SMTs collection small then
providing an ease of discovery like Gunnar suggestions would be extremely
helpful.
Brandon Brown
> On Nov 19, 2021, at 6:13 PM, Gunnar Morling
> wrote:
>
> Hi all,
>
> Just came across this threa
express the interest of
additional SMTs which maybe are available via an open source library and if
enough usage occurs there could be a path to fold into the Kafka project at
large?
Brandon Brown
> On Nov 7, 2021, at 1:19 PM, Randall Hauch wrote:
>
> We have had several reques
Brandon Brown created KAFKA-10299:
-
Summary: Add a Hash SMT transformer
Key: KAFKA-10299
URL: https://issues.apache.org/jira/browse/KAFKA-10299
Project: Kafka
Issue Type: New Feature
24 matches
Mail list logo
