2020-09-08 13:33:45 UTC - Korben: Hi guys I'm playing with flink connector. One of the topic includes multiple events of different types. UserCreated, UserNameChanges ... Is there something similar to AUTO_CONSUME schema to consume multiple event types using PulsarFlinkSource? I found JsonDeser and AvroDeser only where I need to specify real type. Thanks ---- 2020-09-08 14:04:27 UTC - Anjaiah: @Anjaiah has joined the channel ---- 2020-09-08 15:17:55 UTC - Addison Higham: I assume you are talking about this flink connector? <https://github.com/streamnative/pulsar-flink> ---- 2020-09-08 15:52:10 UTC - Korben: Correct ---- 2020-09-08 16:22:12 UTC - Addison Higham: @Korben i *believe* if you use this class <https://github.com/streamnative/pulsar-flink/blob/ced55cf0f0e04e2f7e2b2c0853f796f540873b6b/pulsar-flink-1.11/src/main/java/org/apache/flink/streaming/connectors/pulsar/internal/AvroDeser.java> with a `org.apache.pulsar.client.api.schema.GenericRecord` it will produce a `GenericRecord` ---- 2020-09-08 16:22:53 UTC - Addison Higham: your other option would be to use this class: <https://github.com/streamnative/pulsar-flink/blob/ced55cf0f0e04e2f7e2b2c0853f796f540873b6b/pulsar-flink-1.11/src/main/java/org/apache/flink/streaming/connectors/pulsar/internal/PulsarDeserializer.java> which will convert the record into a flink "row" object ---- 2020-09-08 19:18:09 UTC - C S Thomas: @C S Thomas has joined the channel ---- 2020-09-09 00:33:22 UTC - Jim Martin: @Jim Martin has joined the channel ---- 2020-09-09 03:53:45 UTC - Luke Stephenson: I'm trying to run log compaction externally to the brokers (ie by running <https://github.com/apache/pulsar/blob/master/pulsar-broker/src/main/java/org/apache/pulsar/compaction/CompactorTool.java|CompactorTool> ). logs indicate that if discovered bookies / brokers. I'm seeing (a subset of logs): ```[[id: 0x490dcb08, L:/192.168.178.171:51628 - R:pulsar-broker-7.pulsar-broker.pulsar.svc.cluster.local/192.168.144.140:6650]] Connected to server [<persistent://goanna/collections/tickets-36106-partition-0>][__compaction] Successfully getLastMessageId 366031:37372``` But then the logs show the following: ```[id: 0x490dcb08, L:/192.168.178.171:51628 - R:pulsar-broker-7.pulsar-broker.pulsar.svc.cluster.local/192.168.144.140:6650] Received error from server: Failed to get batch size for entry org.apache.bookkeeper.mledger.ManagedLedgerException: Unknown exception [id: 0x490dcb08, L:/192.168.178.171:51628 - R:pulsar-broker-7.pulsar-broker.pulsar.svc.cluster.local/192.168.144.140:6650] Received unknown request id from server: 6``` Unfortunately I can't see a way to find more information about this "Unknown exception". It appears the code just discards the original exception and we lose all details <https://github.com/apache/pulsar/blob/8933d8ddffe649e3e45458005fae5a5c6a3de47a/managed-ledger/src/main/java/org/apache/bookkeeper/mledger/impl/ManagedLedgerImpl.java#L3173>. ---- 2020-09-09 08:04:17 UTC - xue: use pulsar io redis sink，show "Failed to parse config file"，sink-config-file like this ---- 2020-09-09 08:18:44 UTC - Korben: Thanks ----
