MyLanPangzi commented on pull request #14376: URL: https://github.com/apache/flink/pull/14376#issuecomment-963942917
@maosuhan hello,i am testing the format in production. source : kafka format: pb3 field count: 200+ nested: 1 qps: 40k/s partition: 200 parallelism: 100 sink: hive i found the consumer rate can't caught up. my log: spent: ms deserialize after : 1636447966334, spent: 0, count 97438 total spent 12322 deserialize after : 1636447966335, spent: 0, count 96905 total spent 12065 deserialize after : 1636447966341, spent: 0, count 99242 total spent 12850 deserialize after : 1636447966342, spent: 0, count 97439 total spent 12322 deserialize after : 1636447966344, spent: 0, count 96906 total spent 12065 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
