Usnig CaptureChangeMySQL do parse binlog, then do some transformation and finally put the result to another database. And at the same time put binlog msg to Message Queue. Some controller services are used, HortonworksSchemaRegistry, DistributedMapCacheServer, JSONTreeReader，JSONTreeWriter, etc Two nodes as nifi server, each 16c, 32G
When we do the pressure test, the memory usage is very high and offten the primary node is switched. Maximjm Timer Driver Thread Count is set to 2000 for high throughput The input QPS from CaptureChangeMySQL is about 2000/s Any suggesions on how to optimize the memory usage of NiFi? Thanks, Lei [email protected]
