Re: Content Repository Performance

2022-10-05 Thread Joe Obernberger

Hi - these are three Amazon EC2 instances, 16 cores and 124G of RAM.

-Joe

On 10/5/2022 9:31 AM, Mark Payne wrote:

Joe,

What kind of hardware are you running on?

Thanks
Mark

Sent from my iPhone


On Oct 5, 2022, at 9:23 AM, Joe Obernberger  
wrote:

Hi all - I'm using NiFi 1.16.3 in a 3 node cluster with content repository 
settings:

# Content Repository
nifi.content.repository.implementation=org.apache.nifi.controller.repository.FileSystemRepository
nifi.content.claim.max.appendable.size=50 KB
nifi.content.repository.directory.default=./content_repository
nifi.content.repository.archive.max.retention.period=2 days
nifi.content.repository.archive.max.usage.percentage=50%
nifi.content.repository.archive.enabled=false
nifi.content.repository.always.sync=false
nifi.content.viewer.url=../nifi-content-viewer/

All 3 nodes are pegging the disk where the content repository is stored.  Each 
directory (on each node) is about 8GBytes, but I'm having poor performance 
because nifi is pummeling the disk.  What can I check / change to help?  The 
disk is only for NiFi.
Thank you!

-Joe


--
This email has been checked for viruses by AVG antivirus software.
www.avg.com


Re: Content Repository Performance

2022-10-05 Thread Mark Payne
Joe,

What kind of hardware are you running on?

Thanks
Mark

Sent from my iPhone

> On Oct 5, 2022, at 9:23 AM, Joe Obernberger  
> wrote:
> 
> Hi all - I'm using NiFi 1.16.3 in a 3 node cluster with content repository 
> settings:
> 
> # Content Repository
> nifi.content.repository.implementation=org.apache.nifi.controller.repository.FileSystemRepository
> nifi.content.claim.max.appendable.size=50 KB
> nifi.content.repository.directory.default=./content_repository
> nifi.content.repository.archive.max.retention.period=2 days
> nifi.content.repository.archive.max.usage.percentage=50%
> nifi.content.repository.archive.enabled=false
> nifi.content.repository.always.sync=false
> nifi.content.viewer.url=../nifi-content-viewer/
> 
> All 3 nodes are pegging the disk where the content repository is stored.  
> Each directory (on each node) is about 8GBytes, but I'm having poor 
> performance because nifi is pummeling the disk.  What can I check / change to 
> help?  The disk is only for NiFi.
> Thank you!
> 
> -Joe
> 
> 
> -- 
> This email has been checked for viruses by AVG antivirus software.
> www.avg.com


Content Repository Performance

2022-10-05 Thread Joe Obernberger
Hi all - I'm using NiFi 1.16.3 in a 3 node cluster with content 
repository settings:


# Content Repository
nifi.content.repository.implementation=org.apache.nifi.controller.repository.FileSystemRepository
nifi.content.claim.max.appendable.size=50 KB
nifi.content.repository.directory.default=./content_repository
nifi.content.repository.archive.max.retention.period=2 days
nifi.content.repository.archive.max.usage.percentage=50%
nifi.content.repository.archive.enabled=false
nifi.content.repository.always.sync=false
nifi.content.viewer.url=../nifi-content-viewer/

All 3 nodes are pegging the disk where the content repository is 
stored.  Each directory (on each node) is about 8GBytes, but I'm having 
poor performance because nifi is pummeling the disk.  What can I check / 
change to help?  The disk is only for NiFi.

Thank you!

-Joe


--
This email has been checked for viruses by AVG antivirus software.
www.avg.com