[
https://issues.apache.org/jira/browse/RANGER-4384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bhavik Patel updated RANGER-4384:
---------------------------------
Description:
ORC audit for hdfs destination is too slow when we generate 60GB audit in a day
and audits are not being able to written from spool directories to HDFS due to
slowness.
Below Configurations are set on the test cluster:
orc.buffersize=10mb
orc.stripesize=10mb
filespool.buffer.size=10k
file.rollover.sec=1day
xasecure.audit.provider.queue.size=1mb default
CC: [~rmani] [~fateh288]
was:
ORC audit for hdfs destination is too slow when we generate 60GB audit in a day
and due to slowness it started writing to spool directory. Even audits are not
able flush from spool directories to HDFS due to slowness.
Below Configurations are set on the test cluster:
orc.buffersize=10mb
orc.stripesize=10mb
filespool.buffer.size=10k
file.rollover.sec=1day
xasecure.audit.provider.queue.size=1mb default
CC: [~rmani] [~fateh288]
> ORC audit for hdfs destination is too slow
> ------------------------------------------
>
> Key: RANGER-4384
> URL: https://issues.apache.org/jira/browse/RANGER-4384
> Project: Ranger
> Issue Type: Bug
> Components: Ranger
> Affects Versions: 2.3.0, 2.4.0
> Reporter: Bhavik Patel
> Priority: Major
>
> ORC audit for hdfs destination is too slow when we generate 60GB audit in a
> day and audits are not being able to written from spool directories to HDFS
> due to slowness.
> Below Configurations are set on the test cluster:
> orc.buffersize=10mb
> orc.stripesize=10mb
> filespool.buffer.size=10k
> file.rollover.sec=1day
> xasecure.audit.provider.queue.size=1mb default
>
> CC: [~rmani] [~fateh288]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
