code page conversion

2020-01-14 Thread סמדג'ה גיא
Hi all I have a code page conversion issue I have a flow that reads records from mongoDB and inserts the result into oracle The mongo encoding is utf-8 , and the oracle is iso8859-8 Some special characters are not shown correctly in oracle – shows ??? I tried using the convertcharacterset function

Re: DistributedMapCacheService - automated creation

2020-01-14 Thread Mike Thomsen
What is your use case? Because this sounds vaguely like something that you could implement implicitly with the HBase version by just creating one big cache table with an eye for not overlapping column qualifiers and possibly liberal use of HBase TTLs. On Tue, Jan 14, 2020 at 6:04 PM William Gosse

DistributedMapCacheService - automated creation

2020-01-14 Thread William Gosse
Is there any way to automate the creation of a DistributedMapCacheService I was hoping I could do this via a template but it doesn’t to get exported the way the DistributedMapCacheClientService does. The client got created just fine but there’s no service. I don’t see away to do this with

Re: Nifi - DistributedMapCacheService - how many items is considered big

2020-01-14 Thread Mike Thomsen
You can also use the Redis map cache implementation here as well. On Tue, Jan 14, 2020 at 4:51 PM Christopher J. Amatulli < camatu...@technicallycreative.com> wrote: > I think you answered my question. The DistributedMapCacheServer that comes > with Nifi utilizes memory, as such, memory will be

RE: Nifi - DistributedMapCacheService - how many items is considered big

2020-01-14 Thread Christopher J. Amatulli
I think you answered my question. The DistributedMapCacheServer that comes with Nifi utilizes memory, as such, memory will be the constraint. If all I store in the map cache is a key + a small avro/json with 4 columns, I could probably fit millions without a problem. I am going to play a

Re: Nifi - DistributedMapCacheService - how many items is considered big

2020-01-14 Thread Shawn Weeks
If your using an external one like HBase I wouldn’t expect there to be any issue assuming it had enough space. However if you are using the built in one aka DistributedMapCacheServer then all the values need to fit in memory. One thing I see an issue with is there isn’t a bulk way to get data

Nifi - DistributedMapCacheService - how many items is considered big

2020-01-14 Thread Christopher J. Amatulli
How many items within a distributed map cache service would be considered excessive? I have a situation where I was considering dropping in around 200 million, but I was thinking where the limitation (wall or performance hit) exists within the service. I was thinking about using the cache