Re: Using threads inside Geode Functions

Yeah,  that's totally fine. The one thing you I think you probably shouldn't do is send results with the ResultSender after your function ends. So if you are launching threads that send results your function should wait for those threads to finish.  Dan Original message From:

Re: GeodeRedisAdapter improvments/feedback

I also had a hard time reading this. It sounds like the tl;dr is that your are proposing storing each redis collection in a single region entry, rather than a a partition region? I guess the question is whether users will have a few very large collections that need to be partitioned, or lots and

Re: OutOfMemoryError with cq listener

The error says "unable to create a new native thread." Do you know how many threads you had in this process when it died? The client stats could show the you the number of threads at least. You might also have an hs_err_pid file that might list the threads. -Dan On Thu, Feb 9, 2017 at 9:23 AM,

Re: Quesntion about Geode functions

Hi Amit, You can target a particular stock or stocks by using the filter arguments of a function. For example FunctionService.onRegion( myRegion).withFilter(myStock).execute(...). Your function will then be sent to the node or nodes that have that particular stock. If you pass more than one

Re: Problem reported on Twitter about downloads

Most likely. I do see that on dist.apache.org, our releases have moved from https://dist.apache.org/repos/dist/release/incubator/geode/1.0.0-incubating/ to https://dist.apache.org/repos/dist/release/geode/ However, i don't see geode in that new location on any of the mirrors. -Dan On Fri,

Re: OQL on nested collections

HI Dharam, I think the way you would do such a query in OQL is something like this (I based this on the section on querying nested collections on this page ): SELECT book FROM /jsonRegion store, store.book book

Re: [VOTE] Marking Redis Adapter as Experimental

+1 for marking it experimental and going ahead with changing it. -Dan On Wed, Mar 8, 2017 at 2:21 PM, Michael Stolz wrote: > +1 to marking it experimental now > > Once we do that I think it will be fine for the community to make breaking > changes to it if we need to. > > --

Re: Global Aliases/CommonName in Diskstore config

Hi Dharam, I'm not quite sure I understand what you are asking for. Are you asking for the ability to configure the location of the disk store using an alias? You can put variables in your cache.xml file - see

Re: Global Aliases/CommonName in Diskstore config

dr machine. > > Do you suggest any way for that? > > Regards, > Dharam > > > > Sent with BlackBerry Work (www.blackberry.com) > -- > *From: *Dan Smith <dsm...@pivotal.io> > *Sent: *Jul 25, 2017 01:30 > *To: *user@geode.apache.org > *Subject: *

Re: gateway sender encryption

Hi Nan, You can configure your gateway senders and receivers to use SSL. This page has some description of the properties you need to set to configure SSL for gateways: https://geode.apache.org/docs/guide/12/managing/security/implementing_ssl.html -Dan On Tue, Sep 19, 2017 at 11:20 AM, Xu, Nan

Re: Inserts from multiple threads

Hi Amit, Are you trying to the minimize the elapsed time for this single function call, or the overall performance of the system? Probably having 10 threads doing the putAlls in parallel would end up taking less time, unless your system is saturated enough that the extra thread contention starts

Re: Spring Data Geode Gemfire function batch size

Hi Amit, Looking at the code, it looks like if your annotated method returns an array, or an Iteratable (like a List), and you have batchSize set, then spring will send your data in batches back to the caller of the function. Underneath the covers is it using geode's ResultSender and passing the

Re: ServerRefusedConnectionException

Does the error go away after a period of time from the client? I think the client has some functionality to blacklist servers that it can't connect to for one ping interval (10 seconds). -Dan On Wed, Dec 13, 2017 at 1:21 AM, Rupert St John Webster < rup...@impress-solutions.com> wrote: > Are

Re: Audit Logging in Gemfire Server

It's not the easiest solution, but you could have your clients do all of their operations by invoking a geode Function on the server. That function could do your audit logging and then delegate to the the actual operation you want to do - put/get/destroy/etc. If you use

Re: Regarding storing documents in Apache Geode

Do you want to extract and query metadata in your documents, or are you just trying to store them some where? As John pointed out, if you are just trying to store them you can just to a region.put(document_name, document_bytes) to store your document in geode. The geode-examples

Re: Garbage Collection (gc command)

Hi Sudhir, The JVM does garbage collection automatically. There is really no need to use the 'gc' command. If you start your servers with gfsh, we default to using using ConcMarkSweepGC with the below configuration options. The CMSInitiatingOccupancyFraction setting means that GC automatically

Re: Function Executor thread stacked

Hi Vahram, Well, it's definitely getting corrupted on reading the function arguments based on your version. I'm still suspicious that it has something to do with the arguments you are passing in. Maybe you can share the code for your argument class? One way to narrow down the problem might be to

Re: client notification & message ack

Hi Oliver, The server won't get an acknowledgement for your event until after your cache listener completes. After the cache listener calls completes, geode adds information about the message to a collection of processed messages. Periodically it sends that collection to the server. The

Re: Function Executor thread stacked

I've seen something like this happen before when there is code that is concurrently modifying data that is being serialized. What version of geode are you using? The line number in FunctionRemoteContext.fromData should tell us which of your objects is failing to be deserialized. For example if you

Re: Region /PdxTypes

Hi Sudhir, Are you getting a ConflictingPersistentDataException, like is shown in the link you sent? Generally that is caused by creating to completely different copies of a region, using the method Barry described. The other cause might be revoking members than then trying to bring them back

Re: [PROPOSAL]: Create region with the same name on different groups in gfsh should fail early

Won't this break any use case were two members need to create the same region with different attributes? For example someone might have some members that are empty accessors of a replicated region: //Host data on members in group1 gfsh> create region --name=A --type=REPLICATE --group=group1

Re: Geode wiki edit permission

Hi Barbara, You should now have access. Thanks, -Dan On Tue, Feb 13, 2018 at 11:11 AM, Barbara Pruijn wrote: > Hi, > > Can someone please give me edit permission on the Geode wiki page? > Userid: bpruijn > > Thanks, > Barbara >

Re: Password encrypt/decrypt

Hi Sudhir, You can do pretty much anything you want by implementing your own AuthInitialize on the client. The AuthInitialize generates the credentials to send to the server. So for example you could implement an AuthInitialize that reads and encrypted password, decrypts it, and sends it to the

Re: Password encrypt/decrypt

work. > > On Tue, Dec 26, 2017 at 8:23 PM, Dan Smith <dsm...@pivotal.io> wrote: > >> Hi Sudhir, >> >> There are no built in user names. There is the SimpleSecurityManager Jens >> mentioned, but that should *only* be used for testing because it doesn't >&g

Re: Password encrypt/decrypt

; 2017-12-27 5:04 GMT+09:00 Sudhir Babu Pothineni <sbpothin...@gmail.com>: > >> Thanks Dan. >> >> Yes I am aware it’s not so secure, I am just trying to meet the company >> policy of not directly hardcode the password in a file, encrypted password >> will be ok :). I wi

Re: Password encrypt/decrypt

SPScpj2J50ErtzR9ANSzv3kl> > > > 2017-12-27 5:04 GMT+09:00 Sudhir Babu Pothineni <sbpothin...@gmail.com>: > >> Thanks Dan. >> >> Yes I am aware it’s not so secure, I am just trying to meet the company >> policy of not directly hardcode the password in a

Re: [Proposal] Windows CI integration to 'develop' pipeline.

+1 for in parallel. -Dan On Wed, Aug 8, 2018 at 11:37 AM, Jacob Barrett wrote: > Parallel > > > On Aug 8, 2018, at 11:32 AM, Sai Boorlagadda > wrote: > > > > All, > > > > We would like to add windows jobs (UnitTests, Integration, Acceptance, > and GfshDistributedTests) to the 'develop'

Re: C++ Geode example

Your other option is to use the REST API from C++. See https://geode.apache.org/docs/guide/latest/rest_apps/rest_api_reference.html. -Dan On Fri, Jan 19, 2018 at 9:47 PM, Jacob Barrett wrote: > There are currently no examples for the latest revisions of the C++ client. >

Re: geode server network request is very slow!

Charlie is spot on. Look at your ping times. Each get is a network round trip (just like a ping!). So if you can do one network round trip in 0.2 milliseconds, your should expect to be able to do so 5000 round trips a second. 1 / 0.2 ms/ping = 5 pings/ms = 5000 pings/second. -Dan On Mon, Mar 26,

Re: Lock files with Async event queue

I believe those files are showing up because the async event queue is designed to overflow to disk if it is low on memory. It uses a disk store, which creates those files to show the disk store is in use by a process. You should be able to control where these files end up by setting the

Re: New Geode PMC Chair: Karen Miller

Congratulations Karen! And thanks for all of your hard work, Mark! -Dan On Mon, Nov 26, 2018 at 11:56 AM Mark Bretl wrote: > Hello Geode Community, > > After two years, the Project Management Committee (PMC) agreed to > transition the role of PMC chair from me to another PMC member. I would >

Re: IllegalStateException: Unknown PDX Type on Client Side

Yes, your PDX metadata is stored in a disk store if you have persistence enabled fro PDX. The default disk store files are stored in the working directory of each server, with names like .crf, .drf, .if. So if you moved those files, you potentially moved all of the PDX metadata, and that explain

Re: Stucked thread after network outage

That's interesting. I agree we should be setting a read timeout during the ping so if that thread is stuck it seems like something is wrong with setting the read timeout. Would you mind sharing your pool configuration? -Dan On Thu, Apr 11, 2019 at 11:52 AM Vahram Aharonyan wrote: > > > One

Re: access to raise jira issue

Great, you should have access now. Thanks! -Dan On Fri, Jun 14, 2019 at 1:29 PM aashish choudhary < aashish.choudha...@gmail.com> wrote: > Thanks Dan. Username achoudhary > With Best Regards, > Ashish > > > On Sat, Jun 15, 2019 at 1:53 AM Dan Smith wrote: >

Re: permission to work on jira

Hi Geet, You should have access now! You might also want to consider joining the geode dev list - dev-subscr...@geode.apache.org. Thanks, -Dan On Fri, May 10, 2019 at 2:09 PM Geetanjali rawat wrote: > Hello Devs > > I would like to request for the permission for working on Geode Jira. > my

Re: Alter region attribute enable-statistics

Hi Jerry, Yes, unfortunately you can't enable statistics after your region is already created. Your best option is to recreate the region an migrate your data. You can use the export/import commands to move data from the old region to the new region. -Dan On Wed, Jul 10, 2019 at 12:25 AM

Re: SIGKILL VS SIGTERM VS SIGABRT

+1 to getting a thread dump and using sigterm. That said, geode is designed to handle processes crashing, so sigkill shouldn't hurt anything if you have redundancy. -Dan On Wed, Aug 14, 2019, 8:56 AM Charlie Black wrote: > The thread dump is key - typically what I have found is there are user

Re: Unknown pdx error

It does seem like maybe this should be the default. Although I think right now the way that it detects that it needs to clear the PDX types could be improved - I think it just looks to see if the client is no longer connected to any servers. Really, we should be detecting whether the servers have

Re: Geode function avoid multiple service call

Hi Ashish, How are you executing your function? If you execute a function from the client with Function.onServer, it should only be executed on a single running server. -Dan

Re: Geode function avoid multiple service call

node is down? >> >> With best regards, >> Ashish >> >> On Mon, Sep 16, 2019, 9:59 PM Dan Smith wrote: >> >>> Hi Ashish, >>> >>> How are you executing your function? If you execute a function from the >>> client with Function.onServer, it should only be executed on a single >>> running server. >>> >>> -Dan >>> >>

Re: region name is incorrect while trying to get using region.get

Huh, that's weird. Is it possible that somewhere in your code you are calling createSubregion on the returned authIdCacheRegionInstance? The syntax /AuthIdRegion/AuthIdRegion indicates a region named AuthIdRegion with a subregion also named AuthIdRegion. -Dan On Mon, Dec 2, 2019 at 8:04 PM

Re: region name is incorrect while trying to get using region.get

message should be more insightful. Please > include the full stack trace and error message along with how you > configured the Region on the server. > > -j > > > > On Tue, Dec 3, 2019 at 9:53 AM Dan Smith wrote: > >> Huh, that's weird. Is it possible that somewhe

Re: region name is incorrect while trying to get using region.get

> sometimes randomly while trying to get details from a region Rereading this - I suspect maybe *some* of your servers don't have the region? That might explain why sometimes it works and sometimes it doesn't. -Dan On Tue, Dec 3, 2019 at 11:36 AM Udo Kohlmeyer wrote: > Try 3? > On 12/3/19

Re: Function execute method thread safety

I think what the javadocs are getting at is that the same function object may have the execute method invoked concurrently by many threads. The best way to make the function thread safe is to make it stateless or immutable, so that it doesn't matter how many threads are accessing the function. If

Re: Executing LuceneQueries in Geode

teFunction(ServerRegionFunctionExecutor.java:154) >>>>> at >>>>> org.apache.geode.internal.cache.execute.ServerRegionFunctionExecutor.execute(ServerRegionFunctionExecutor.java:379) >>>>> at >>>>> org.apache.geode.cache.lucene.internal.Lucene

Re: Executing LuceneQueries in Geode

gt;>> at >>> org.apache.geode.internal.util.BlobHelper.deserializeBlob(BlobHelper.java:99) >>> at >>> org.apache.geode.internal.cache.tier.sockets.CacheServerHelper.deserialize(CacheServerHelper.java:73) >>> at >>> o

Re: Executing LuceneQueries in Geode

I think you could probably use a BooleanQuery to do this. Something like this, although I haven't tested it. Your LuceneQuery1 just results in a call to StandardQueryParser.parse, so you can combine that with your spatial query: LuceneQuery luceneQuery2 = luceneService

Re: [DISCUSS] RFC: How management rest API GET request deals with entities in multiple groups

+1 to the proposal. As Charlie said, groups are a core geode concept. But I think it's reasonable for this "GET /management/v1/regions/" rest include list of all the different group configurations for that region. Looks good! BTW - maybe send the RFC to the dev@geode list? -Dan On Wed, Mar 11,

Re: Error while executing dynamic Lucene query

Your custom query code does need to be on the server in order for this to work. Specifically, this lambda is your LuceneQueryProvider, which needs to be serializable in some way (Serializable, DataSerializable, etc.) and the code need to be on the server: index -> {

Re: Data ingestion with predefined buckets

Hi Steve, The bucket that data goes into is generally determined by the key. So for example if your data in File-0 is all for customer X, you can include Customer X in your region key and implement a PartitionResolver that extracts the customer from your region key and returns it. Geode will then

Re: Data ingestion with predefined buckets

uckets made fix .. thoughts? > > > -Steave M. > > > On Sat, Apr 11, 2020, 1:54 AM Dan Smith wrote: > > > Hi Steve, > > > > The bucket that data goes into is generally determined by the key. So for > > example if your data in File-0 is all for cus

Re: Difference in behavior when enabling max-threads parameter

Hi Jakov, I'm assuming you are talking about the max-threads setting on the cache server. When you set max-threads, it is limiting the number of threads used for processing requests from clients. Normally, the number of threads would grow up to max-connections, or 4000 threads in your case. If

Re: apache geode docker image vulnerabilities

From: Dan Smith Sent: Wednesday, January 13, 2021 4:28 PM To: user@geode.apache.org Subject: Re: apache geode docker image vulnerabilities I'm not sure if it helps, but on develop we've switched to the liberica openjdk 11 docker image as the base image. So some of these may go away

Re: apache geode docker image vulnerabilities

I'm not sure if it helps, but on develop we've switched to the liberica openjdk 11 docker image as the base image. So some of these may go away if they are JDK 8 specific vulnerabilities. The state we are in right now is that when we do a release we're building our Docker image on the latest

Re: JDK 16 Support?

You might be able to work around this for the moment using something like --add-opens java.base/java.nio=ALL-UNNAMED when you start the JVM. I do agree we should not be using these internal JDK classes for our buffer pool. Maybe someone who knows more about that code can share why we are doing

Re: Connecting remotely to Geode on Raspberry Pi 4

pi@raspberrypi:~/fractalworks/example-1.0 $ netstat -a | grep 4 tcp6 0 0 [::]:4 [::]:* LISTEN Does this mean that geode is only listening for IPV6 traffic? That might explain it since you are trying to connect using the IPv4 address. -Dan

Re: Geode Java Client Upgrade Compatibility

Using Geode 1.12.8 with GemFire 9.10.13 should be fine. In general, we suggest using a server version that is higher or equal than the client version. 9.10.13 is based on Geode 1.12.7, so technically to have matching versions it would be nice to update the server. But in practice, the only

[ANNOUNCE] Apache Geode Kafka Connector 1.1.0

/closer.lua/geode/kafka-connector-1.1.0 We would like to thank all the contributors that made the release possible. Regards, Dan Smith on behalf of the Apache Geode team

[ANNOUNCE] Apache Geode Kafka Connector 1.1.0

/releases/ We would like to thank all the contributors that made the release possible. Regards, Dan Smith on behalf of the Apache Geode team

Re: [VOTE] Move geode to the attic

CJXVCI6Mn0%3D%7C3000%7C%7C%7Csdata=wo6wDQSJk8FdjjJs%2F8IM5Lnh2sn9b%2F8E2Epr3Uw9HlM%3Dreserved=0 > On Oct 24, 2022, at 10:51 AM, Dan Smith wrote: > > ⚠ External Email > > Hi folks, > > Last week we discussed moving Geode to the attic [1]. I'm sad to find us at > this

[RESULT] [VOTE] Move geode to the attic

This vote is now closed, thanks to everyone who voted. The vote has passed with 4 binding PMC members voting to move the project to the attic. I think the next step is that I will add an item to the agenda for the next Apache board meeting for the board to consider. I'll also put the details in

Re: [RESULT] [VOTE] Move geode to the attic

, there are options to raise a community and reboot the project within the apache foundation, so this doesn't have to be the end of the line. -Dan From: Dan Smith Sent: Thursday, November 3, 2022 3:15 PM To: user@geode.apache.org ; d...@geode.apache.org Subject: [RESULT] [VOTE] Move geode

Update: Geode not moving to the attic

Hi folks, I have some good news! Notifying the board mailing list of our vote to move Geode to the attic got some attention. Several inactive PMC members and some new folks from the Apache membership have expressed interest in helping with the project. With this help, we do not need to move

Re: [VOTE] Move geode to the attic

. -Dan From: Xiaojian Zhou Sent: Sunday, October 30, 2022 10:51 PM To: user@geode.apache.org ; d...@geode.apache.org Subject: Re: [VOTE] Move geode to the attic !! External Email Vote to move to attic. Regards Xiaojian Zhou, PMC of geode From: Dan Smith Date