Re: [PDE East] Geode Conference - Double the Expected Attendance

2017-12-04 Thread Michael Stolz
This was really a great day in the history of Apache Geode. We were concerned that we might not have any turn-out at all for this session because it was disjointed from the rest of Spring 1 Platform. The rest of the show starts tomorrow. We were concerned that we had no way to measure the popular

Re: Proposal on new features [Json Extension]

2018-01-10 Thread Michael Stolz
I don't see how the lack of an entity-defined pojo limits co-location. Co-location must always be achieved via data that is resident in the key of the entry. PartitionResolver cannot use anything in the payload itself, because the PartitionResolver is called in the case of get(key) as well as put(k

Re: Function Executor thread stacked

2018-01-11 Thread Michael Stolz
Could this be the thing about passing 1 argument to a function you receive just what was passed...passing more than one argument you get an array containing the things that you passed? -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 Download the new GemFire book here

Re: sync up 2 data centers

2018-01-17 Thread Michael Stolz
You can write a function to "touch" (read get/put) the entries that didn't get replicated and run it on the DC1 side after the sender has been started, and they will be replicated automatically. -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 Download the new GemFire

Re: sync up 2 data centers

2018-01-18 Thread Michael Stolz
ies that are not replicated then you may have to do put() with all the > entries; that could be expensive... > > Any reason why sender is not started... > > -Anil. > > > On Wed, Jan 17, 2018 at 4:05 PM, Michael Stolz wrote: > >> You can write a function to "touch&

Re: Custom Partitioning and Restful Interface

2018-01-18 Thread Michael Stolz
If you format your key as a String as follows: "partition_key|actual_key" then you can use the StringPrefixPartitionResolver that comes with Geode that will return the "partition_key" substring as the partition key, so you don't even have to write a custom PartitionResolver. -- Mike Stolz Princi

Re: Spring Session for Apache Geode 2.0.0.RELEASE Available!

2018-01-18 Thread Michael Stolz
Congrats John -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 Download the new GemFire book here. On Thu, Jan 18, 2018 at 2:16 PM, John Blum wrote: > Apache Geode Community- > > I am pl

Re: Spring Data for Apache Geode 2.0.3.RELEASE available!

2018-01-24 Thread Michael Stolz
Congratulations. Great job as always. -- Mike Stolz Principal Engineer - Gemfire Product Manager Mobile: 631-835-4771 On Jan 24, 2018 10:35 AM, "John Blum" wrote: > Apache Geode Community- > > I am very pleased to follow-up to the announcement by Mark Paluch on the > release of Spring Data Kay

Re: [ANNOUNCE] Apache Geode 1.4.0

2018-02-06 Thread Michael Stolz
Super! Congratulations -- Mike Stolz On Feb 5, 2018 8:36 PM, "Akihiro Kitada" wrote: > Awesome! > > > -- > Akihiro Kitada | Staff Customer Engineer | +81 80 3716 3736 > <+81%2080-3716-3736> > Support.Pivotal.io | Mon-Fri 9:00am to > 5:30pm JST | 1-877-477-2

Re: [PROPOSAL]: Create region with the same name on different groups in gfsh should fail early

2018-02-06 Thread Michael Stolz
Seems like you don't want the second one. Proxy should be allowed, yes? -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 Download the new GemFire book here. On Tue, Feb 6, 2018 at 10:56 AM

Re: [PROPOSAL]: Create region with the same name on different groups in gfsh should fail early

2018-02-06 Thread Michael Stolz
n with the same name, I should abort the creation. > > On Tue, Feb 6, 2018 at 8:00 AM, Michael Stolz wrote: > >> Seems like you don't want the second one. Proxy should be allowed, yes? >> >> -- >> Mike Stolz >> Principal Engineer, GemFire Product Lead >&g

Re: [PROPOSAL]: Create region with the same name on different groups in gfsh should fail early

2018-02-06 Thread Michael Stolz
ing-data-services-with-pivotal-gemfire> On Tue, Feb 6, 2018 at 11:05 AM, Michael Stolz wrote: > Ah, on the same member. That makes sense. What if it is a new member > joining the group? > > -- > Mike Stolz > Principal Engineer, GemFire Product Lead > Mobile: +1-631-835-47

Re: geode & timeseries

2018-03-12 Thread Michael Stolz
Does this construct do what you need? https://stackoverflow.com/questions/29564490/implementing-a-sliding-window-java -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 Download the new GemFire book here.

Re: [PROPOSAL]: deprecating gfsh command option --load-cluster-config-from-dir for 'start locator'

2018-04-05 Thread Michael Stolz
There could be. For instance, in a cloud environment, the working directory could be on transient disk. The cluster configuration should, however, always be on permanent disk. -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 Download the new GemFire book here.

Re: Geode Summit 2018 coming up on Sept 24th - register now

2018-08-15 Thread Michael Stolz
Yes that is likely to happen. We haven't started planning yet but we will definitely do one. -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 Download the GemFire book here. On Wed, Aug 15

Re: Slow speed traversing through the database

2018-08-16 Thread Michael Stolz
One thing to make sure of is that the function is only accessing data that is local to each of the nodes where it is running. To do this you must do something like this: Region localPrimaryData = PartitionRegionHelper.getLocalPrimaryData(exampleRegion); Then you can iterate over the entries in thi

Re: Get geode region insert completion event

2018-09-26 Thread Michael Stolz
You could store the pointer record in both regions and make sure to replace the stale region first then the live region. Then you could use getAll( ) including the key of the pointer record as well as the record you want. -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-47

Re: Get geode region insert completion event

2018-09-26 Thread Michael Stolz
Then you would have to check that the pointer record is pointing to the region you fetched it from. If not, redo the operation on the region it IS pointing to. -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 On Wed, Sep 26, 2018 at 1:47 PM Michael Stolz wrote

Re: GEODE-5649

2018-10-26 Thread Michael Stolz
Is other network traffic between those machines running at normal speed? Maybe there's some kind of routing issue? How many keys in your getAll? -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 On Fri, Oct 26, 2018 at 11:50 AM Charlie Black wrote: > 30 seconds is

Re: GEODE-5649

2018-10-30 Thread Michael Stolz
Thanks for that additional detail. The workload you are describing should be taking more like 30 milliseconds rather than 30 seconds. There is something VERY wrong somewhere in this environment. One area I would look at in this case is maybe the disk you are logging to is having i/o errors and retr

Re: Creating Regions Dynamically using Functions

2018-10-30 Thread Michael Stolz
While everyone is helping you get to your goal of creating regions dynamically, I'd like to learn why dynamic region creation is important. Could you please explain that? -- Mike Stolz Principal Engineer - Gemfire Product Manager Mobile: 631-835-4771 On Oct 30, 2018 6:12 PM, "Udo Kohlmeyer" wro

Re: Removing region data

2018-11-01 Thread Michael Stolz
1. Retrieve the keys (millions) to be evicted and pass this to localData.removeAll() MS: This option is probably not a good idea for a few reasons. First, it will take quite a lot of memory to pass the list to localData.removeAll, thereby making a significant amount of garbage. Second, it will resu

Re: Issues with register interest with the number of consumers

2019-01-11 Thread Michael Stolz
Olivier, Can you correlate anything like GC pauses with these slow deliveries? -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 On Fri, Jan 11, 2019 at 1:36 PM Anilkumar Gingade wrote: > Oliv, > > The subscription has cost associated with it; as interested need

Re: Geode switch over to different data center

2019-04-10 Thread Michael Stolz
If the data centers are far apart you will want to use the bi-directional GemFire WAN Gateway to replicate between clusters. The trickiest part is figuring out when to switch. If you already have a mechanism for that then that's great. Once you know for sure you want to switch, the easiest way is

Re: Geode switch over to different data center

2019-04-11 Thread Michael Stolz
n. > > One way we are thinking of is probably catching those locator not > available sort of exception and then make a switch. Any thoughts? > > > With best regards, > Ashish > > > On Thu, Apr 11, 2019, 1:42 AM Michael Stolz wrote: > >> If the data centers are

Re: can't connect to 2 different locators?

2019-04-12 Thread Michael Stolz
You will need to establish separate pools for the 2 clusters. Each pool can talk to separate locators. -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 On Fri, Apr 12, 2019, 6:32 PM Jinmei Liao wrote: > I believe multiple caches in one VM are not supported in Geod

Re: Geode switch over to different data center

2019-04-15 Thread Michael Stolz
would be tricky to make switch as you explained. > > Even with rolling restart there will be a downtime and some manual steps > will be required to accomplish that. > > With best regards, > Ashish > > On Thu, Apr 11, 2019, 10:18 PM Michael Stolz wrote: > >> Ye

Re: [ANNOUNCE] Spring Boot for Apache Geode 1.0.0.RELEASE Available!

2019-05-07 Thread Michael Stolz
Congratulations John, Great work as always. -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 On Mon, May 6, 2019 at 10:03 PM John Blum wrote: > It is my pleasure to announce the first GA release of Spring Boot for > Apache Geode (SBDG) 1.0.0.RELEASE. > > See the

Re: Geode function avoid multiple service call

2019-09-16 Thread Michael Stolz
If you execute onRegion withFilter and a single filter key it will only be executed on the server who would host that key. -- Mike Stolz Principal Engineer, Pivotal Cloud Cache Mobile: +1-631-835-4771 On Mon, Sep 16, 2019 at 12:49 PM aashish choudhary < aashish.choudha...@gmail.com> wrote: > W

Re: Geode function avoid multiple service call

2019-09-18 Thread Michael Stolz
;>> -Anil. >>> >>> >>> >>> On Mon, Sep 16, 2019 at 10:55 AM Dan Smith wrote: >>> >>>> When you call FunctionService.onServer, you can pass it a ClientCache >>>> or a Pool. It will find a running server and execute on that. So

Re: Geode active active wan

2019-10-17 Thread Michael Stolz
Is replication to cluster-2 working? -- Mike Stolz Principal Engineer, Pivotal Cloud Cache Mobile: +1-631-835-4771 On Thu, Oct 17, 2019, 11:06 AM aashish choudhary < aashish.choudha...@gmail.com> wrote: > Anyone? > > With best regards, > Ashish > > On Mon, Oct 14, 2019, 10:27 PM aashish choudha

Re: [INTRODUCTIONS] Hi, I'm Greg and I'm part of the Geode Community

2016-12-15 Thread Michael Stolz
Hi my name is Mike Stolz. I have been around GemFire (the product from which Apache Geode was spawned) pretty much from the very beginning. In fact, I was the first customer to put it in production back in 2002 when I worked at Merrill Lynch. In 2007 I left Merrill Lynch and joined the GemFire tea

Re: Socket timeout after making regions persistent in async way

2016-12-20 Thread Michael Stolz
You should probably put 100 instead of 1000 rather than playing with the timeouts. -- Mike Stolz Principal Engineer, GemFire Product Manager Mobile: 631-835-4771 On Tue, Dec 20, 2016 at 11:23 AM, Dharam Thacker wrote: > Yeah increasing read time out to 60 seconds worked out for me! > > I am put

Re: How does colocation work in Spring data Geode

2016-12-29 Thread Michael Stolz
We should make a generic implementation of what Udo described here as part of the Geode examples. It's such a frequently used pattern. -- Mike Stolz Principal Engineer - Gemfire Product Manager Mobile: 631-835-4771 On Dec 29, 2016 9:54 AM, "Amit Pandey" wrote: > Hi All, > > A happy new year to a

Re: Send an asynchronous event to one client among many

2017-01-19 Thread Michael Stolz
Instead of hopping out to a client, you could get horizontal scale and asynchronous processing by using an AsyncEventListener in the servers. That will take care of multi-threading and queuing and all the plumbing, and you just go ahead and write your processing code and deploy it as AsyncEventList

Re: Project demonstrating indexing technique using quad trees

2017-02-16 Thread Michael Stolz
Great stuff Charlie. Thanks for sharing -- Mike Stolz Principal Engineer, GemFire Product Manager Mobile: +1-631-835-4771 On Thu, Feb 16, 2017 at 10:56 AM, Udo Kohlmeyer wrote: > Nice work! > > On 2/15/17 18:11, Charlie Black wrote: > > Hello fellow Apache Geode users. > > I thought I would sha

Re: fastest way to bulk insert in geode

2017-03-03 Thread Michael Stolz
And of course, it depends on your access patterns. If all access is by primary key, then CacheLoaders are a viable option. If access is by query on non-primary key fields, then ALL data needs to be pre-loaded, otherwise you won't know if you got the right query result. So for situations where pre-

RE: fastest way to bulk insert in geode

2017-03-06 Thread Michael Stolz
Of course if you're REALLY in need of speed you can write your own custom implementations of toData and fromData for the DataSerializable Interface. I haven't seen anyone need that much speed in a long time though. -- Mike Stolz Principal Engineer - Gemfire Product Manager Mobile: 631-835-4771

Re: Gemfire proxy cache race condition bug?

2017-03-06 Thread Michael Stolz
If you always do whatever processing you are planning to do inside the CacheListener and use the "newValue" field that is supplied to that callback you will always begin processing in the order the data was received. I suppose if you want to ensure that you are completing processing in the correct

Re: [VOTE] Marking Redis Adapter as Experimental

2017-03-08 Thread Michael Stolz
+1 to marking it experimental now Once we do that I think it will be fine for the community to make breaking changes to it if we need to. -- Mike Stolz Principal Engineer, GemFire Product Manager Mobile: +1-631-835-4771 On Wed, Mar 8, 2017 at 5:08 PM, Galen M O'Sullivan wrote: > Hi all, > > I

Re: concurrent access on the same key - need precision

2017-03-29 Thread Michael Stolz
Gets are load-balanced across the redundant copies UNLESS they are operating within the context of a Transaction, in which case they will always hit the local server on which the transaction is being managed. Puts are replicated synchronously and while the primary is locked to limit the chance of a

Re: Questions about gfsh and Cluster Config for eviction

2017-04-18 Thread Michael Stolz
Any and all feedback on missing gfsh commands or options are very very welcome. -- Mike Stolz Principal Engineer, GemFire Product Manager Mobile: +1-631-835-4771 On Tue, Apr 18, 2017 at 3:00 PM, Swapnil Bawaskar wrote: > Hi Mark, > We have this jira https://issues.apache.org/jira/browse/GEODE-2

RE: Geode Performance how to push the cpu to 100%?

2017-06-09 Thread Michael Stolz
Try doing just raw pipe communications between a bunch of processes to see if you can pin the cpu. # cat somebigfile | cat | cat... >/dev/null If that can't pin cpu then you know it's the operating system. -- Mike Stolz Principal Engineer - Gemfire Product Manager Mobile: 631-835-4771 <(631)%20

Re: Geode Performance how to push the cpu to 100%?

2017-06-09 Thread Michael Stolz
verton, OR USA > > http://www.pivotal.io > <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.pivotal.io&d=DwMFaQ&c=SFszdw3oxIkTvaP4xmzq_apLU3uL-3SxdAPNkldf__Q&r=HB5LZowSGF4DiMmOUsCX6Q&m=jA6gcP4ARbtU41FCBhxbyMYIc6RtwsaQ---Me6CGLDY&s=7432wySy951E1aDXgYyglk2Xj8r

Re: Geode Performance how to push the cpu to 100%?

2017-06-09 Thread Michael Stolz
but adding more tcp connections don't help. Ideas? > > > Sent with BlackBerry Work (www.blackberry.com) > ------ > *From: *Michael Stolz > *Sent: *Jun 9, 2017 5:05 PM > *To: *user@geode.apache.org > *Subject: *Re: Geode Performance how to

Re: Trying to create a Region with GatewaySenderId

2017-06-20 Thread Michael Stolz
Jarred is correct but could definitely use clearer docs abs/or error message. -- Mike Stolz Principal Engineer - Gemfire Product Manager Mobile: 631-835-4771 On Jun 20, 2017 5:36 PM, "Kirk Lund" wrote: > Looks like a usability issue to me. Where did you find that info? > > I'm looking at Gatewa

Re: Use Java Serialization in Spring Data

2017-06-30 Thread Michael Stolz
Actually, the system will automatically "punt" to Java serialization if there is no PDX serializer for a given class and the class is Serializable. The big trouble with that is it can hide errors in your PDX configuration, silently resorting to Java Serializable when you are thinking that you are

Re: Use Java Serialization in Spring Data

2017-06-30 Thread Michael Stolz
, Amit Pandey wrote: > John, Michael, > > Thanks for the info. > > Michael can you please let me know what you mean by this :- "don't need to > push you domain objects into the servers in order to query or index them" > > Regards > > > On Sa

Re: How to stop geode server

2017-07-06 Thread Michael Stolz
Only ever use kill -9 as a last resort when dealing with any process that stores data permanently. You can issue a kill -2 to the geode process id and that should cause the geode process to shutdown in an orderly fashion. -- Mike Stolz Principal Engineer, GemFire Product Manager Mobile: +1-631-835

Re: refactor query command

2017-07-11 Thread Michael Stolz
Actually a really nice thing would be to put the pagination feature into the OQL engine where it belongs. Clients shouldn't have to implement pagination. -- Mike Stolz Principal Engineer, GemFire Product Manager Mobile: +1-631-835-4771 On Tue, Jul 11, 2017 at 12:00 AM, Michael William Dodge wrot

Re: refactor query command

2017-07-12 Thread Michael Stolz
IOW within the query string is acting on >>>>> server side. >>>>> >>>>> On Tue, Jul 11, 2017 at 11:19 AM, Jinmei Liao >>>>> wrote: >>>>> >>>>>> what if user wants to do: >>>>>> gfsh> query --que

Re: refactor query command

2017-07-12 Thread Michael Stolz
gt;>>> >>>>>> >> gfsh> query --query='select * from /A limit 10' --limit=100 >>>>>> We need to make sure that user can differentiate query commands from >>>>>> options provided by tool. >>>>>> >>>

Re: Alternative to AtomicInteger or AtomicLong with Geode

2017-07-17 Thread Michael Stolz
Why not partitioned region with a local entry lock on the primary? -- Mike Stolz Principal Engineer - Gemfire Product Manager Mobile: 631-835-4771 On Jul 17, 2017 9:58 AM, "Anthony Baker" wrote: > You can build concurrency primitives like AtomicInteger using the > DistributedLockService. Howev

Re: Concerns of CacheLoader

2017-08-28 Thread Michael Stolz
I suppose you could write your own thing to do a get if zero rows are returned, but how to make that generically part of the product seems quite a stretch. -- Mike Stolz Principal Engineer, GemFire Product Manager Mobile: +1-631-835-4771 On Sun, Aug 27, 2017 at 2:20 AM, Parin dazz wrote: > Than

Re: Get part of the object

2017-08-29 Thread Michael Stolz
You should probably use the PDX ReflectionBasedAutoSerializer. Then you can write a server-side function that you call to get just the fields you want and return them. -- Mike Stolz Principal Engineer, GemFire Product Manager Mobile: +1-631-835-4771 On Tue, Aug 29, 2017 at 4:49 PM, Xu, Nan wrote

Re: Get part of the object

2017-08-30 Thread Michael Stolz
6F4A808AEFB748C867189E > <https://urldefense.proofpoint.com/v2/url?u=https-3A__gemfire.docs.pivotal.io_geode_getting-5Fstarted_querying-5Fquick-5Freference.html-23reference-5FD5CE64F5FD6F4A808AEFB748C867189E&d=DwMFaQ&c=SFszdw3oxIkTvaP4xmzq_apLU3uL-3SxdAPNkldf__Q&r=HB5LZowSGF4

Re: [ANNOUNCE] Spring Data Geode 2.0.0.RELEASE (Kay GA) Available...

2017-10-05 Thread Michael Stolz
Wow! Great stuff John! -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 On Thu, Oct 5, 2017 at 6:35 PM, John Blum wrote: > Dear Geode Community- > > After almost 1 year of radio silence on all things related to *Spring > Data Geode* for Apache Geode, it is my pleas

Re: Executing function on partitioned region

2017-10-06 Thread Michael Stolz
"with filter" was added to the REST api in 8.x I believe. -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 On Fri, Oct 6, 2017 at 2:19 PM, Jens Deppe wrote: > Hi Mangesh, > > If you have the key for your entry then it will be more performant, > calling the function

Re: Executing function on partitioned region

2017-10-06 Thread Michael Stolz
t; Thanks, > > Mangesh > > > > > > *From: *Michael Stolz > *Reply-To: *"user@geode.apache.org" > *Date: *Friday, October 6, 2017 at 3:01 PM > *To: *"user@geode.apache.org" > *Subject: *Re: Executing function on partitioned region > > > &

Re: locator and peer compatible versions

2017-10-20 Thread Michael Stolz
What benefits are you getting from your application being resident in a peer versus a client? -- Mike Stolz Principal Engineer, GemFire Product Lead Mobile: +1-631-835-4771 On Fri, Oct 20, 2017 at 1:00 PM, George Wilder wrote: > Ultimately I'll have more than one peer application. I was hoping

Re: Client queue full

2017-10-24 Thread Michael Stolz
Maybe you shouldn't be using registerInterest at all if you don't have a CacheListener. If all you want is to ensure that you always get the latest version of data on a client get(key), just switch your client Region to PROXY instead of CACHING_PROXY, and don't even bother registering interest. I