Re: Stored procedures on Apache Geode.
dated or
pushed, it only augments the configuration (currently, it never "nukes and
paves"). New clients, with additional configuration not yet applied will
only augment/update the *Cluster Config*. It never stomps on existing
schema objects (e.g. Regions).
The only other goals are this...
1. That *Spring Data Geode* and *Spring Data GemFire*, as of *Spring Data*
*Kay* (i.e. *2.0.0*) are *interchangeable*.
The only thing a *Spring* Geode/GemFire developer need do is switch the
dependency (i.e. the artifactId) in their Maven POM or Gradle build file
from spring-data-geode to spring-data-gemfire. As of *Spring Data* *Kay*,
the versions of SD Geode and SD GemFire have been aligned since *Spring
Data Geode* joined the SD *(Kay) Release Train* (which reminds me, I need
to make announcement!).
2. That developing a *Spring (Boot)* Geode or GemFire cache client
application is (nearly) *identical* whether building/running your local
environment or in a managed environment, like PCF. My goal is that the
developer will need very little to zero application/configuration code
changes, especially when combined with the power of *Spring Boot's*
auto-configuration support.
I don't want to spill all the beans (no pun intended) since I am planning
several announcements, blog series and video for all this stuff, but this
is a gist of it in a nutshell.
As for configuring servers, that really depends on your context. Outside
of PCF, users will need to setup and configure their own clusters. When
using PCF, this becomes a no brainer regardless of the infrastructure
provider (IaaS like GCP, AWS or MS Azure), and is one of the key advantages
to using PCF to begin with. And by "configure", I just meaning
provisioning, not "application-specific" configuration.
One of the reasons I am not a big fan of using *Gfsh* independently of your
application is that I believe the "configuration" should be "versioned"
along with the application code that depends on it, since then, there will
be no chance of a mismatch, things getting out-of-sync, etc. The moment
you have to resort to separate tooling for configuring all the "services"
used/required by the application, that involves additional processing and
steps to ensure the "schema" for those services match when the application
is updated.
The other interesting tidbit in all this is how to handle *blue/green*
deployments (updating the service and then rolling back in the case of
failures or other problems). Anyway, another topic for another day...
Of course, I do envision that *Gfsh* will be needed and *should be* used
for advance UCs, where the Annotation model and SB auto-configuration stop
and "developer" attention is required. This is to be expected.
Anyway, this is the general direction for SDG^2 and how it relates to PCF.
Hope this helps!
Regards,
John
>
> Thanks a lot
> Really appreciate it.
>
> Marios
>
> ________
> From: John Blum [via Apache Geode (Incubating) Developers Forum] [
> ml+s70738n24960...@n6.nabble.com]
> Sent: Thursday, August 03, 2017 12:56 AM
> To: Marios Sofocleous/IT/CREDITSAFE
> Subject: Re: Stored procedures on Apache Geode.
>
> Hi Marios-
>
> Any application config annotated with @PeerCacheApplication /
> @CacheServerApplication, or CacheFactoryBean directly in *JavaConfig*, or
> in XML, is a Geode (GemFire) Server, a peer member of the
> distributed system (cluster) defined by a Locator.
>
> For instance, I can...
>
> gfsh>start locator --name=*LocatorX* --log-level=config
> gfsh>start server --name=*ServerA* --disable-default-server
> --log-level=config
> gfsh>start server --name=*ServerB* --disable-default-server
> --log-level=config
>
> Then run the configuration-example,
> AnnotationConfiguredGeodeServerApplication class from my IDE, modified as
> so..
>
> @SpringBootApplication
> @CacheServerApplication(name = "AnnotationConfiguredGeodeServe
> rApplication",
> port = AnnotationConfiguredGeodeServerApplication.GEODE_CACHE_
> SERVER_PORT,
> *locators
> = **"localhost[10334]"*)
> @EnableCacheServers(servers = { @EnableCacheServer(port = 12480),
> @EnableCacheServer(port = 40404) })
> //@EnableLocator
> //@EnableManager
> ...
> @Import(EchoServerApplicationConfiguration.class)
> public class AnnotationConfiguredGeodeServerApplication {
> ...
> }
>
> And then...
>
> gfsh>list members
>Name| Id
> -- |
> --
> *LocatorX* |
> 10.99.199.5(LocatorX:57545:locator):1024
> *ServerA*|
> 10.99.199.5(ServerA
RE: Stored procedures on Apache Geode.
Hi John,
I am confused a little bit about the different ways of setting up geode cluster
and deploying it in CF.
In short:
* If we choose gemfire we can easily provision it on CF via a tile, whereas
if we go with Geode we have to setup cluster externally (i.e aws) correct ?
* I really like using annotations to configure embedded components (i.e
locator, servers etc) and am wondering weather or not I can use those to deploy
app directly on CF without setting up a cluster externally.
Thanks a lot
Really appreciate it.
Marios
From: John Blum [via Apache Geode (Incubating) Developers Forum]
[ml+s70738n24960...@n6.nabble.com]
Sent: Thursday, August 03, 2017 12:56 AM
To: Marios Sofocleous/IT/CREDITSAFE
Subject: Re: Stored procedures on Apache Geode.
Hi Marios-
Any application config annotated with @PeerCacheApplication /
@CacheServerApplication, or CacheFactoryBean directly in *JavaConfig*, or
in XML, is a Geode (GemFire) Server, a peer member of the
distributed system (cluster) defined by a Locator.
For instance, I can...
gfsh>start locator --name=*LocatorX* --log-level=config
gfsh>start server --name=*ServerA* --disable-default-server
--log-level=config
gfsh>start server --name=*ServerB* --disable-default-server
--log-level=config
Then run the configuration-example,
AnnotationConfiguredGeodeServerApplication class from my IDE, modified as
so..
@SpringBootApplication
@CacheServerApplication(name = "AnnotationConfiguredGeodeServerApplication",
port = AnnotationConfiguredGeodeServerApplication.GEODE_CACHE_SERVER_PORT,
*locators
= **"localhost[10334]"*)
@EnableCacheServers(servers = { @EnableCacheServer(port = 12480),
@EnableCacheServer(port = 40404) })
//@EnableLocator
//@EnableManager
...
@Import(EchoServerApplicationConfiguration.class)
public class AnnotationConfiguredGeodeServerApplication {
...
}
And then...
gfsh>list members
Name| Id
-- |
--
*LocatorX* |
10.99.199.5(LocatorX:57545:locator):1024
*ServerA*|
10.99.199.5(ServerA:57572):1025
*ServerB*|
10.99.199.5(ServerB:57579):1026
*AnnotationConfiguredGeodeServerApplication* |
10.99.199.5(AnnotationConfiguredGeodeServerApplication:57594):1027
Alternatively, I can...
@SpringBootApplication
@CacheServerApplication(name = "AnnotationConfiguredGeodeServerApplication",
port = AnnotationConfiguredGeodeServerApplication.GEODE_CACHE_SERVER_PORT)
@EnableCacheServers(servers = { @EnableCacheServer(port = 12480),
@EnableCacheServer(port = 40404) })
@EnableLocator
@EnableManager
//@EnableSsl(components = { EnableSsl.Component.SERVER },
// keystore =
"/Users/jblum/pivdev/springonePlatform-2016/configuration-example/etc/geode/security/trusted.keystore",
// keystorePassword = "s3cr3t",
// keystoreType = "JKS",
// truststore =
"/Users/jblum/pivdev/springonePlatform-2016/configuration-example/etc/geode/security/trusted.keystore",
// truststorePassword = "s3cr3t")
@Import(EchoServerApplicationConfiguration.class)
public class AnnotationConfiguredGeodeServerApplication {
...
}
That is comment our SSL config, and run the *Spring* class as is.
NOTE: you can run with SSL, but then you must config all servers and
clients connecting to this Locator to use SSL. This just simplifies
running the example with minimal fuss (such as when starting
Locators/Servers from *Gfsh*, where configuring SSL is much more difficult
to do successfully).
This example is running both an embedded *Locator* (on port 10334, by
default) and has enabled the *Manager* service (on port 1099, by default)
for JMX clients to connect (like *Gfsh*). The *CacheServers* are
irrelevant for this demonstration.
Now, *without* even being connected, I can start several servers in *Gfsh*
and connect to this application (NOTE: the application must be running),
which again, is a *Spring Boot(ed)* GemFire peer cache member of the DS
(cluster that it forms with the *Locator* endpoint, namely...
localhost[10334]).
NOTE: the @EnableLocator annotation does let you change the embedded
*Locator's* port if you like. Additionally, the @EnableManager annotation
allows you to change the port of the embedded *Manager* as well.
Ok, my application (AnnotationConfiguredGeodeServerApplication) is running
and I am not (yet) connected in *Gfsh*...
gfsh>list members
Command 'list members' was found but is not currently available (type
'help' then ENTER to learn about this command)
Then, I start some server (in a disconnected state)...
gfsh>start server --name=ServerA --disable-default-server
--log-level=config *--locators=localhost[10334]*
gfsh>start server --name=ServerB --disable-default-server
--log-level
RE: Stored procedures on Apache Geode.
Hi John,
Thank you very much for all this details provided , was very helpful!!!
Thanks
Marios
From: John Blum [via Apache Geode (Incubating) Developers Forum]
[ml+s70738n24960...@n6.nabble.com]
Sent: Thursday, August 03, 2017 12:56 AM
To: Marios Sofocleous/IT/CREDITSAFE
Subject: Re: Stored procedures on Apache Geode.
Hi Marios-
Any application config annotated with @PeerCacheApplication /
@CacheServerApplication, or CacheFactoryBean directly in *JavaConfig*, or
in XML, is a Geode (GemFire) Server, a peer member of the
distributed system (cluster) defined by a Locator.
For instance, I can...
gfsh>start locator --name=*LocatorX* --log-level=config
gfsh>start server --name=*ServerA* --disable-default-server
--log-level=config
gfsh>start server --name=*ServerB* --disable-default-server
--log-level=config
Then run the configuration-example,
AnnotationConfiguredGeodeServerApplication class from my IDE, modified as
so..
@SpringBootApplication
@CacheServerApplication(name = "AnnotationConfiguredGeodeServerApplication",
port = AnnotationConfiguredGeodeServerApplication.GEODE_CACHE_SERVER_PORT,
*locators
= **"localhost[10334]"*)
@EnableCacheServers(servers = { @EnableCacheServer(port = 12480),
@EnableCacheServer(port = 40404) })
//@EnableLocator
//@EnableManager
...
@Import(EchoServerApplicationConfiguration.class)
public class AnnotationConfiguredGeodeServerApplication {
...
}
And then...
gfsh>list members
Name| Id
-- |
--
*LocatorX* |
10.99.199.5(LocatorX:57545:locator):1024
*ServerA*|
10.99.199.5(ServerA:57572):1025
*ServerB*|
10.99.199.5(ServerB:57579):1026
*AnnotationConfiguredGeodeServerApplication* |
10.99.199.5(AnnotationConfiguredGeodeServerApplication:57594):1027
Alternatively, I can...
@SpringBootApplication
@CacheServerApplication(name = "AnnotationConfiguredGeodeServerApplication",
port = AnnotationConfiguredGeodeServerApplication.GEODE_CACHE_SERVER_PORT)
@EnableCacheServers(servers = { @EnableCacheServer(port = 12480),
@EnableCacheServer(port = 40404) })
@EnableLocator
@EnableManager
//@EnableSsl(components = { EnableSsl.Component.SERVER },
// keystore =
"/Users/jblum/pivdev/springonePlatform-2016/configuration-example/etc/geode/security/trusted.keystore",
// keystorePassword = "s3cr3t",
// keystoreType = "JKS",
// truststore =
"/Users/jblum/pivdev/springonePlatform-2016/configuration-example/etc/geode/security/trusted.keystore",
// truststorePassword = "s3cr3t")
@Import(EchoServerApplicationConfiguration.class)
public class AnnotationConfiguredGeodeServerApplication {
...
}
That is comment our SSL config, and run the *Spring* class as is.
NOTE: you can run with SSL, but then you must config all servers and
clients connecting to this Locator to use SSL. This just simplifies
running the example with minimal fuss (such as when starting
Locators/Servers from *Gfsh*, where configuring SSL is much more difficult
to do successfully).
This example is running both an embedded *Locator* (on port 10334, by
default) and has enabled the *Manager* service (on port 1099, by default)
for JMX clients to connect (like *Gfsh*). The *CacheServers* are
irrelevant for this demonstration.
Now, *without* even being connected, I can start several servers in *Gfsh*
and connect to this application (NOTE: the application must be running),
which again, is a *Spring Boot(ed)* GemFire peer cache member of the DS
(cluster that it forms with the *Locator* endpoint, namely...
localhost[10334]).
NOTE: the @EnableLocator annotation does let you change the embedded
*Locator's* port if you like. Additionally, the @EnableManager annotation
allows you to change the port of the embedded *Manager* as well.
Ok, my application (AnnotationConfiguredGeodeServerApplication) is running
and I am not (yet) connected in *Gfsh*...
gfsh>list members
Command 'list members' was found but is not currently available (type
'help' then ENTER to learn about this command)
Then, I start some server (in a disconnected state)...
gfsh>start server --name=ServerA --disable-default-server
--log-level=config *--locators=localhost[10334]*
gfsh>start server --name=ServerB --disable-default-server
--log-level=config *--locators=localhost[10334]*
Now, I connect...
gfsh>connect
Connecting to Locator at [host=localhost, port=10334] ..
Connecting to Manager at [host=10.99.199.5, port=1099] ..
Successfully connected to: [host=10.99.199.5, port=1099]
And `list members`...
gfsh>list members
Name| Id
-- |
-
Re: Stored procedures on Apache Geode.
cted in *Gfsh* (to the AnnotationConfiguredGeodeServerApplication application), I can even start another Geode Server and it will connect *without* me having to explicitly specify the --locators option to `start server` now, because *Gfsh* is connect to the DS (cluster) defined by my AnnotationConfiguredGeodeServerApplication application... gfsh>start server --name=*ServerC* --disable-default-server --log-level=config gfsh>list members Name| Id -- | -- *AnnotationConfiguredGeodeServerApplication* | 10.99.199.5(AnnotationConfiguredGeodeServerApplication:57663):1024 *ServerA*| 10.99.199.5(ServerA:57704):1025 *ServerB*| 10.99.199.5(ServerB:57711):1026 *ServerC*| 10.99.199.5(ServerC:57759):1027 Anyway, there are many ways to go about it. Technically, we are just scratching the surface of what the new SDG Annotation based configuration model can do. There are many more powerful annotations available that do so much more. They all greatly simplify the *getting started* experience and *get users up and running* as *easily* and *quickly* as possible, with the minimal fuss, as in, no need to go into *Gfsh* to do menial tasks (e.g. create Regions, Indexes, etc) anymore, yuck! Although, keep in mind, the Annotations are not a replacement for *Gfsh* where advance UC are concerned. However, a developer should not have to leave his/her IDE (and use a shell too) to quickly prototype his/her application. Anyway, I will be planning a series of blog posts and webinars soon to showcase these new capabilities. Stay tuned! -j On Wed, Aug 2, 2017 at 1:17 PM, marios390 <marios.sofocle...@creditsafe.com> wrote: > Hi John, > > Thanks for providing these details. I am gonna update clone and verify. > I am also have another question for you. I noticed that while executing > "list members" only application listed as member. Locators and servers > are not supposed to be listed as well? > > Thanks > Marios > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > ml+s70738n2493...@n6.nabble.com] > Sent: Wednesday, August 02, 2017 10:48 PM > To: Marios Sofocleous/IT/CREDITSAFE > Subject: Re: Stored procedures on Apache Geode. > > Hi Marios- > > That is strange. Seems your problem is this... > > Failed to instantiate [org.springframework.data.gemfire.CacheFactoryBean]: > Factory method 'gemfireCache' threw exception; nested exception is > *java.lang.NoSuchMethodError*: *org.springframework.data.* > *gemfire.util.CollectionUtils.nullSafeList(Ljava/util/List;) > Ljava/util/List;* > > However, I just ran the example it it started up fine for me (from my > IDE) > > . ___ _ _ > /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ > ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ > \\/ ___)| |_)| | | | | || (_| | ) ) ) ) > ' || .__|_| |_|_| |_\__, | / / / / > =|_|==|___/=/_/_/_/ > :: Spring Boot :: (v2.0.0.M3) > > [info 2017/08/02 12:29:32.694 PDT tid=0x1] Starting > AnnotationConfiguredGeodeServerApplication on jblum-mbpro-2.local with PID > 57158 > (/Users/jblum/pivdev/spring-data-examples-workspace/contacts-application- > workspace/configuration-example/target/classes > started by jblum in > /Users/jblum/pivdev/spring-data-examples-workspace/contacts-application- > workspace/configuration-example/target) > > [info 2017/08/02 12:29:32.695 PDT tid=0x1] No active profile set, > falling back to default profiles: default > > [info 2017/08/02 12:29:32.741 PDT tid=0x1] Refreshing > org.springframework.context.annotation.AnnotationConfigApplicationCon > text@1e81f160: > startup date [Wed Aug 02 12:29:32 PDT 2017]; root of context hierarchy > > ... > > Build-Date: 2017-07-12 07:18:53 -0700 > Build-Id: abaker 0 > Build-Java-Version: 1.8.0_121 > Build-Platform: Mac OS X 10.12.3 x86_64 > Product-Name: Apache Geode > Product-Version: 1.2.0 > Source-Date: 2017-07-11 09:31:40 -0700 > Source-Repository: release/1.2.0 > Source-Revision: 964f2749065ce9c6898fd27983b43f1bd9fc77d0 > Native version: native code unavailable > > ... > > [info 2017/08/02 12:29:35.236 PDT tid=0x1] CacheServer > Configuration: port=12480 max-connections=800 max-threads=0 > notify-by-subscription=true socket-buffer-size=32768 > maximum-time-between-pings=6 maximum-message-count=23 > message-time-to-live=180 eviction-policy=none capacity=1 overflow > directory=. groups=[] loadProbe=ConnectionCountProbe loadPollInterval=5000 > tcpNoDelay=true > >
RE: Stored procedures on Apache Geode.
Hi John, Thanks for providing these details. I am gonna update clone and verify. I am also have another question for you. I noticed that while executing "list members" only application listed as member. Locators and servers are not supposed to be listed as well? Thanks Marios From: John Blum [via Apache Geode (Incubating) Developers Forum] [ml+s70738n2493...@n6.nabble.com] Sent: Wednesday, August 02, 2017 10:48 PM To: Marios Sofocleous/IT/CREDITSAFE Subject: Re: Stored procedures on Apache Geode. Hi Marios- That is strange. Seems your problem is this... Failed to instantiate [org.springframework.data.gemfire.CacheFactoryBean]: Factory method 'gemfireCache' threw exception; nested exception is *java.lang.NoSuchMethodError*: *org.springframework.data.* *gemfire.util.CollectionUtils.nullSafeList(Ljava/util/List;)Ljava/util/List;* However, I just ran the example it it started up fine for me (from my IDE) . ___ _ _ /\\ / ___'_ __ _ _(_)_ __ __ _ \ \ \ \ ( ( )\___ | '_ | '_| | '_ \/ _` | \ \ \ \ \\/ ___)| |_)| | | | | || (_| | ) ) ) ) ' || .__|_| |_|_| |_\__, | / / / / =|_|==|___/=/_/_/_/ :: Spring Boot :: (v2.0.0.M3) [info 2017/08/02 12:29:32.694 PDT tid=0x1] Starting AnnotationConfiguredGeodeServerApplication on jblum-mbpro-2.local with PID 57158 (/Users/jblum/pivdev/spring-data-examples-workspace/contacts-application-workspace/configuration-example/target/classes started by jblum in /Users/jblum/pivdev/spring-data-examples-workspace/contacts-application-workspace/configuration-example/target) [info 2017/08/02 12:29:32.695 PDT tid=0x1] No active profile set, falling back to default profiles: default [info 2017/08/02 12:29:32.741 PDT tid=0x1] Refreshing org.springframework.context.annotation.AnnotationConfigApplicationContext@1e81f160: startup date [Wed Aug 02 12:29:32 PDT 2017]; root of context hierarchy ... Build-Date: 2017-07-12 07:18:53 -0700 Build-Id: abaker 0 Build-Java-Version: 1.8.0_121 Build-Platform: Mac OS X 10.12.3 x86_64 Product-Name: Apache Geode Product-Version: 1.2.0 Source-Date: 2017-07-11 09:31:40 -0700 Source-Repository: release/1.2.0 Source-Revision: 964f2749065ce9c6898fd27983b43f1bd9fc77d0 Native version: native code unavailable ... [info 2017/08/02 12:29:35.236 PDT tid=0x1] CacheServer Configuration: port=12480 max-connections=800 max-threads=0 notify-by-subscription=true socket-buffer-size=32768 maximum-time-between-pings=6 maximum-message-count=23 message-time-to-live=180 eviction-policy=none capacity=1 overflow directory=. groups=[] loadProbe=ConnectionCountProbe loadPollInterval=5000 tcpNoDelay=true [info 2017/08/02 12:29:35.238 PDT tid=0x1] Cache server connection listener bound to address 0.0.0.0/0.0.0.0:40404<redir.aspx?REF=sDZg-nvvsyKvJ_YfZI_cr1EJR8CVeZbc0Xz_7DsFLWhJ5pmI4tnUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9bnF5QzJTMW00R3dwdFdVWG52dmhHX2JsSlB6YThXMlFFRURrTzlEMEdnJnU9aHR0cCUzYSUyZiUyZjAlMmUwJTJlMCUyZTAlMmYwJTJlMCUyZTAlMmUwJTNhNDA0MDQ.> with backlog 1,000. [info 2017/08/02 12:29:35.239 PDT tid=0x1] CacheServer Configuration: port=40404 max-connections=800 max-threads=0 notify-by-subscription=true socket-buffer-size=32768 maximum-time-between-pings=6 maximum-message-count=23 message-time-to-live=180 eviction-policy=none capacity=1 overflow directory=. groups=[] loadProbe=ConnectionCountProbe loadPollInterval=5000 tcpNoDelay=true [info 2017/08/02 12:29:35.250 PDT tid=0x1] Started AnnotationConfiguredGeodeServerApplication in 2.83 seconds (JVM running for 4.218) ... Indeed, I am also able to connect to this *Spring* configure Geode server in *Gfsh*... jblum-mbpro-2:lab jblum$ gfsh _ __ / _/ __/ __/ // / / / __/ /___ /_ / _ / / /__/ / / _/ / // / /__/_/ /__/_//_/1.2.0 Monitor and Manage Apache Geode gfsh>connect Connecting to Locator at [host=localhost, port=10334] .. Connecting to Manager at [host=10.99.199.5, port=1099] .. Successfully connected to: [host=10.99.199.5, port=1099] gfsh>list members Name| Id -- | -- AnnotationConfiguredGeodeServerApplication | 10.99.199.5(AnnotationConfiguredGeodeServerApplication:57158):1024 I have updated the dependencies recently and I just checked in a change to the parent pom and configuration-example pom to base the examples on Apache Geode (rather than Pivotal GemFire). Can you please update your clone and verify again. Thanks, John On Wed, Aug 2, 2017 at 12:20 PM, marios390 <[hidden email] > wrote: > Hi John, > > Thanks a lot for getting back to me. This is the example am trying , > > > https://github.com/jx
Re: Stored procedures on Apache Geode.
10.RELEASE.jar:4.3.10.RELEASE] > at org.springframework.beans.factory.support.ConstructorResolver. > instantiateUsingFactoryMethod(ConstructorResolver.java:588) > ~[spring-beans-4.3.10.RELEASE.jar:4.3.10.RELEASE] > ... 31 common frames omitted > Caused by: java.lang.NoSuchMethodError: org.springframework.data. > gemfire.util.CollectionUtils.nullSafeList(Ljava/util/List;) > Ljava/util/List; > at org.springframework.data.gemfire.config.annotation. > AbstractCacheConfiguration.jndiDataSources(AbstractCacheConfiguration.java:684) > ~[spring-data-gemfire-1.9.6.RELEASE.jar:na] > at org.springframework.data.gemfire.config.annotation. > AbstractCacheConfiguration.setCommonCacheConfiguration( > AbstractCacheConfiguration.java:602) ~[spring-data-gemfire-1.9.6. > RELEASE.jar:na] > at org.springframework.data.gemfire.config.annotation. > AbstractCacheConfiguration.constructCacheFactoryBean( > AbstractCacheConfiguration.java:567) ~[spring-data-gemfire-1.9.6. > RELEASE.jar:na] > at org.springframework.data.gemfire.config.annotation. > PeerCacheConfiguration.gemfireCache(PeerCacheConfiguration.java:57) > ~[spring-data-gemfire-1.9.6.RELEASE.jar:na] > at org.springframework.data.gemfire.config.annotation. > CacheServerConfiguration$$EnhancerBySpringCGLIB$$ > 5807f1bc.CGLIB$gemfireCache$42() ~[spring-data-gemfire-1.9.6. > RELEASE.jar:na] > at org.springframework.data.gemfire.config.annotation. > CacheServerConfiguration$$EnhancerBySpringCGLIB$$5807f1bc$$ > FastClassBySpringCGLIB$$29225ea5.invoke() > ~[spring-data-gemfire-1.9.6.RELEASE.jar:na] > at > org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228) > ~[spring-core-4.3.10.RELEASE.jar:4.3.10.RELEASE] > at org.springframework.context.annotation.ConfigurationClassEnhancer$ > BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:358) > ~[spring-context-4.3.10.RELEASE.jar:4.3.10.RELEASE] > at org.springframework.data.gemfire.config.annotation. > CacheServerConfiguration$$EnhancerBySpringCGLIB$$5807f1bc.gemfireCache() > ~[spring-data-gemfire-1.9.6.RELEASE.jar:na] > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > ~[na:1.8.0_131] > at sun.reflect.NativeMethodAccessorImpl.invoke( > NativeMethodAccessorImpl.java:62) ~[na:1.8.0_131] > at sun.reflect.DelegatingMethodAccessorImpl.invoke( > DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_131] > at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_131] > at org.springframework.beans.factory.support.SimpleInstantiationStrategy. > instantiate(SimpleInstantiationStrategy.java:162) > ~[spring-beans-4.3.10.RELEASE.jar:4.3.10.RELEASE] > ... 32 common frames omitted > > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > ml+s70738n24899...@n6.nabble.com] > Sent: Wednesday, August 02, 2017 6:20 PM > To: Marios Sofocleous/IT/CREDITSAFE > Subject: Re: Stored procedures on Apache Geode. > > Hi Marios- > > To which example are you referring and what is the error you are getting? > > Also, if you could please share a small snippet of code showing how you > used the annotations, that would be helpful. > > The new Annotation based configuration (beginning with 1 of... > @ClientCacheApplication, @PeerCacheApplication or > @CacheServerApplication) *applies > to both GemFire and Geode*. @ClientCacheApplication is probably going to > be the most widely used annotation while the later 2 are used to embed > either a GemFire/Geode data node in your application or just configure 1. > > Finally, while I am still in the process of building examples/documentation > for the new Annotations, there are plenty of tests in the SDG test suite > showing them in action and how they work... > > https://github.com/spring-projects/spring-data-geode/ > tree/master/src/test/java/org/springframework/data/gemfire/ > config/annotation<redir.aspx?REF=kvZS0WoQ35NGl46_5vRg3iuMLMna8SKcybK_ > oRKQCPmi54Wz2tnUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_ > Yz03NDIyJmQ9Mi0yQjJVRjNURjczcFNvS2luWnR4emp6cW9keXB0M3VoZDdh > U3BfLVJnJnU9aHR0cHMlM2ElMmYlMmZnaXRodWIlMmVjb20lMmZzcHJpbmct > cHJvamVjdHMlMmZzcHJpbmctZGF0YS1nZW9kZSUyZnRyZWUlMmZtYXN0ZXIl > MmZzcmMlMmZ0ZXN0JTJmamF2YSUyZm9yZyUyZnNwcmluZ2ZyYW1ld29yayUy > ZmRhdGElMmZnZW1maXJlJTJmY29uZmlnJTJmYW5ub3RhdGlvbg..> > > > Regards, > > -j > > > On Wed, Aug 2, 2017 at 8:04 AM, marios390 <[hidden > email]> > wrote: > > > Hi John, > > > > I am following you example for setting up geode cluster using annotation > > but getting > > a few errors. Do these annotations apply only for gemfire? > > > > Thanks > > Marios > > > > From: John Blum [via Apache Geode (Incubating) Developers
RE: Stored procedures on Apache Geode.
; at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:189) ~[spring-beans-4.3.10.RELEASE.jar:4.3.10.RELEASE] at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:588) ~[spring-beans-4.3.10.RELEASE.jar:4.3.10.RELEASE] ... 31 common frames omitted Caused by: java.lang.NoSuchMethodError: org.springframework.data.gemfire.util.CollectionUtils.nullSafeList(Ljava/util/List;)Ljava/util/List; at org.springframework.data.gemfire.config.annotation.AbstractCacheConfiguration.jndiDataSources(AbstractCacheConfiguration.java:684) ~[spring-data-gemfire-1.9.6.RELEASE.jar:na] at org.springframework.data.gemfire.config.annotation.AbstractCacheConfiguration.setCommonCacheConfiguration(AbstractCacheConfiguration.java:602) ~[spring-data-gemfire-1.9.6.RELEASE.jar:na] at org.springframework.data.gemfire.config.annotation.AbstractCacheConfiguration.constructCacheFactoryBean(AbstractCacheConfiguration.java:567) ~[spring-data-gemfire-1.9.6.RELEASE.jar:na] at org.springframework.data.gemfire.config.annotation.PeerCacheConfiguration.gemfireCache(PeerCacheConfiguration.java:57) ~[spring-data-gemfire-1.9.6.RELEASE.jar:na] at org.springframework.data.gemfire.config.annotation.CacheServerConfiguration$$EnhancerBySpringCGLIB$$5807f1bc.CGLIB$gemfireCache$42() ~[spring-data-gemfire-1.9.6.RELEASE.jar:na] at org.springframework.data.gemfire.config.annotation.CacheServerConfiguration$$EnhancerBySpringCGLIB$$5807f1bc$$FastClassBySpringCGLIB$$29225ea5.invoke() ~[spring-data-gemfire-1.9.6.RELEASE.jar:na] at org.springframework.cglib.proxy.MethodProxy.invokeSuper(MethodProxy.java:228) ~[spring-core-4.3.10.RELEASE.jar:4.3.10.RELEASE] at org.springframework.context.annotation.ConfigurationClassEnhancer$BeanMethodInterceptor.intercept(ConfigurationClassEnhancer.java:358) ~[spring-context-4.3.10.RELEASE.jar:4.3.10.RELEASE] at org.springframework.data.gemfire.config.annotation.CacheServerConfiguration$$EnhancerBySpringCGLIB$$5807f1bc.gemfireCache() ~[spring-data-gemfire-1.9.6.RELEASE.jar:na] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.8.0_131] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[na:1.8.0_131] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[na:1.8.0_131] at java.lang.reflect.Method.invoke(Method.java:498) ~[na:1.8.0_131] at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:162) ~[spring-beans-4.3.10.RELEASE.jar:4.3.10.RELEASE] ... 32 common frames omitted From: John Blum [via Apache Geode (Incubating) Developers Forum] [ml+s70738n24899...@n6.nabble.com] Sent: Wednesday, August 02, 2017 6:20 PM To: Marios Sofocleous/IT/CREDITSAFE Subject: Re: Stored procedures on Apache Geode. Hi Marios- To which example are you referring and what is the error you are getting? Also, if you could please share a small snippet of code showing how you used the annotations, that would be helpful. The new Annotation based configuration (beginning with 1 of... @ClientCacheApplication, @PeerCacheApplication or @CacheServerApplication) *applies to both GemFire and Geode*. @ClientCacheApplication is probably going to be the most widely used annotation while the later 2 are used to embed either a GemFire/Geode data node in your application or just configure 1. Finally, while I am still in the process of building examples/documentation for the new Annotations, there are plenty of tests in the SDG test suite showing them in action and how they work... https://github.com/spring-projects/spring-data-geode/tree/master/src/test/java/org/springframework/data/gemfire/config/annotation<redir.aspx?REF=kvZS0WoQ35NGl46_5vRg3iuMLMna8SKcybK_oRKQCPmi54Wz2tnUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9Mi0yQjJVRjNURjczcFNvS2luWnR4emp6cW9keXB0M3VoZDdhU3BfLVJnJnU9aHR0cHMlM2ElMmYlMmZnaXRodWIlMmVjb20lMmZzcHJpbmctcHJvamVjdHMlMmZzcHJpbmctZGF0YS1nZW9kZSUyZnRyZWUlMmZtYXN0ZXIlMmZzcmMlMmZ0ZXN0JTJmamF2YSUyZm9yZyUyZnNwcmluZ2ZyYW1ld29yayUyZmRhdGElMmZnZW1maXJlJTJmY29uZmlnJTJmYW5ub3RhdGlvbg..> Regards, -j On Wed, Aug 2, 2017 at 8:04 AM, marios390 <[hidden email]> wrote: > Hi John, > > I am following you example for setting up geode cluster using annotation > but getting > a few errors. Do these annotations apply only for gemfire? > > Thanks > Marios > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > [hidden email]] > Sent: Wednesday, July 19, 2017 6:13 PM > To: Marios Sofocleous/IT/CREDITSAFE > Subject: Re: Stored procedures on Apache Geode. > > Hi Marios- > > Regarding... > > *> Do you think this indeed will have a huge impact on the performance?* > > There are many factors that affect performance. A few things to consider > might be... > > 1. How well yo
Re: Stored procedures on Apache Geode.
Hi Marios- To which example are you referring and what is the error you are getting? Also, if you could please share a small snippet of code showing how you used the annotations, that would be helpful. The new Annotation based configuration (beginning with 1 of... @ClientCacheApplication, @PeerCacheApplication or @CacheServerApplication) *applies to both GemFire and Geode*. @ClientCacheApplication is probably going to be the most widely used annotation while the later 2 are used to embed either a GemFire/Geode data node in your application or just configure 1. Finally, while I am still in the process of building examples/documentation for the new Annotations, there are plenty of tests in the SDG test suite showing them in action and how they work... https://github.com/spring-projects/spring-data-geode/tree/master/src/test/java/org/springframework/data/gemfire/config/annotation Regards, -j On Wed, Aug 2, 2017 at 8:04 AM, marios390 <marios.sofocle...@creditsafe.com> wrote: > Hi John, > > I am following you example for setting up geode cluster using annotation > but getting > a few errors. Do these annotations apply only for gemfire? > > Thanks > Marios > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > ml+s70738n2447...@n6.nabble.com] > Sent: Wednesday, July 19, 2017 6:13 PM > To: Marios Sofocleous/IT/CREDITSAFE > Subject: Re: Stored procedures on Apache Geode. > > Hi Marios- > > Regarding... > > *> Do you think this indeed will have a huge impact on the performance?* > > There are many factors that affect performance. A few things to consider > might be... > > 1. How well you planned and organized the data (e.g. partitioning strategy, > possible collocation). > 2. How large are the data entries. > 3. What type of queries you may be performing (which might be an important > factor in collocation, with the ability to run queries local to the node). > 4. What data management policies are in effect (e.g. eviction, expiration). > 5. What the logic in your SPs are doing and how effectively they can be > parallelized. > 6. etc. > > *> Is there any best practises for doing this or any demo you could provide > demonstrating this process?(SP to geode/gemfire functions)* > > I know of customers who have migrated or are migrating from a RDBMS to an > IMDG like Geode/GemFire, but I do not know the results of their work. I am > in R and not regularly exposed to that type of information. Others on > this list might have better information for you. > > Regards, > John > > > On Tue, Jul 18, 2017 at 10:59 PM, marios390 < > [hidden email]> wrote: > > > Hi John, > > > > As mentioned the other day, we are interested in lift all the stored > > procedures up into the > > cluster.Do<redir.aspx?REF=Pv4LR-a213jN-NELSbebdhQQ11M_ > Ab7asC9ITedw5Cv9II58t9nUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_ > Yz03NDIyJmQ9Z3ZmdjJiZEV2ek9Ub3NsLTJYX2RlY0FGd0Y0NDFEQWJWdjh2 > TDFSdDRBJnU9aHR0cCUzYSUyZiUyZmNsdXN0ZXIlMmVEbw..> you think this indeed > will have a huge impact on the > > performance? Is there any best practises for doing this or any demo you > > could provide demonstrating this process?(SP to geode/gemfire functions) > > I would really appreciate it if you could provide any material related to > > this. > > > > Thanks > > Marios > > > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > > [hidden email]] > > Sent: Friday, July 14, 2017 6:35 PM > > To: Marios Sofocleous/IT/CREDITSAFE > > Subject: Re: Stored procedures on Apache Geode. > > > > Hi Marios- > > > > I may not be the best person to answer this. There is a Pivotal GemFire > / > > Greenplum Connector available for download here... > > > > https://network.pivotal.io/products/pivotal-gemfire/#/< > redir.aspx?REF=zlKGb_nE7XEGmuoUFLjEyh3PFSlMkNxc4E- > 1GwecQR79II58t9nUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_ > Yz03NDIyJmQ9Z3ZmdjJiZEV2ek9Ub3NsLTJYX2RlY0FGd0Y0NDFEQWJWdmgz > S2dNeHRnJnU9aHR0cHMlM2ElMmYlMmZuZXR3b3JrJTJlcGl2b3RhbCUyZWlv > JTJmcHJvZHVjdHMlMmZwaXZvdGFsLWdlbWZpcmUlMmYlMjMlMmY.> > > releases/5376/file_groups/495<redir.aspx?REF=ePuj29pLHnEN- > > smbkFovlp6IgDkajN0nKt4CrX58E5K46E5Gas7UCAFodHRwOi8vc2Nhbm1ha > > WwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TE > > NHdk1HTXFNMXliTUZtU0xZV293d2dsYWNUMHJBJnU9aHR0cHMlM2ElMmYlMm > > ZuZXR3b3JrJTJlcGl2b3RhbCUyZWlvJTJmcHJvZHVjdHMlMmZwaXZvdGFsLW > > dlbWZpcmUlMmYlMjMlMmZyZWxlYXNlcyUyZjUzNzYlMmZmaWxlJTVmZ3JvdXBzJTJmNDk1> > > > > More information on the Connector can be found here... > > > >
RE: Stored procedures on Apache Geode.
Hi John, I am following you example for setting up geode cluster using annotation but getting a few errors. Do these annotations apply only for gemfire? Thanks Marios From: John Blum [via Apache Geode (Incubating) Developers Forum] [ml+s70738n2447...@n6.nabble.com] Sent: Wednesday, July 19, 2017 6:13 PM To: Marios Sofocleous/IT/CREDITSAFE Subject: Re: Stored procedures on Apache Geode. Hi Marios- Regarding... *> Do you think this indeed will have a huge impact on the performance?* There are many factors that affect performance. A few things to consider might be... 1. How well you planned and organized the data (e.g. partitioning strategy, possible collocation). 2. How large are the data entries. 3. What type of queries you may be performing (which might be an important factor in collocation, with the ability to run queries local to the node). 4. What data management policies are in effect (e.g. eviction, expiration). 5. What the logic in your SPs are doing and how effectively they can be parallelized. 6. etc. *> Is there any best practises for doing this or any demo you could provide demonstrating this process?(SP to geode/gemfire functions)* I know of customers who have migrated or are migrating from a RDBMS to an IMDG like Geode/GemFire, but I do not know the results of their work. I am in R and not regularly exposed to that type of information. Others on this list might have better information for you. Regards, John On Tue, Jul 18, 2017 at 10:59 PM, marios390 < [hidden email]> wrote: > Hi John, > > As mentioned the other day, we are interested in lift all the stored > procedures up into the > cluster.Do<redir.aspx?REF=Pv4LR-a213jN-NELSbebdhQQ11M_Ab7asC9ITedw5Cv9II58t9nUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9Z3ZmdjJiZEV2ek9Ub3NsLTJYX2RlY0FGd0Y0NDFEQWJWdjh2TDFSdDRBJnU9aHR0cCUzYSUyZiUyZmNsdXN0ZXIlMmVEbw..> > you think this indeed will have a huge impact on the > performance? Is there any best practises for doing this or any demo you > could provide demonstrating this process?(SP to geode/gemfire functions) > I would really appreciate it if you could provide any material related to > this. > > Thanks > Marios > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > [hidden email]] > Sent: Friday, July 14, 2017 6:35 PM > To: Marios Sofocleous/IT/CREDITSAFE > Subject: Re: Stored procedures on Apache Geode. > > Hi Marios- > > I may not be the best person to answer this. There is a Pivotal GemFire / > Greenplum Connector available for download here... > > https://network.pivotal.io/products/pivotal-gemfire/#/<redir.aspx?REF=zlKGb_nE7XEGmuoUFLjEyh3PFSlMkNxc4E-1GwecQR79II58t9nUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9Z3ZmdjJiZEV2ek9Ub3NsLTJYX2RlY0FGd0Y0NDFEQWJWdmgzS2dNeHRnJnU9aHR0cHMlM2ElMmYlMmZuZXR3b3JrJTJlcGl2b3RhbCUyZWlvJTJmcHJvZHVjdHMlMmZwaXZvdGFsLWdlbWZpcmUlMmYlMjMlMmY.> > releases/5376/file_groups/495<redir.aspx?REF=ePuj29pLHnEN- > smbkFovlp6IgDkajN0nKt4CrX58E5K46E5Gas7UCAFodHRwOi8vc2Nhbm1ha > WwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TE > NHdk1HTXFNMXliTUZtU0xZV293d2dsYWNUMHJBJnU9aHR0cHMlM2ElMmYlMm > ZuZXR3b3JrJTJlcGl2b3RhbCUyZWlvJTJmcHJvZHVjdHMlMmZwaXZvdGFsLW > dlbWZpcmUlMmYlMjMlMmZyZWxlYXNlcyUyZjUzNzYlMmZmaWxlJTVmZ3JvdXBzJTJmNDk1> > > More information on the Connector can be found here... > > http://ggc.docs.pivotal.io/ggc/relnotes/release_notes30.html<redir.aspx?REF=wdKqTVVJ1c8jl_Xw_KlYbN4GnC8uVGryblPpmgMMtl39II58t9nUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9Z3ZmdjJiZEV2ek9Ub3NsLTJYX2RlY0FGd0Y0NDFEQWJWdjhtZkFSbTVnJnU9aHR0cCUzYSUyZiUyZmdnYyUyZWRvY3MlMmVwaXZvdGFsJTJlaW8lMmZnZ2MlMmZyZWxub3RlcyUyZnJlbGVhc2UlNWZub3RlczMwJTJlaHRtbA..> > <redir.aspx?REF=IVeZQL0iyIj6DDR8gUm4MyheeHroZK > 7o1EZnK4vhJL646E5Gas7UCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_ > Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293d3dq > T0pPbHJnJnU9aHR0cCUzYSUyZiUyZmdnYyUyZWRvY3MlMmVwaXZvdGFsJTJl > aW8lMmZnZ2MlMmZyZWxub3RlcyUyZnJlbGVhc2UlNWZub3RlczMwJTJlaHRtbA..> > > As you may know, Apache Geode is the open source core of Pivotal GemFire ( > https://pivotal.io/pivotal-gemfire<redir.aspx?REF=HtAa4A841_z_RMAvmBV1lvxMH2k6fUb9gt-PzRfGlDL9II58t9nUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9Z3ZmdjJiZEV2ek9Ub3NsLTJYX2RlY0FGd0Y0NDFEQWJWdmgwS0ZkajVnJnU9aHR0cHMlM2ElMmYlMmZwaXZvdGFsJTJlaW8lMmZwaXZvdGFsLWdlbWZpcmU.><redir.aspx?REF= > avpjDplcz8GhyxNakFqKyxR0D7vFnF2EyHNgs3HhSye46E5Gas7UCAFodHRw > Oi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TE > NHdk1HTXFNMXliTUZtU0xZV293d3R4Yk1DZ3JnJnU9aHR0cHMlM2ElMmYlMm > ZwaXZvdGFsJTJlaW8lMmZwaXZvdGFsLWdlbWZpcmU.>). Theoretically, it probably > would/should work to connect Geode with Greenplum, though I have not don
Re: Stored procedures on Apache Geode.
Hi Marios- Regarding... *> Do you think this indeed will have a huge impact on the performance?* There are many factors that affect performance. A few things to consider might be... 1. How well you planned and organized the data (e.g. partitioning strategy, possible collocation). 2. How large are the data entries. 3. What type of queries you may be performing (which might be an important factor in collocation, with the ability to run queries local to the node). 4. What data management policies are in effect (e.g. eviction, expiration). 5. What the logic in your SPs are doing and how effectively they can be parallelized. 6. etc. *> Is there any best practises for doing this or any demo you could provide demonstrating this process?(SP to geode/gemfire functions)* I know of customers who have migrated or are migrating from a RDBMS to an IMDG like Geode/GemFire, but I do not know the results of their work. I am in R and not regularly exposed to that type of information. Others on this list might have better information for you. Regards, John On Tue, Jul 18, 2017 at 10:59 PM, marios390 < marios.sofocle...@creditsafe.com> wrote: > Hi John, > > As mentioned the other day, we are interested in lift all the stored > procedures up into the > cluster.Do you think this indeed will have a huge impact on the > performance? Is there any best practises for doing this or any demo you > could provide demonstrating this process?(SP to geode/gemfire functions) > I would really appreciate it if you could provide any material related to > this. > > Thanks > Marios > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > ml+s70738n24351...@n6.nabble.com] > Sent: Friday, July 14, 2017 6:35 PM > To: Marios Sofocleous/IT/CREDITSAFE > Subject: Re: Stored procedures on Apache Geode. > > Hi Marios- > > I may not be the best person to answer this. There is a Pivotal GemFire / > Greenplum Connector available for download here... > > https://network.pivotal.io/products/pivotal-gemfire/#/ > releases/5376/file_groups/495<redir.aspx?REF=ePuj29pLHnEN- > smbkFovlp6IgDkajN0nKt4CrX58E5K46E5Gas7UCAFodHRwOi8vc2Nhbm1ha > WwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TE > NHdk1HTXFNMXliTUZtU0xZV293d2dsYWNUMHJBJnU9aHR0cHMlM2ElMmYlMm > ZuZXR3b3JrJTJlcGl2b3RhbCUyZWlvJTJmcHJvZHVjdHMlMmZwaXZvdGFsLW > dlbWZpcmUlMmYlMjMlMmZyZWxlYXNlcyUyZjUzNzYlMmZmaWxlJTVmZ3JvdXBzJTJmNDk1> > > More information on the Connector can be found here... > > http://ggc.docs.pivotal.io/ggc/relnotes/release_notes30.html > <redir.aspx?REF=IVeZQL0iyIj6DDR8gUm4MyheeHroZK > 7o1EZnK4vhJL646E5Gas7UCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_ > Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293d3dq > T0pPbHJnJnU9aHR0cCUzYSUyZiUyZmdnYyUyZWRvY3MlMmVwaXZvdGFsJTJl > aW8lMmZnZ2MlMmZyZWxub3RlcyUyZnJlbGVhc2UlNWZub3RlczMwJTJlaHRtbA..> > > As you may know, Apache Geode is the open source core of Pivotal GemFire ( > https://pivotal.io/pivotal-gemfire<redir.aspx?REF= > avpjDplcz8GhyxNakFqKyxR0D7vFnF2EyHNgs3HhSye46E5Gas7UCAFodHRw > Oi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TE > NHdk1HTXFNMXliTUZtU0xZV293d3R4Yk1DZ3JnJnU9aHR0cHMlM2ElMmYlMm > ZwaXZvdGFsJTJlaW8lMmZwaXZvdGFsLWdlbWZpcmU.>). Theoretically, it probably > would/should work to connect Geode with Greenplum, though I have not done > this and I am not sure it is a combination Pivotal nor the Apache Geode > community supports. > > There is example of using this Connector with Geode here... > > https://github.com/mgoddard-pivotal/FraudDetection-wwko<redir.aspx?REF= > mhVyYn6hNXwW9OLdPgBcsVH6ty0EvvNRtbL2w9DhzRm46E5Gas7UCAFodHRw > Oi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TE > NHdk1HTXFNMXliTUZtU0xZV293dzBxUHBDa19nJnU9aHR0cHMlM2ElMmYlMm > ZnaXRodWIlMmVjb20lMmZtZ29kZGFyZC1waXZvdGFsJTJmRnJhdWREZXRlY3 > Rpb24td3drbw..> > > Which was the basis for this presentation/article... > > https://content.pivotal.io/blog/big-data-meets-fast-data- > to-fight-fraud-and-more<redir.aspx?REF=MNgakfneuwuvyGbKlC_n_8RoNoNblBha1c_ > FcCwMktO46E5Gas7UCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_ > Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293MXNt > T2NEem9nJnU9aHR0cHMlM2ElMmYlMmZjb250ZW50JTJlcGl2b3RhbCUyZWlv > JTJmYmxvZyUyZmJpZy1kYXRhLW1lZXRzLWZhc3QtZGF0YS10by1maWdodC1m > cmF1ZC1hbmQtbW9yZQ..> > > -j > > > > On Thu, Jul 13, 2017 at 11:33 PM, marios390 < > [hidden email]> wrote: > > > Hi John, > > > > Just a quick one, > > Geode could be integrated with green plum and if not what alternatives > for > > this. > > > > Thanks > > Ms > > > > From: John Blum [via Apache Geode (Incu
RE: Stored procedures on Apache Geode.
Hi John, As mentioned the other day, we are interested in lift all the stored procedures up into the cluster.Do you think this indeed will have a huge impact on the performance? Is there any best practises for doing this or any demo you could provide demonstrating this process?(SP to geode/gemfire functions) I would really appreciate it if you could provide any material related to this. Thanks Marios From: John Blum [via Apache Geode (Incubating) Developers Forum] [ml+s70738n24351...@n6.nabble.com] Sent: Friday, July 14, 2017 6:35 PM To: Marios Sofocleous/IT/CREDITSAFE Subject: Re: Stored procedures on Apache Geode. Hi Marios- I may not be the best person to answer this. There is a Pivotal GemFire / Greenplum Connector available for download here... https://network.pivotal.io/products/pivotal-gemfire/#/releases/5376/file_groups/495<redir.aspx?REF=ePuj29pLHnEN-smbkFovlp6IgDkajN0nKt4CrX58E5K46E5Gas7UCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293d2dsYWNUMHJBJnU9aHR0cHMlM2ElMmYlMmZuZXR3b3JrJTJlcGl2b3RhbCUyZWlvJTJmcHJvZHVjdHMlMmZwaXZvdGFsLWdlbWZpcmUlMmYlMjMlMmZyZWxlYXNlcyUyZjUzNzYlMmZmaWxlJTVmZ3JvdXBzJTJmNDk1> More information on the Connector can be found here... http://ggc.docs.pivotal.io/ggc/relnotes/release_notes30.html<redir.aspx?REF=IVeZQL0iyIj6DDR8gUm4MyheeHroZK7o1EZnK4vhJL646E5Gas7UCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293d3dqT0pPbHJnJnU9aHR0cCUzYSUyZiUyZmdnYyUyZWRvY3MlMmVwaXZvdGFsJTJlaW8lMmZnZ2MlMmZyZWxub3RlcyUyZnJlbGVhc2UlNWZub3RlczMwJTJlaHRtbA..> As you may know, Apache Geode is the open source core of Pivotal GemFire ( https://pivotal.io/pivotal-gemfire<redir.aspx?REF=avpjDplcz8GhyxNakFqKyxR0D7vFnF2EyHNgs3HhSye46E5Gas7UCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293d3R4Yk1DZ3JnJnU9aHR0cHMlM2ElMmYlMmZwaXZvdGFsJTJlaW8lMmZwaXZvdGFsLWdlbWZpcmU.>). Theoretically, it probably would/should work to connect Geode with Greenplum, though I have not done this and I am not sure it is a combination Pivotal nor the Apache Geode community supports. There is example of using this Connector with Geode here... https://github.com/mgoddard-pivotal/FraudDetection-wwko<redir.aspx?REF=mhVyYn6hNXwW9OLdPgBcsVH6ty0EvvNRtbL2w9DhzRm46E5Gas7UCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293dzBxUHBDa19nJnU9aHR0cHMlM2ElMmYlMmZnaXRodWIlMmVjb20lMmZtZ29kZGFyZC1waXZvdGFsJTJmRnJhdWREZXRlY3Rpb24td3drbw..> Which was the basis for this presentation/article... https://content.pivotal.io/blog/big-data-meets-fast-data-to-fight-fraud-and-more<redir.aspx?REF=MNgakfneuwuvyGbKlC_n_8RoNoNblBha1c_FcCwMktO46E5Gas7UCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293MXNtT2NEem9nJnU9aHR0cHMlM2ElMmYlMmZjb250ZW50JTJlcGl2b3RhbCUyZWlvJTJmYmxvZyUyZmJpZy1kYXRhLW1lZXRzLWZhc3QtZGF0YS10by1maWdodC1mcmF1ZC1hbmQtbW9yZQ..> -j On Thu, Jul 13, 2017 at 11:33 PM, marios390 < [hidden email]> wrote: > Hi John, > > Just a quick one, > Geode could be integrated with green plum and if not what alternatives for > this. > > Thanks > Ms > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > [hidden email]] > Sent: Thursday, July 13, 2017 11:33 PM > To: Marios Sofocleous/IT/CREDITSAFE > Subject: Re: Stored procedures on Apache Geode. > > Hi Marios- > > It seems you and your team could be / mostly are likely dealing with a > high-volume of sensitive information, but without knowing a lot about your > UC(s) or particular application requirements/SLAs, I would recommend > starting small, simple and scale based on need. > > Geode is a highly concurrent and distributed system with strong consistency > guarantees. Prematurely breaking the logic down into many individual > microservices early (especially for individual Stored Procedures... how > complex are these?) might unduly add complexity to your application and > system architecture. > > So my advice is to really evaluate the need to create individual > microservices first (which usually involves a platform like [Pivotal's] > CloudFoundry on an IaaS (or private infra) to manage effectively) vs. > starting small and just converting the Stored Procs into Geode Functions. > > Geode Function executions can be distributed across the cluster (similarly > to Map-Reduce, but far more robust) in a highly available and reliable > fashion. > > You might want to also read up on Geode's Partitioned Regions [1] for > effectively managing (parti
RE: Stored procedures on Apache Geode.
Thanks Micheal From: Michael Stolz [via Apache Geode (Incubating) Developers Forum] [ml+s70738n24402...@n6.nabble.com] Sent: Saturday, July 15, 2017 12:37 AM To: Marios Sofocleous/IT/CREDITSAFE Subject: Re: Stored procedures on Apache Geode. Pivotal provides a closed-source connector to link commercial GemFire to commercial Greenplum. Pivotal has no intention of opening that connector at this time. -- Mike Stolz Principal Engineer, GemFire Product Manager Mobile: +1-631-835-4771 On Fri, Jul 14, 2017 at 2:33 AM, marios390 <[hidden email] > wrote: > Hi John, > > Just a quick one, > Geode could be integrated with green plum and if not what alternatives for > this. > > Thanks > Ms > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > [hidden email]] > Sent: Thursday, July 13, 2017 11:33 PM > To: Marios Sofocleous/IT/CREDITSAFE > Subject: Re: Stored procedures on Apache Geode. > > Hi Marios- > > It seems you and your team could be / mostly are likely dealing with a > high-volume of sensitive information, but without knowing a lot about your > UC(s) or particular application requirements/SLAs, I would recommend > starting small, simple and scale based on need. > > Geode is a highly concurrent and distributed system with strong consistency > guarantees. Prematurely breaking the logic down into many individual > microservices early (especially for individual Stored Procedures... how > complex are these?) might unduly add complexity to your application and > system architecture. > > So my advice is to really evaluate the need to create individual > microservices first (which usually involves a platform like [Pivotal's] > CloudFoundry on an IaaS (or private infra) to manage effectively) vs. > starting small and just converting the Stored Procs into Geode Functions. > > Geode Function executions can be distributed across the cluster (similarly > to Map-Reduce, but far more robust) in a highly available and reliable > fashion. > > You might want to also read up on Geode's Partitioned Regions [1] for > effectively managing (partitioning and distributing/arranging your data). > > Hope this helps. > > -John > > [1] > http://gemfire90.docs.pivotal.io/geode/developing/<redir.aspx?REF=4kbgXrAZhKXhMwF3XACsydIxZ4uN_lz7bgaIkg4XqHVL_nsvmcvUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9cDducDJlejlqUlpOSWJpblppTWxSc0w3S0RrdDdCV3BzMDE3V25qOHRRJnU9aHR0cCUzYSUyZiUyZmdlbWZpcmU5MCUyZWRvY3MlMmVwaXZvdGFsJTJlaW8lMmZnZW9kZSUyZmRldmVsb3BpbmclMmY.> > partitioned_regions/chapter_overview.html<redir.aspx?REF= > yrjldnY3TtixZu9rDvLgvAx0M0bPn0iR_AzXTlMikrJPQ7v4gcrUCAFodHRwOi8 > vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9aXRubjJWd0otbE1xQm > NKbU01T3Q1RU1ZSHRrUWgyc1E4Q08zemVsZjZnJnU9aHR0cCUzYSUyZiUyZm > dlbWZpcmU5MCUyZWRvY3MlMmVwaXZvdGFsJTJlaW8lMmZnZW9kZSUyZmRldm > Vsb3BpbmclMmZwYXJ0aXRpb25lZCU1ZnJlZ2lvbnMlMmZjaGFwdGVyJTVmb3 > ZlcnZpZXclMmVodG1s> > > > On Thu, Jul 13, 2017 at 1:09 PM, marios390 <[hidden > email] > > wrote: > > > > > ________ > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > > [hidden email]] > > Sent: Thursday, July 13, 2017 9:16 PM > > To: Marios Sofocleous/IT/CREDITSAFE > > Subject: Re: Stored procedures on Apache Geode. > > > > Right. > > > > You can also review the Apache Geode documentation on Function Execution > > [1]. And if you are a *Spring* user, you can use *Spring Data Geode's* > > convenient Function annotation support for both Function implementation > as > > well as execution, here [2]. > > > > NOTE: you will probably notice the link [2] refers to *Spring Data > > GemFire's* docs. *Spring Data GemFire* and *Spring Data Geode* are > > virtually the same with no differences. Eventually *Spring Data Geode* > > will have its own home with its own doc locations since it is finally > > becoming a top-level SD module [3]. > > > > -j > > > > [1] > > http://geode.apache.org/docs/guide/11/developing/function_<redir.aspx?REF=a7X8rghwBgDiacfImDi14yQHEQfEdYRGn9LNC31vbzFL_nsvmcvUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9cDducDJlejlqUlpOSWJpblppTWxSc0w3S0RrdDdCV3BzeFo2Q251dHNBJnU9aHR0cCUzYSUyZiUyZmdlb2RlJTJlYXBhY2hlJTJlb3JnJTJmZG9jcyUyZmd1aWRlJTJmMTElMmZkZXZlbG9waW5nJTJmZnVuY3Rpb24lNWY.>< > redir.aspx?REF=9WC8AmXblm4Q_zDPwbP3MZWeTU5A8b8TcK6A7zAo07x > PQ7v4gcrUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_ > Yz03NDIyJmQ9aXRubjJWd0otbE1xQmNKbU01T3Q1RU1ZSHRrUWgyc1E4QzIx > bWVsWTd3JnU9aHR0cCUzYSUyZiUyZmdlb2RlJTJlYXBhY2hlJTJlb3JnJTJm > ZG9jcyUyZmd1aWRlJTJmMTElMmZkZXZlbG9waW5nJTJmZnVuY3Rpb24l
Re: Stored procedures on Apache Geode.
Pivotal provides a closed-source connector to link commercial GemFire to commercial Greenplum. Pivotal has no intention of opening that connector at this time. -- Mike Stolz Principal Engineer, GemFire Product Manager Mobile: +1-631-835-4771 On Fri, Jul 14, 2017 at 2:33 AM, marios390 <marios.sofocle...@creditsafe.com > wrote: > Hi John, > > Just a quick one, > Geode could be integrated with green plum and if not what alternatives for > this. > > Thanks > Ms > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > ml+s70738n24325...@n6.nabble.com] > Sent: Thursday, July 13, 2017 11:33 PM > To: Marios Sofocleous/IT/CREDITSAFE > Subject: Re: Stored procedures on Apache Geode. > > Hi Marios- > > It seems you and your team could be / mostly are likely dealing with a > high-volume of sensitive information, but without knowing a lot about your > UC(s) or particular application requirements/SLAs, I would recommend > starting small, simple and scale based on need. > > Geode is a highly concurrent and distributed system with strong consistency > guarantees. Prematurely breaking the logic down into many individual > microservices early (especially for individual Stored Procedures... how > complex are these?) might unduly add complexity to your application and > system architecture. > > So my advice is to really evaluate the need to create individual > microservices first (which usually involves a platform like [Pivotal's] > CloudFoundry on an IaaS (or private infra) to manage effectively) vs. > starting small and just converting the Stored Procs into Geode Functions. > > Geode Function executions can be distributed across the cluster (similarly > to Map-Reduce, but far more robust) in a highly available and reliable > fashion. > > You might want to also read up on Geode's Partitioned Regions [1] for > effectively managing (partitioning and distributing/arranging your data). > > Hope this helps. > > -John > > [1] > http://gemfire90.docs.pivotal.io/geode/developing/ > partitioned_regions/chapter_overview.html<redir.aspx?REF= > yrjldnY3TtixZu9rDvLgvAx0M0bPn0iR_AzXTlMikrJPQ7v4gcrUCAFodHRwOi8 > vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9aXRubjJWd0otbE1xQm > NKbU01T3Q1RU1ZSHRrUWgyc1E4Q08zemVsZjZnJnU9aHR0cCUzYSUyZiUyZm > dlbWZpcmU5MCUyZWRvY3MlMmVwaXZvdGFsJTJlaW8lMmZnZW9kZSUyZmRldm > Vsb3BpbmclMmZwYXJ0aXRpb25lZCU1ZnJlZ2lvbnMlMmZjaGFwdGVyJTVmb3 > ZlcnZpZXclMmVodG1s> > > > On Thu, Jul 13, 2017 at 1:09 PM, marios390 <[hidden > email] > > wrote: > > > > > ____ > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > > [hidden email]] > > Sent: Thursday, July 13, 2017 9:16 PM > > To: Marios Sofocleous/IT/CREDITSAFE > > Subject: Re: Stored procedures on Apache Geode. > > > > Right. > > > > You can also review the Apache Geode documentation on Function Execution > > [1]. And if you are a *Spring* user, you can use *Spring Data Geode's* > > convenient Function annotation support for both Function implementation > as > > well as execution, here [2]. > > > > NOTE: you will probably notice the link [2] refers to *Spring Data > > GemFire's* docs. *Spring Data GemFire* and *Spring Data Geode* are > > virtually the same with no differences. Eventually *Spring Data Geode* > > will have its own home with its own doc locations since it is finally > > becoming a top-level SD module [3]. > > > > -j > > > > [1] > > http://geode.apache.org/docs/guide/11/developing/function_< > redir.aspx?REF=9WC8AmXblm4Q_zDPwbP3MZWeTU5A8b8TcK6A7zAo07x > PQ7v4gcrUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_ > Yz03NDIyJmQ9aXRubjJWd0otbE1xQmNKbU01T3Q1RU1ZSHRrUWgyc1E4QzIx > bWVsWTd3JnU9aHR0cCUzYSUyZiUyZmdlb2RlJTJlYXBhY2hlJTJlb3JnJTJm > ZG9jcyUyZmd1aWRlJTJmMTElMmZkZXZlbG9waW5nJTJmZnVuY3Rpb24lNWY.> > > exec/chapter_overview.html<http://scanmail.trustwave.com/?c=7422= > <redir.aspx?REF=mdjxxKeYg0Z0Du5sr2nWD1qB35-j5d3fyiHT-Wg_ > keRPQ7v4gcrUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9> > > j7nn2bxZOwcngUOelB5ZmyW7oHpBqfFPnKkha5eWJQ=http%3a%2f% > > 2fgeode%2eapache%2eorg%2fdocs%2fguide%2f11%2fdeveloping% > > 2ffunction%5fexec%2fchapter%5foverview%2ehtml> > > [2] > > http://docs.spring.io/spring-data-gemfire/docs/current/<redir.aspx?REF= > FeI05aGSUMelSXs5C8eNCYF4w7WOQTrcPuikgbSqvPtPQ7v4gcrUCAFodHRw > Oi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9aXRubjJWd0otbE1xQm > NKbU01T3Q1RU1ZSHRrUWgyc1E4SExsbmJ0ZTZnJnU9aHR0cCUzYSUyZiUyZm > RvY3MlMmVzcHJpbmclMmVpbyUyZnNwcmluZy1kYXRhL
RE: Stored procedures on Apache Geode.
Hi John, Thank you very much for all this information. I will check it out. Appreciate it!. Thanks MS From: John Blum [via Apache Geode (Incubating) Developers Forum] [ml+s70738n24351...@n6.nabble.com] Sent: Friday, July 14, 2017 6:35 PM To: Marios Sofocleous/IT/CREDITSAFE Subject: Re: Stored procedures on Apache Geode. Hi Marios- I may not be the best person to answer this. There is a Pivotal GemFire / Greenplum Connector available for download here... https://network.pivotal.io/products/pivotal-gemfire/#/releases/5376/file_groups/495<redir.aspx?REF=oIwYai00t1vPmw1y3tLoHwos0ixYHOau3kvAjiWYsVH09UIy7crUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293d2dsYWNUMHJBJnU9aHR0cHMlM2ElMmYlMmZuZXR3b3JrJTJlcGl2b3RhbCUyZWlvJTJmcHJvZHVjdHMlMmZwaXZvdGFsLWdlbWZpcmUlMmYlMjMlMmZyZWxlYXNlcyUyZjUzNzYlMmZmaWxlJTVmZ3JvdXBzJTJmNDk1> More information on the Connector can be found here... http://ggc.docs.pivotal.io/ggc/relnotes/release_notes30.html<redir.aspx?REF=8L5OAhQF95I0VRmU0kBfh2iXSozQSrj93N1bNaW55Mn09UIy7crUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293d3dqT0pPbHJnJnU9aHR0cCUzYSUyZiUyZmdnYyUyZWRvY3MlMmVwaXZvdGFsJTJlaW8lMmZnZ2MlMmZyZWxub3RlcyUyZnJlbGVhc2UlNWZub3RlczMwJTJlaHRtbA..> As you may know, Apache Geode is the open source core of Pivotal GemFire ( https://pivotal.io/pivotal-gemfire<redir.aspx?REF=BHu12u9T5Qug5wpMadlpIRkoOxWwSzVrEYBtRZPjVSb09UIy7crUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293d3R4Yk1DZ3JnJnU9aHR0cHMlM2ElMmYlMmZwaXZvdGFsJTJlaW8lMmZwaXZvdGFsLWdlbWZpcmU.>). Theoretically, it probably would/should work to connect Geode with Greenplum, though I have not done this and I am not sure it is a combination Pivotal nor the Apache Geode community supports. There is example of using this Connector with Geode here... https://github.com/mgoddard-pivotal/FraudDetection-wwko<redir.aspx?REF=_JYZPKHU63W5fGP9Pn1KTJc0nPQsfFd_rM5-vc9KZ7309UIy7crUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293dzBxUHBDa19nJnU9aHR0cHMlM2ElMmYlMmZnaXRodWIlMmVjb20lMmZtZ29kZGFyZC1waXZvdGFsJTJmRnJhdWREZXRlY3Rpb24td3drbw..> Which was the basis for this presentation/article... https://content.pivotal.io/blog/big-data-meets-fast-data-to-fight-fraud-and-more<redir.aspx?REF=gAeXJe05w3VY-IB7O1KUpnR7dHZhyBiYLblVgRKDypP09UIy7crUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293MXNtT2NEem9nJnU9aHR0cHMlM2ElMmYlMmZjb250ZW50JTJlcGl2b3RhbCUyZWlvJTJmYmxvZyUyZmJpZy1kYXRhLW1lZXRzLWZhc3QtZGF0YS10by1maWdodC1mcmF1ZC1hbmQtbW9yZQ..> -j On Thu, Jul 13, 2017 at 11:33 PM, marios390 < [hidden email]> wrote: > Hi John, > > Just a quick one, > Geode could be integrated with green plum and if not what alternatives for > this. > > Thanks > Ms > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > [hidden email]] > Sent: Thursday, July 13, 2017 11:33 PM > To: Marios Sofocleous/IT/CREDITSAFE > Subject: Re: Stored procedures on Apache Geode. > > Hi Marios- > > It seems you and your team could be / mostly are likely dealing with a > high-volume of sensitive information, but without knowing a lot about your > UC(s) or particular application requirements/SLAs, I would recommend > starting small, simple and scale based on need. > > Geode is a highly concurrent and distributed system with strong consistency > guarantees. Prematurely breaking the logic down into many individual > microservices early (especially for individual Stored Procedures... how > complex are these?) might unduly add complexity to your application and > system architecture. > > So my advice is to really evaluate the need to create individual > microservices first (which usually involves a platform like [Pivotal's] > CloudFoundry on an IaaS (or private infra) to manage effectively) vs. > starting small and just converting the Stored Procs into Geode Functions. > > Geode Function executions can be distributed across the cluster (similarly > to Map-Reduce, but far more robust) in a highly available and reliable > fashion. > > You might want to also read up on Geode's Partitioned Regions [1] for > effectively managing (partitioning and distributing/arranging your data). > > Hope this helps. > > -John > > [1] > http://gemfire90.docs.pivotal.io/geode/developing/<redir.aspx?REF=WCFSrMasI2YAeGMcF0Km3sV_jBnlYBPuYTymRh05y4j09UIy7crUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9MS1UbzJSR211OUx2TENHdk1HTXFNMXliTUZtU0xZV293d3NrTzVhal9BJnU9aHR0cCUzYSUyZiUyZmdlbWZpcmU5MCUyZWRvY3MlMmVwaXZvdGFsJTJlaW8lMmZnZW9kZSUyZmRldmVsb3BpbmclMmY.> > partit
Re: Stored procedures on Apache Geode.
Hi Marios- I may not be the best person to answer this. There is a Pivotal GemFire / Greenplum Connector available for download here... https://network.pivotal.io/products/pivotal-gemfire/#/releases/5376/file_groups/495 More information on the Connector can be found here... http://ggc.docs.pivotal.io/ggc/relnotes/release_notes30.html As you may know, Apache Geode is the open source core of Pivotal GemFire ( https://pivotal.io/pivotal-gemfire). Theoretically, it probably would/should work to connect Geode with Greenplum, though I have not done this and I am not sure it is a combination Pivotal nor the Apache Geode community supports. There is example of using this Connector with Geode here... https://github.com/mgoddard-pivotal/FraudDetection-wwko Which was the basis for this presentation/article... https://content.pivotal.io/blog/big-data-meets-fast-data-to-fight-fraud-and-more -j On Thu, Jul 13, 2017 at 11:33 PM, marios390 < marios.sofocle...@creditsafe.com> wrote: > Hi John, > > Just a quick one, > Geode could be integrated with green plum and if not what alternatives for > this. > > Thanks > Ms > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > ml+s70738n24325...@n6.nabble.com] > Sent: Thursday, July 13, 2017 11:33 PM > To: Marios Sofocleous/IT/CREDITSAFE > Subject: Re: Stored procedures on Apache Geode. > > Hi Marios- > > It seems you and your team could be / mostly are likely dealing with a > high-volume of sensitive information, but without knowing a lot about your > UC(s) or particular application requirements/SLAs, I would recommend > starting small, simple and scale based on need. > > Geode is a highly concurrent and distributed system with strong consistency > guarantees. Prematurely breaking the logic down into many individual > microservices early (especially for individual Stored Procedures... how > complex are these?) might unduly add complexity to your application and > system architecture. > > So my advice is to really evaluate the need to create individual > microservices first (which usually involves a platform like [Pivotal's] > CloudFoundry on an IaaS (or private infra) to manage effectively) vs. > starting small and just converting the Stored Procs into Geode Functions. > > Geode Function executions can be distributed across the cluster (similarly > to Map-Reduce, but far more robust) in a highly available and reliable > fashion. > > You might want to also read up on Geode's Partitioned Regions [1] for > effectively managing (partitioning and distributing/arranging your data). > > Hope this helps. > > -John > > [1] > http://gemfire90.docs.pivotal.io/geode/developing/ > partitioned_regions/chapter_overview.html<redir.aspx?REF= > yrjldnY3TtixZu9rDvLgvAx0M0bPn0iR_AzXTlMikrJPQ7v4gcrUCAFodHRwOi8 > vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9aXRubjJWd0otbE1xQm > NKbU01T3Q1RU1ZSHRrUWgyc1E4Q08zemVsZjZnJnU9aHR0cCUzYSUyZiUyZm > dlbWZpcmU5MCUyZWRvY3MlMmVwaXZvdGFsJTJlaW8lMmZnZW9kZSUyZmRldm > Vsb3BpbmclMmZwYXJ0aXRpb25lZCU1ZnJlZ2lvbnMlMmZjaGFwdGVyJTVmb3 > ZlcnZpZXclMmVodG1s> > > > On Thu, Jul 13, 2017 at 1:09 PM, marios390 <[hidden > email] > > wrote: > > > > > ____ > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > > [hidden email]] > > Sent: Thursday, July 13, 2017 9:16 PM > > To: Marios Sofocleous/IT/CREDITSAFE > > Subject: Re: Stored procedures on Apache Geode. > > > > Right. > > > > You can also review the Apache Geode documentation on Function Execution > > [1]. And if you are a *Spring* user, you can use *Spring Data Geode's* > > convenient Function annotation support for both Function implementation > as > > well as execution, here [2]. > > > > NOTE: you will probably notice the link [2] refers to *Spring Data > > GemFire's* docs. *Spring Data GemFire* and *Spring Data Geode* are > > virtually the same with no differences. Eventually *Spring Data Geode* > > will have its own home with its own doc locations since it is finally > > becoming a top-level SD module [3]. > > > > -j > > > > [1] > > http://geode.apache.org/docs/guide/11/developing/function_< > redir.aspx?REF=9WC8AmXblm4Q_zDPwbP3MZWeTU5A8b8TcK6A7zAo07x > PQ7v4gcrUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_ > Yz03NDIyJmQ9aXRubjJWd0otbE1xQmNKbU01T3Q1RU1ZSHRrUWgyc1E4QzIx > bWVsWTd3JnU9aHR0cCUzYSUyZiUyZmdlb2RlJTJlYXBhY2hlJTJlb3JnJTJm > ZG9jcyUyZmd1aWRlJTJmMTElMmZkZXZlbG9waW5nJTJmZnVuY3Rpb24lNWY.> > > exec/chapter_overview.html<http://scanmail.trustwave.com/?c=7422= > &
RE: Stored procedures on Apache Geode.
Hi John, Thank you so much for your advise. I will go through the links you provided and get back to you if I have a question. I really appreciate it! Marios From: John Blum [via Apache Geode (Incubating) Developers Forum] [ml+s70738n24325...@n6.nabble.com] Sent: Thursday, July 13, 2017 11:33 PM To: Marios Sofocleous/IT/CREDITSAFE Subject: Re: Stored procedures on Apache Geode. Hi Marios- It seems you and your team could be / mostly are likely dealing with a high-volume of sensitive information, but without knowing a lot about your UC(s) or particular application requirements/SLAs, I would recommend starting small, simple and scale based on need. Geode is a highly concurrent and distributed system with strong consistency guarantees. Prematurely breaking the logic down into many individual microservices early (especially for individual Stored Procedures... how complex are these?) might unduly add complexity to your application and system architecture. So my advice is to really evaluate the need to create individual microservices first (which usually involves a platform like [Pivotal's] CloudFoundry on an IaaS (or private infra) to manage effectively) vs. starting small and just converting the Stored Procs into Geode Functions. Geode Function executions can be distributed across the cluster (similarly to Map-Reduce, but far more robust) in a highly available and reliable fashion. You might want to also read up on Geode's Partitioned Regions [1] for effectively managing (partitioning and distributing/arranging your data). Hope this helps. -John [1] http://gemfire90.docs.pivotal.io/geode/developing/partitioned_regions/chapter_overview.html<redir.aspx?REF=gFqPp2E5UhB3bUqxuBpEqI2rkvk0WJItDehpfwXC9CqiFSrKMcrUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9aXRubjJWd0otbE1xQmNKbU01T3Q1RU1ZSHRrUWgyc1E4Q08zemVsZjZnJnU9aHR0cCUzYSUyZiUyZmdlbWZpcmU5MCUyZWRvY3MlMmVwaXZvdGFsJTJlaW8lMmZnZW9kZSUyZmRldmVsb3BpbmclMmZwYXJ0aXRpb25lZCU1ZnJlZ2lvbnMlMmZjaGFwdGVyJTVmb3ZlcnZpZXclMmVodG1s> On Thu, Jul 13, 2017 at 1:09 PM, marios390 <[hidden email] > wrote: > > > From: John Blum [via Apache Geode (Incubating) Developers Forum] [ > [hidden email]] > Sent: Thursday, July 13, 2017 9:16 PM > To: Marios Sofocleous/IT/CREDITSAFE > Subject: Re: Stored procedures on Apache Geode. > > Right. > > You can also review the Apache Geode documentation on Function Execution > [1]. And if you are a *Spring* user, you can use *Spring Data Geode's* > convenient Function annotation support for both Function implementation as > well as execution, here [2]. > > NOTE: you will probably notice the link [2] refers to *Spring Data > GemFire's* docs. *Spring Data GemFire* and *Spring Data Geode* are > virtually the same with no differences. Eventually *Spring Data Geode* > will have its own home with its own doc locations since it is finally > becoming a top-level SD module [3]. > > -j > > [1] > http://geode.apache.org/docs/guide/11/developing/function_<redir.aspx?REF=ptfC_qtB9SCjPCoxs3_yn9f2NIVd-BWtXYpmbZUg8VuiFSrKMcrUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9aXRubjJWd0otbE1xQmNKbU01T3Q1RU1ZSHRrUWgyc1E4QzIxbWVsWTd3JnU9aHR0cCUzYSUyZiUyZmdlb2RlJTJlYXBhY2hlJTJlb3JnJTJmZG9jcyUyZmd1aWRlJTJmMTElMmZkZXZlbG9waW5nJTJmZnVuY3Rpb24lNWY.> > exec/chapter_overview.html<http://scanmail.trustwave.com/?c=7422=<redir.aspx?REF=LBGGXPqh5q8HDTW7cH8e8eiHgtc5lqSLKngJ-8eZk42iFSrKMcrUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9> > j7nn2bxZOwcngUOelB5ZmyW7oHpBqfFPnKkha5eWJQ=http%3a%2f% > 2fgeode%2eapache%2eorg%2fdocs%2fguide%2f11%2fdeveloping% > 2ffunction%5fexec%2fchapter%5foverview%2ehtml> > [2] > http://docs.spring.io/spring-data-gemfire/docs/current/<redir.aspx?REF=OlLWx3tU1V_NinctPy4DmUVc9YtZKkOukobDfIi_OrSiFSrKMcrUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9aXRubjJWd0otbE1xQmNKbU01T3Q1RU1ZSHRrUWgyc1E4SExsbmJ0ZTZnJnU9aHR0cCUzYSUyZiUyZmRvY3MlMmVzcHJpbmclMmVpbyUyZnNwcmluZy1kYXRhLWdlbWZpcmUlMmZkb2NzJTJmY3VycmVudCUyZg..> > reference/html/#function-annotations<http://scanmail<redir.aspx?REF=lRLIbfydcIuDZ72f3Rc385nAEECyr9K5Ham6lpe1I5uiFSrKMcrUCAFodHRwOi8vc2Nhbm1haWw.>. > trustwave.com/?c=7422=j7nn2bxZOwcngUOelB5ZmyW7oHpBqf<redir.aspx?REF=Aj9Xtlmq4PvZE3u43doygrY7CRBMs5CeXbzeQ0PzjLiiFSrKMcrUCAFodHRwOi8vc2Nhbm1haWwudHJ1c3R3YXZlLmNvbS8_Yz03NDIyJmQ9aXRubjJWd0otbE1xQmNKbU01T3Q1RU1ZSHRrUWgyc1E4SGV6bUwwRTd3JnU9aHR0cCUzYSUyZiUyZnRydXN0d2F2ZSUyZWNvbSUyZiUzZmMlM2Q3NDIyJTI2YW1wJTNiZCUzZGo3bm4yYnhaT3djbmdVT2VsQjVabXlXN29IcEJxZg..> > FPnPsrbJ3BIQ=http%3a%2f%2fdocs%2espring%2eio%2fspring- > data-gemfire%2fdocs%2fcurrent%2freference%2fhtml%2f%23function-annotations > > > [3] > http://projects.spring.io/spring-data/<redir.aspx?REF=oYTJQHmJMeYIMvFTaIFapXUJc8FNgR2zERqx6iSSq1iiFSrKMcrUCAFodHRwOi8vc2N
RE: Stored procedures on Apache Geode.
From: John Blum [via Apache Geode (Incubating) Developers Forum] [ml+s70738n24312...@n6.nabble.com] Sent: Thursday, July 13, 2017 9:16 PM To: Marios Sofocleous/IT/CREDITSAFE Subject: Re: Stored procedures on Apache Geode. Right. You can also review the Apache Geode documentation on Function Execution [1]. And if you are a *Spring* user, you can use *Spring Data Geode's* convenient Function annotation support for both Function implementation as well as execution, here [2]. NOTE: you will probably notice the link [2] refers to *Spring Data GemFire's* docs. *Spring Data GemFire* and *Spring Data Geode* are virtually the same with no differences. Eventually *Spring Data Geode* will have its own home with its own doc locations since it is finally becoming a top-level SD module [3]. -j [1] http://geode.apache.org/docs/guide/11/developing/function_exec/chapter_overview.html<http://scanmail.trustwave.com/?c=7422=j7nn2bxZOwcngUOelB5ZmyW7oHpBqfFPnKkha5eWJQ=http%3a%2f%2fgeode%2eapache%2eorg%2fdocs%2fguide%2f11%2fdeveloping%2ffunction%5fexec%2fchapter%5foverview%2ehtml> [2] http://docs.spring.io/spring-data-gemfire/docs/current/reference/html/#function-annotations<http://scanmail.trustwave.com/?c=7422=j7nn2bxZOwcngUOelB5ZmyW7oHpBqfFPnPsrbJ3BIQ=http%3a%2f%2fdocs%2espring%2eio%2fspring-data-gemfire%2fdocs%2fcurrent%2freference%2fhtml%2f%23function-annotations> [3] http://projects.spring.io/spring-data/<http://scanmail.trustwave.com/?c=7422=j7nn2bxZOwcngUOelB5ZmyW7oHpBqfFPnPshbJGVdw=http%3a%2f%2fprojects%2espring%2eio%2fspring-data%2f> On Thu, Jul 13, 2017 at 6:04 AM, Anthony Baker <[hidden email]> wrote: > A geode Function is conceptually similar to a stored proc but the > implementation is different. It's a java class that would use geode apis to > execute logic within the cluster. > > Anthony > > > On Jul 12, 2017, at 11:13 PM, marios390 <marios.sofocleous@creditsafe. > com> wrote: > > > > Hi, > > > > I noticed that Apache Geode supports stored procedures as functions > running > > on nodes. > > Could you please elaborate on that since I am confused a little a bit. > > Can I run for example Oracle SP directly on cache servers (nodes) or do I > > have to transform them somehow into microservices ( i.e spring boot) > which > > expose functions on nodes. > > > > > > > > -- > > View this message in context: http://apache-geode- > incubating-developers-forum.70738.x6.nabble.com/Stored-<http://scanmail.trustwave.com/?c=7422=j7nn2bxZOwcngUOelB5ZmyW7oHpBqfFPnPUhb5PCJw=http%3a%2f%2fincubating-developers-forum%2e70738%2ex6%2enabble%2ecom%2fStored-> > procedures-on-Apache-Geode-tp24279.html > > Sent from the Apache Geode (Incubating) Developers Forum mailing list > archive at > Nabble.com.<http://scanmail.trustwave.com/?c=7422=j7nn2bxZOwcngUOelB5ZmyW7oHpBqfFPnPR_aZzGKg=http%3a%2f%2fNabble%2ecom> > Hi John I really appreciate it for getting back to me. I will check it out. We are basically having a bunch of stored procedures and thinking to create as many microservices as the SPs in order to load them in geode. I know that this makes nosense. How would you suggest resolving this? -- -John john.blum10101 (skype) ____________ If you reply to this email, your message will be added to the discussion below: http://apache-geode-incubating-developers-forum.70738.x6.nabble.com/Stored-procedures-on-Apache-Geode-tp24279p24312.html<http://scanmail.trustwave.com/?c=7422=j7nn2bxZOwcngUOelB5ZmyW7oHpBqfFPnPUub5LDIw=http%3a%2f%2fapache-geode-incubating-developers-forum%2e70738%2ex6%2enabble%2ecom%2fStored-procedures-on-Apache-Geode-tp24279p24312%2ehtml> To unsubscribe from Stored procedures on Apache Geode., click here<http://scanmail.trustwave.com/?c=7422=j7nn2bxZOwcngUOelB5ZmyW7oHpBqfFPnKwhaJ3DIA=http%3a%2f%2fapache-geode-incubating-developers-forum%2e70738%2ex6%2enabble%2ecom%2ftemplate%2fNamlServlet%2ejtp%3fmacro%3dunsubscribe%5fby%5fcode%26node%3d24279%26code%3dbWFyaW9zLnNvZm9jbGVvdXNAY3JlZGl0c2FmZS5jb218MjQyNzl8MTczMDMwODYwMA%3d%3d>. NAML<http://scanmail.trustwave.com/?c=7422=j7nn2bxZOwcngUOelB5ZmyW7oHpBqfFPnPggOJ3DJQ=http%3a%2f%2fapache-geode-incubating-developers-forum%2e70738%2ex6%2enabble%2ecom%2ftemplate%2fNamlServlet%2ejtp%3fmacro%3dmacro%5fviewer%26id%3dinstant%5fhtml%2521nabble%253Aemail%2enaml%26base%3dnabble%2enaml%2enamespaces%2eBasicNamespace-nabble%2eview%2eweb%2etemplate%2eNabbleNamespace-nabble%2eview%2eweb%2etemplate%2eNodeNamespace%26breadcrumbs%3dnotify%5fsubscribers%2521nabble%253Aemail%2enaml-instant%5femails%2521nabble%253Aemail%2enaml-send%5finstant%5femail%2521nabble%253Aemail%2enaml> Notes: Terms and Conditions: 'All quotes, offers, contracts and agreements verbal or written are subject to our Standard Terms and Conditions as display
Re: Stored procedures on Apache Geode.
A geode Function is conceptually similar to a stored proc but the implementation is different. It's a java class that would use geode apis to execute logic within the cluster. Anthony > On Jul 12, 2017, at 11:13 PM, marios390 <marios.sofocle...@creditsafe.com> > wrote: > > Hi, > > I noticed that Apache Geode supports stored procedures as functions running > on nodes. > Could you please elaborate on that since I am confused a little a bit. > Can I run for example Oracle SP directly on cache servers (nodes) or do I > have to transform them somehow into microservices ( i.e spring boot) which > expose functions on nodes. > > > > -- > View this message in context: > http://apache-geode-incubating-developers-forum.70738.x6.nabble.com/Stored-procedures-on-Apache-Geode-tp24279.html > Sent from the Apache Geode (Incubating) Developers Forum mailing list archive > at Nabble.com.
Stored procedures on Apache Geode.
Hi, I noticed that Apache Geode supports stored procedures as functions running on nodes. Could you please elaborate on that since I am confused a little a bit. Can I run for example Oracle SP directly on cache servers (nodes) or do I have to transform them somehow into microservices ( i.e spring boot) which expose functions on nodes. -- View this message in context: http://apache-geode-incubating-developers-forum.70738.x6.nabble.com/Stored-procedures-on-Apache-Geode-tp24279.html Sent from the Apache Geode (Incubating) Developers Forum mailing list archive at Nabble.com.
