Re: Delete performance
Is there an example of how to do that? I cannot find any sample code that does a delete using the streamer other than the ds.remove(). On Tue, Jul 2, 2019 at 4:22 AM Ilya Kasnacheev wrote: > Hello! > > You can have a custom StreamReceiver that will remove entries from cache. > It's a pity we don't ship it by default. > > Regards, > -- > Ilya Kasnacheev > > > пн, 1 июл. 2019 г. в 23:32, Mike Needham : > >> Hi All, >> >> I have a cache that has approx 2 million records and is stored as a >> queryable object (SQL). What is the fastest way to perform deletes on this >> cache? I have been using a SqlFielsQuery to issue a SQL delete statement >> but that seems to be very slow? I add/update using a dataStreamer, is >> there some equivalent for deletes? >> >> Thanks in advance >> >> -- >> *Don't be afraid to be wrong. Don't be afraid to admit you don't have all >> the answers. Don't be afraid to say "I think" instead of "I know."* >> > -- *Don't be afraid to be wrong. Don't be afraid to admit you don't have all the answers. Don't be afraid to say "I think" instead of "I know."*
Delete performance
Hi All, I have a cache that has approx 2 million records and is stored as a queryable object (SQL). What is the fastest way to perform deletes on this cache? I have been using a SqlFielsQuery to issue a SQL delete statement but that seems to be very slow? I add/update using a dataStreamer, is there some equivalent for deletes? Thanks in advance -- *Don't be afraid to be wrong. Don't be afraid to admit you don't have all the answers. Don't be afraid to say "I think" instead of "I know."*
Re: Trouble with continuous queries
My next hurdle is to get a remote listener from .NET working to the cache On Thu, May 30, 2019 at 1:47 PM Mike Needham wrote: > I was able to figure this out. Was missing > the ignite.events().localListen(lsnr, EVT_CACHE_OBJECT_PUT); > > On Thu, May 30, 2019 at 12:43 PM Mike Needham wrote: > >> But does ignite fire the ignite >> event EventType.EVT_CACHE_OBJECT_PUT, EventType.EVT_CACHE_OBJECT_READ >> and EventType.EVT_CACHE_OBJECT_REMOVED >> >> On Thu, May 30, 2019 at 12:18 PM Alexandr Shapkin >> wrote: >> >>> Hi, yes, it should work that way. >>> >>> I was able to caught all events event with the raw SQL using this DBeaver >>> https://apacheignite-sql.readme.io/docs/sql-tooling >>> >>> >>> >>> >>> >>> -- >>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >>> >> >> >> -- >> *Don't be afraid to be wrong. Don't be afraid to admit you don't have all >> the answers. Don't be afraid to say "I think" instead of "I know."* >> > > > -- > *Don't be afraid to be wrong. Don't be afraid to admit you don't have all > the answers. Don't be afraid to say "I think" instead of "I know."* > -- *Don't be afraid to be wrong. Don't be afraid to admit you don't have all the answers. Don't be afraid to say "I think" instead of "I know."*
Re: Trouble with continuous queries
I was able to figure this out. Was missing the ignite.events().localListen(lsnr, EVT_CACHE_OBJECT_PUT); On Thu, May 30, 2019 at 12:43 PM Mike Needham wrote: > But does ignite fire the ignite > event EventType.EVT_CACHE_OBJECT_PUT, EventType.EVT_CACHE_OBJECT_READ > and EventType.EVT_CACHE_OBJECT_REMOVED > > On Thu, May 30, 2019 at 12:18 PM Alexandr Shapkin > wrote: > >> Hi, yes, it should work that way. >> >> I was able to caught all events event with the raw SQL using this DBeaver >> https://apacheignite-sql.readme.io/docs/sql-tooling >> >> >> >> >> >> -- >> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >> > > > -- > *Don't be afraid to be wrong. Don't be afraid to admit you don't have all > the answers. Don't be afraid to say "I think" instead of "I know."* > -- *Don't be afraid to be wrong. Don't be afraid to admit you don't have all the answers. Don't be afraid to say "I think" instead of "I know."*
Re: Trouble with continuous queries
But does ignite fire the ignite event EventType.EVT_CACHE_OBJECT_PUT, EventType.EVT_CACHE_OBJECT_READ and EventType.EVT_CACHE_OBJECT_REMOVED On Thu, May 30, 2019 at 12:18 PM Alexandr Shapkin wrote: > Hi, yes, it should work that way. > > I was able to caught all events event with the raw SQL using this DBeaver > https://apacheignite-sql.readme.io/docs/sql-tooling > > > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ > -- *Don't be afraid to be wrong. Don't be afraid to admit you don't have all the answers. Don't be afraid to say "I think" instead of "I know."*
Re: Trouble with continuous queries
Do cache events fire when using SQL to update tables? My app is listening to a queue for json payloads that have the INS/UPD/DEL: for the cache entries. They are updated using SQL over the respective caches. On Wed, May 29, 2019 at 8:14 AM Mike Needham wrote: > I have tried various things, but it never fires for a change in the > cache. that is why I do not think it is set-up correctly > > > On Tue, May 28, 2019 at 9:30 AM Alexandr Shapkin > wrote: > >> Hi, >> >> You can just save an instance of continuous query somewhere and dispose it >> when required >> >> >> var listener = new SomeListener(); >> var someFilter= new >> CacheEntryEventFilter(_ignite.GetCluster().GetLocalNode(), >> Const.CacheName); >> var query = new ContinuousQuery(listener, someFilter); >> >>//save the reference in a private field >> _continuousQuery = cache.QueryContinuous(query); >> >> >> Regardless of a cache value. >> As I understand correctly you have a mixed platform solution (Java + .NET) >> This may lead to additional marshalling configuration. >> >> I will try the posted solution a bit later and reply >> >> >> >> >> -- >> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >> > > > -- > *Don't be afraid to be wrong. Don't be afraid to admit you don't have all > the answers. Don't be afraid to say "I think" instead of "I know."* > -- *Don't be afraid to be wrong. Don't be afraid to admit you don't have all the answers. Don't be afraid to say "I think" instead of "I know."*
Re: Trouble with continuous queries
I have tried various things, but it never fires for a change in the cache. that is why I do not think it is set-up correctly On Tue, May 28, 2019 at 9:30 AM Alexandr Shapkin wrote: > Hi, > > You can just save an instance of continuous query somewhere and dispose it > when required > > > var listener = new SomeListener(); > var someFilter= new > CacheEntryEventFilter(_ignite.GetCluster().GetLocalNode(), > Const.CacheName); > var query = new ContinuousQuery(listener, someFilter); > >//save the reference in a private field > _continuousQuery = cache.QueryContinuous(query); > > > Regardless of a cache value. > As I understand correctly you have a mixed platform solution (Java + .NET) > This may lead to additional marshalling configuration. > > I will try the posted solution a bit later and reply > > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ > -- *Don't be afraid to be wrong. Don't be afraid to admit you don't have all the answers. Don't be afraid to say "I think" instead of "I know."*
Re: Trouble with continuous queries
private const string CacheName = "EXCHANGE";
static void Main(string[] args)
{
using (var ignite =
Ignition.Start("E:\\ignite\\apache-ignite-2.7.0-src\\examples\\config\\example-igniteClient.xml"))
{
{
var cacheCfg = new CacheConfiguration
{
Name = CacheName, //"port2",
SqlSchema = "EXCHANGE"
};
ICache exchCache =
ignite.GetOrCreateCache(cacheCfg);
ICollection cacheNames = ignite.GetCacheNames();
string qry = "SELECT * from EXCHANGE.EXCHANGE;";
SqlFieldsQuery qry23 = new SqlFieldsQuery(qry);
var result2 = exchCache.Query(qry23).GetAll();
var qryr = new ContinuousQuery(new
Listener());
using (exchCache.QueryContinuous(qryr))
{
while (true)
{
Thread.Sleep(2000);
}
}
Console.WriteLine();
Console.WriteLine(">>> Example finished, press any key
to exit ...");
Console.ReadKey();
}
}
}
private class Listener : ICacheEntryEventListener
{
public void OnEvent(IEnumerable>
events)
{
foreach (var e in events)
Console.WriteLine("Queried entry [key=" + e.Key + ",
val=" + e.Value + ']');
}
}
On Wed, May 22, 2019 at 3:29 AM Denis Mekhanikov
wrote:
> Mike,
>
> Could you show the code, that you use to register the continuous query?
> Maybe there is some misconfiguration?
>
> Denis
>
> пн, 20 мая 2019 г. в 17:47, Mike Needham :
>
>> Hi All,
>>
>> I have a cache that is running and is defined as
>> IgniteCache exchCache =
>> ignite.getOrCreateCache(new CacheConfiguration<>("EXCHANGE")
>> .setIndexedTypes(Long.class, Exchange.class)
>> .setAtomicityMode(CacheAtomicityMode.ATOMIC)
>> .setBackups(0)
>> );
>>
>> from a dotnet client how can I get a continuous query so that I am
>> notified of the changes to the cache? I can access the cache VIA DBeaver
>> and other sql tools.
>>
>> the documentation does not make it clear how to set this up. I want ALL
>> changes to the cache to be sent to the client. The DOTNET example does not
>> appear to work for this scenario. It is using a simple for
>> cache. I have tried but it does not appear to ever be
>> notified of events
>>
>> On Tue, May 14, 2019 at 10:55 AM Denis Mekhanikov
>> wrote:
>>
>>> Mike,
>>>
>>> First of all, it's recommended to have a separate cache per table to
>>> avoid storing of objects of different types in the same cache.
>>>
>>> Continuous query receives all updates on the cache regardless of their
>>> type. Local listener is invoked when new events happen. Existing records
>>> can be processed using initial query.
>>>
>>> Refer to the following documentation page for more information:
>>> https://apacheignite.readme.io/docs/continuous-queries
>>>
>>> Denis
>>>
>>> чт, 2 мая 2019 г. в 14:14, Mike Needham :
>>>
>>>> I have seen that example, what I do not understand is I have two SQL
>>>> tables in a cache that has n number of nodes. it is loaded ahead of time
>>>> and a client wants to be notified when the contents of the cache are
>>>> changed. Do you have to have the continuous query in a never ending loop
>>>> to not have it end? All the examples are simply using ContinuousQuery<
>>>> Integer, String>. my example uses which is a
>>>> java class defining the structure. do I just set-up a
>>>> ContinuousQuery
>>>>
>>>> On Thu, May 2, 2019 at 3:59 AM aealexsandrov
>>>> wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> The good example of how it can be done you can see here:
>>>>>
>>>>>
>>>>> https://github.com/gridgain/gridgain-advanced-examples/blob/master/src/main/java/org/gridgain/examples/datagrid/query/ContinuousQueryExample.java
>>>>>
>>>>> You can set remote listener to handle changes on remote nodes and local
>>>>> listers for current.
>>>>>
>>>&
Re: Trouble with continuous queries
Hi All,
I have a cache that is running and is defined as
IgniteCache exchCache =
ignite.getOrCreateCache(new CacheConfiguration<>("EXCHANGE")
.setIndexedTypes(Long.class, Exchange.class)
.setAtomicityMode(CacheAtomicityMode.ATOMIC)
.setBackups(0)
);
from a dotnet client how can I get a continuous query so that I am notified
of the changes to the cache? I can access the cache VIA DBeaver and other
sql tools.
the documentation does not make it clear how to set this up. I want ALL
changes to the cache to be sent to the client. The DOTNET example does not
appear to work for this scenario. It is using a simple for
cache. I have tried but it does not appear to ever be
notified of events
On Tue, May 14, 2019 at 10:55 AM Denis Mekhanikov
wrote:
> Mike,
>
> First of all, it's recommended to have a separate cache per table to avoid
> storing of objects of different types in the same cache.
>
> Continuous query receives all updates on the cache regardless of their
> type. Local listener is invoked when new events happen. Existing records
> can be processed using initial query.
>
> Refer to the following documentation page for more information:
> https://apacheignite.readme.io/docs/continuous-queries
>
> Denis
>
> чт, 2 мая 2019 г. в 14:14, Mike Needham :
>
>> I have seen that example, what I do not understand is I have two SQL
>> tables in a cache that has n number of nodes. it is loaded ahead of time
>> and a client wants to be notified when the contents of the cache are
>> changed. Do you have to have the continuous query in a never ending loop
>> to not have it end? All the examples are simply using ContinuousQuery<
>> Integer, String>. my example uses which is a java
>> class defining the structure. do I just set-up a ContinuousQuery> Exchange.class>
>>
>> On Thu, May 2, 2019 at 3:59 AM aealexsandrov
>> wrote:
>>
>>> Hi,
>>>
>>> The good example of how it can be done you can see here:
>>>
>>>
>>> https://github.com/gridgain/gridgain-advanced-examples/blob/master/src/main/java/org/gridgain/examples/datagrid/query/ContinuousQueryExample.java
>>>
>>> You can set remote listener to handle changes on remote nodes and local
>>> listers for current.
>>>
>>> Note that you will get the updates only until ContinuousQuery will not be
>>> closed or until the node that starts it will not left the cluster.
>>>
>>> Also, you can try to use CacheEvents like in example here:
>>>
>>> https://apacheignite.readme.io/docs/events#section-remote-events
>>>
>>> Note that events can affect your performance.
>>>
>>> BR,
>>> Andrei
>>>
>>>
>>>
>>>
>>>
>>> --
>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>
>>
>>
>> --
>> *Don't be afraid to be wrong. Don't be afraid to admit you don't have all
>> the answers. Don't be afraid to say "I think" instead of "I know."*
>>
>
--
*Don't be afraid to be wrong. Don't be afraid to admit you don't have all
the answers. Don't be afraid to say "I think" instead of "I know."*
Re: Trouble with continuous queries
I have seen that example, what I do not understand is I have two SQL tables in a cache that has n number of nodes. it is loaded ahead of time and a client wants to be notified when the contents of the cache are changed. Do you have to have the continuous query in a never ending loop to not have it end? All the examples are simply using ContinuousQuery. my example uses which is a java class defining the structure. do I just set-up a ContinuousQuery On Thu, May 2, 2019 at 3:59 AM aealexsandrov wrote: > Hi, > > The good example of how it can be done you can see here: > > > https://github.com/gridgain/gridgain-advanced-examples/blob/master/src/main/java/org/gridgain/examples/datagrid/query/ContinuousQueryExample.java > > You can set remote listener to handle changes on remote nodes and local > listers for current. > > Note that you will get the updates only until ContinuousQuery will not be > closed or until the node that starts it will not left the cluster. > > Also, you can try to use CacheEvents like in example here: > > https://apacheignite.readme.io/docs/events#section-remote-events > > Note that events can affect your performance. > > BR, > Andrei > > > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ > -- *Don't be afraid to be wrong. Don't be afraid to admit you don't have all the answers. Don't be afraid to say "I think" instead of "I know."*
Trouble with continuous queries
Hi All,
I have a setup that is creating a cache with two SQL tables in it. I am
able to update the cache and now want to have a client use the continuous
queries to be notified of any changes to the cache.
the cache is using the default config and has the cache defined as
IgniteCache testCache = ignite.getOrCreateCache(new
CacheConfiguration<>("MAIN")
.setIndexedTypes(Long.class, SecurityExchanges.class)
.setIndexedTypes(Long.class, Exchange.class)
.setIndexedTypes(Long.class, Department.class)
.setAtomicityMode(CacheAtomicityMode.ATOMIC)
.setBackups(0)
);
Once the data is loaded and I update a value, how can a client listen to
this to get updates?
Thanks in advance
--
*Don't be afraid to be wrong. Don't be afraid to admit you don't have all
the answers. Don't be afraid to say "I think" instead of "I know."*
Listen for cache changes
Hi All, I have a cache that has 3 SQL tables in it. There is a loop that listens to a queue that has json strings on it that represent changes to the underlying cache tables. These are applied to the cache via INSERT/UPDATE/Delete SQL statements. How can I have Events triggered off of this so that people can listen to those events to know when the cache has been updated? -- *Don't be afraid to be wrong. Don't be afraid to admit you don't have all the answers. Don't be afraid to say "I think" instead of "I know."*
How to use UPDATE statement and set value to NULL
I am trying to figure out how to set a cache value to a NULL. The update
is coming through and I am doing the following:
String sql =
"UPDATE MAIN.EXCHANGE" +
" SET LEGACYXRID = ?" +
" ,EXCHANGENAME = ?" +
" ,EXCHANGEMIC = ?" +
" ,EXCHANGEOPERATINGMIC = ?" +
" WHERE EXCHANGEXRID = ?;";
//Object x = map.get("ExchangeXRID");
testCache.query(new
SqlFieldsQuery(sql).setArgs(LegacyIDNode.asLong(),ExchNameNode.asText(),ExchMicNode.asText(),ExchOperatingMicNode.asText(),ExIDNode.asLong()));
The update succeeds but I am getting the word null instead of a NULL value
the cache. What is the best way to pass the NULL in the update?
--
*Don't be afraid to be wrong. Don't be afraid to admit you don't have all
the answers. Don't be afraid to say "I think" instead of "I know."*
Re: Access a cache loaded by DataStreamer with SQL
I guess I am not understanding how to build this for multiple tables in a
cache that can be loaded using the datastreamer and are queryable from
DBeaver or tableau.
I changed the code to be
IgniteCache testCache =
ignite.getOrCreateCache(new CacheConfiguration<>("MAIN")
.setIndexedTypes(Long.class, Employee.class)
.setIndexedTypes(Long.class, Department.class)
);
Employee e = new Employee(1, "Test", 123.34f, 3);
try (IgniteDataStreamer ds =
ignite.dataStreamer("MAIN")) {
ds.addData(1l, e);
}
Department d = new Department(1, "Main", 12, 3);
try (IgniteDataStreamer ds2 =
ignite.dataStreamer("MAIN")) {
ds2.addData(1l, d);
}
which created the two in the cache, but does not load anything to the
department table.
On Wed, Mar 20, 2019 at 10:01 AM Ilya Kasnacheev
wrote:
> Hello!
>
> I don't understand what you are doing here. Why do you have two employee
> tables here? What is desired table structure?
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> ср, 20 мар. 2019 г. в 16:44, Mike Needham :
>
>> I have that part, what I dont understand is how I can create multiple
>> "Tables" within a Cache(Schema)? I have the following code that is using a
>> simple Employee Class.
>>
>> IgniteCache testCache =
>> ignite.getOrCreateCache(new CacheConfiguration<>("MAIN")
>> .setIndexedTypes(Long.class, Employee.class)
>> .setQueryEntities(Collections.singleton(
>> new QueryEntity(Integer.class,
>> String.class).setTableName("EMPLOYEE";
>> Employee e = new Employee(1, "Test", 123.34f, 3);
>> try (IgniteDataStreamer ds =
>> ignite.dataStreamer("MAIN")) {
>> ds.addData(1l, e);
>> }
>>
>> how would one go about adding a second "Table" to the MAIN cache so that
>> it is queryable from DBeaver or other tools?
>>
>>
>> On Wed, Mar 20, 2019 at 4:29 AM Ilya Kasnacheev <
>> ilya.kasnach...@gmail.com> wrote:
>>
>>> Hello!
>>>
>>> Please take a look at
>>> https://apacheignite.readme.io/docs/cache-queries#section-query-configuration-by-annotations
>>>
>>> Regards,
>>> --
>>> Ilya Kasnacheev
>>>
>>>
>>> вт, 19 мар. 2019 г. в 20:25, Mike Needham :
>>>
>>>> Do you have an example of how that could be done. I am struggling to
>>>> figure out how to set this up.
>>>>
>>>> On Mon, Mar 18, 2019 at 2:00 AM Ilya Kasnacheev <
>>>> ilya.kasnach...@gmail.com> wrote:
>>>>
>>>>> Hello!
>>>>>
>>>>> The best approach is to use .setIndexedTypes() instead of
>>>>> setQueryEntities(), and annotate complex types in question with
>>>>> @QuerySqlField.
>>>>> This way you can then pour those types into cache and it will work
>>>>> transparently.
>>>>>
>>>>> Regards,
>>>>> --
>>>>> Ilya Kasnacheev
>>>>>
>>>>>
>>>>> пт, 15 мар. 2019 г. в 18:28, Mike Needham :
>>>>>
>>>>>> Perfect, now the next question is how would you do this for a more
>>>>>> complex object/table? Either one defined in a separate object or via SQL
>>>>>> DDL?
>>>>>>
>>>>>> On Fri, Mar 15, 2019 at 9:05 AM Ilya Kasnacheev <
>>>>>> ilya.kasnach...@gmail.com> wrote:
>>>>>>
>>>>>>> Hello!
>>>>>>>
>>>>>>> You will have to specify schema name (or cache name?) in ALLCAPS
>>>>>>> when creating cache.
>>>>>>>
>>>>>>> Regards,
>>>>>>> --
>>>>>>> Ilya Kasnacheev
>>>>>>>
>>>>>>>
>>>>>>> пт, 15 мар. 2019 г. в 16:45, Mike Needham :
>>>>>>>
>>>>>>>> I see. did not have the "person" for the schema. Is there a way
>>>>>>>> to not have the quotes around that?
>>>>>>>>
>>>>>>>> On Fri, Mar 15, 2019 at 7:59 AM ilya.kasnacheev <
>>>>>>>> ilya.kasnach...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hello!
>>>>>>>>>
>>>>>>>>> Definitely works for me in DBeaver with this exact code:
>>>>>>>>>
>>>>>>>>> <
>>>>>>>>> http://apache-ignite-users.70518.x6.nabble.com/file/t1312/dbeaver-tables.png>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Some of DBeaver's introspection does not work but statements are
>>>>>>>>> solid.
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> *Some days it just not worth chewing through the restraints*
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Some days it just not worth chewing through the restraints*
>>>>>>
>>>>>
>>>>
>>>> --
>>>> *Some days it just not worth chewing through the restraints*
>>>>
>>>
>>
>> --
>> *Some days it just not worth chewing through the restraints*
>>
>
--
*Some days it just not worth chewing through the restraints*
Re: Access a cache loaded by DataStreamer with SQL
I have that part, what I dont understand is how I can create multiple
"Tables" within a Cache(Schema)? I have the following code that is using a
simple Employee Class.
IgniteCache testCache =
ignite.getOrCreateCache(new CacheConfiguration<>("MAIN")
.setIndexedTypes(Long.class, Employee.class)
.setQueryEntities(Collections.singleton(
new QueryEntity(Integer.class,
String.class).setTableName("EMPLOYEE";
Employee e = new Employee(1, "Test", 123.34f, 3);
try (IgniteDataStreamer ds =
ignite.dataStreamer("MAIN")) {
ds.addData(1l, e);
}
how would one go about adding a second "Table" to the MAIN cache so that it
is queryable from DBeaver or other tools?
On Wed, Mar 20, 2019 at 4:29 AM Ilya Kasnacheev
wrote:
> Hello!
>
> Please take a look at
> https://apacheignite.readme.io/docs/cache-queries#section-query-configuration-by-annotations
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> вт, 19 мар. 2019 г. в 20:25, Mike Needham :
>
>> Do you have an example of how that could be done. I am struggling to
>> figure out how to set this up.
>>
>> On Mon, Mar 18, 2019 at 2:00 AM Ilya Kasnacheev <
>> ilya.kasnach...@gmail.com> wrote:
>>
>>> Hello!
>>>
>>> The best approach is to use .setIndexedTypes() instead of
>>> setQueryEntities(), and annotate complex types in question with
>>> @QuerySqlField.
>>> This way you can then pour those types into cache and it will work
>>> transparently.
>>>
>>> Regards,
>>> --
>>> Ilya Kasnacheev
>>>
>>>
>>> пт, 15 мар. 2019 г. в 18:28, Mike Needham :
>>>
>>>> Perfect, now the next question is how would you do this for a more
>>>> complex object/table? Either one defined in a separate object or via SQL
>>>> DDL?
>>>>
>>>> On Fri, Mar 15, 2019 at 9:05 AM Ilya Kasnacheev <
>>>> ilya.kasnach...@gmail.com> wrote:
>>>>
>>>>> Hello!
>>>>>
>>>>> You will have to specify schema name (or cache name?) in ALLCAPS when
>>>>> creating cache.
>>>>>
>>>>> Regards,
>>>>> --
>>>>> Ilya Kasnacheev
>>>>>
>>>>>
>>>>> пт, 15 мар. 2019 г. в 16:45, Mike Needham :
>>>>>
>>>>>> I see. did not have the "person" for the schema. Is there a way to
>>>>>> not have the quotes around that?
>>>>>>
>>>>>> On Fri, Mar 15, 2019 at 7:59 AM ilya.kasnacheev <
>>>>>> ilya.kasnach...@gmail.com> wrote:
>>>>>>
>>>>>>> Hello!
>>>>>>>
>>>>>>> Definitely works for me in DBeaver with this exact code:
>>>>>>>
>>>>>>> <
>>>>>>> http://apache-ignite-users.70518.x6.nabble.com/file/t1312/dbeaver-tables.png>
>>>>>>>
>>>>>>>
>>>>>>> Some of DBeaver's introspection does not work but statements are
>>>>>>> solid.
>>>>>>>
>>>>>>> Regards,
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Some days it just not worth chewing through the restraints*
>>>>>>
>>>>>
>>>>
>>>> --
>>>> *Some days it just not worth chewing through the restraints*
>>>>
>>>
>>
>> --
>> *Some days it just not worth chewing through the restraints*
>>
>
--
*Some days it just not worth chewing through the restraints*
Re: Access a cache loaded by DataStreamer with SQL
Do you have an example of how that could be done. I am struggling to figure out how to set this up. On Mon, Mar 18, 2019 at 2:00 AM Ilya Kasnacheev wrote: > Hello! > > The best approach is to use .setIndexedTypes() instead of > setQueryEntities(), and annotate complex types in question with > @QuerySqlField. > This way you can then pour those types into cache and it will work > transparently. > > Regards, > -- > Ilya Kasnacheev > > > пт, 15 мар. 2019 г. в 18:28, Mike Needham : > >> Perfect, now the next question is how would you do this for a more >> complex object/table? Either one defined in a separate object or via SQL >> DDL? >> >> On Fri, Mar 15, 2019 at 9:05 AM Ilya Kasnacheev < >> ilya.kasnach...@gmail.com> wrote: >> >>> Hello! >>> >>> You will have to specify schema name (or cache name?) in ALLCAPS when >>> creating cache. >>> >>> Regards, >>> -- >>> Ilya Kasnacheev >>> >>> >>> пт, 15 мар. 2019 г. в 16:45, Mike Needham : >>> >>>> I see. did not have the "person" for the schema. Is there a way to >>>> not have the quotes around that? >>>> >>>> On Fri, Mar 15, 2019 at 7:59 AM ilya.kasnacheev < >>>> ilya.kasnach...@gmail.com> wrote: >>>> >>>>> Hello! >>>>> >>>>> Definitely works for me in DBeaver with this exact code: >>>>> >>>>> < >>>>> http://apache-ignite-users.70518.x6.nabble.com/file/t1312/dbeaver-tables.png> >>>>> >>>>> >>>>> Some of DBeaver's introspection does not work but statements are solid. >>>>> >>>>> Regards, >>>>> >>>>> >>>>> >>>>> -- >>>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >>>>> >>>> >>>> >>>> -- >>>> *Some days it just not worth chewing through the restraints* >>>> >>> >> >> -- >> *Some days it just not worth chewing through the restraints* >> > -- *Some days it just not worth chewing through the restraints*
Re: Access a cache loaded by DataStreamer with SQL
Perfect, now the next question is how would you do this for a more complex object/table? Either one defined in a separate object or via SQL DDL? On Fri, Mar 15, 2019 at 9:05 AM Ilya Kasnacheev wrote: > Hello! > > You will have to specify schema name (or cache name?) in ALLCAPS when > creating cache. > > Regards, > -- > Ilya Kasnacheev > > > пт, 15 мар. 2019 г. в 16:45, Mike Needham : > >> I see. did not have the "person" for the schema. Is there a way to not >> have the quotes around that? >> >> On Fri, Mar 15, 2019 at 7:59 AM ilya.kasnacheev < >> ilya.kasnach...@gmail.com> wrote: >> >>> Hello! >>> >>> Definitely works for me in DBeaver with this exact code: >>> >>> < >>> http://apache-ignite-users.70518.x6.nabble.com/file/t1312/dbeaver-tables.png> >>> >>> >>> Some of DBeaver's introspection does not work but statements are solid. >>> >>> Regards, >>> >>> >>> >>> -- >>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >>> >> >> >> -- >> *Some days it just not worth chewing through the restraints* >> > -- *Some days it just not worth chewing through the restraints*
Re: Access a cache loaded by DataStreamer with SQL
I see. did not have the "person" for the schema. Is there a way to not have the quotes around that? On Fri, Mar 15, 2019 at 7:59 AM ilya.kasnacheev wrote: > Hello! > > Definitely works for me in DBeaver with this exact code: > > < > http://apache-ignite-users.70518.x6.nabble.com/file/t1312/dbeaver-tables.png> > > > Some of DBeaver's introspection does not work but statements are solid. > > Regards, > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ > -- *Some days it just not worth chewing through the restraints*
Re: Access a cache loaded by DataStreamer with SQL
OK, that appears to be part of the way, but they caches are not queryable
from any SQL tools like Tableau or DBeaver. What am i missing?
On Fri, Mar 15, 2019 at 5:29 AM Ilya Kasnacheev
wrote:
> Hello!
>
> Yes, I understand your confusuion here.
>
> Take a look at following elaborate snippet:
>
> package org.apache.ignite.examples;
> import java.util.Collections;
> import java.util.LinkedHashMap;
> import org.apache.ignite.Ignite;
> import org.apache.ignite.IgniteCache;
> import org.apache.ignite.IgniteDataStreamer;
> import org.apache.ignite.Ignition;
> import org.apache.ignite.cache.QueryEntity;
> import org.apache.ignite.cache.query.SqlFieldsQuery;
> import org.apache.ignite.configuration.CacheConfiguration;
>
> public class LoadTableWithDataStreamer {
> public static void main(String[] args) {
> try (Ignite ignite = Ignition.start()) {
> IgniteCache personCache =
> ignite.getOrCreateCache(new CacheConfiguration<>("person")
> .setQueryEntities(Collections.singleton(
> new QueryEntity(Integer.class,
> String.class).setTableName("person_table";
>
> IgniteCache placeCache =
> ignite.getOrCreateCache(new CacheConfiguration<>("place")
> .setQueryEntities(Collections.singleton(
> new QueryEntity(Integer.class,
> String.class).setTableName("place_table")
> // more decoration
> .setKeyFieldName("id").setValueFieldName("name")
> .setFields(new LinkedHashMap() {{
> // Note that extending LinkedHashMap isn't
> production-ready
> put("id", Integer.class.getCanonicalName());
> put("name", String.class.getCanonicalName());
> }};
>
> try (IgniteDataStreamer ds =
> ignite.dataStreamer("person")) {
> ds.addData(1, "John");
> }
>
> try (IgniteDataStreamer ds =
> ignite.dataStreamer("place")) {
> ds.addData(1, "Siberia");
> }
>
> System.err.println("Query result");
> personCache.query(new SqlFieldsQuery("select _key, _val from
> person_table")).getAll().forEach(System.err::println);
>
> // refer to different cache's table
> personCache.query(new SqlFieldsQuery("select id, name from
> \"place\".place_table")).getAll().forEach(System.err::println);
> }
> }
> }
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> чт, 14 мар. 2019 г. в 22:59, Mike Needham :
>
>> Hi,
>>
>> Here is the code I am using
>>
>> package org.apache.ignite.examples;
>> import java.util.Collections;
>> import org.apache.ignite.Ignite;
>> import org.apache.ignite.IgniteCache;
>> import org.apache.ignite.IgniteDataStreamer;
>> import org.apache.ignite.Ignition;
>> import org.apache.ignite.cache.QueryEntity;
>> import org.apache.ignite.cache.query.SqlFieldsQuery;
>> import org.apache.ignite.configuration.CacheConfiguration;
>> import org.apache.ignite.configuration.IgniteConfiguration;
>>
>> public class LoadTableWithDataStreamer {
>> public static void main(String[] args) {
>> try (Ignite ignite =
>> Ignition.start("E:\\ignite\\apache-ignite-2.7.0-src\\examples\\config\\example-ignite.xml"))
>> {
>> IgniteCache personCache =
>> ignite.getOrCreateCache(new CacheConfiguration<>("PUBLIC")
>> .setQueryEntities(Collections.singleton(
>> new QueryEntity(Integer.class,
>> String.class).setTableName("person_table";
>>
>> IgniteCache placeCache =
>> ignite.getOrCreateCache(new CacheConfiguration<>("PUBLIC")
>> .setQueryEntities(Collections.singleton(
>> new QueryEntity(Integer.class,
>> String.class).setTableName("place_table";
>> try (IgniteDataStreamer ds =
>> ignite.dataStreamer("person")) {
>> ds.addData(1, "John");
>> }
>>
>> System.err.println("Query result");
>> personCache.query(new SqlFieldsQuery("select * from
>> person_table")).getAll().forEach(System.err::println);
>> }
>> }
>> }
>>
>> I want to create to queryable tables that I can load
Re: Access a cache loaded by DataStreamer with SQL
Hi,
Here is the code I am using
package org.apache.ignite.examples;
import java.util.Collections;
import org.apache.ignite.Ignite;
import org.apache.ignite.IgniteCache;
import org.apache.ignite.IgniteDataStreamer;
import org.apache.ignite.Ignition;
import org.apache.ignite.cache.QueryEntity;
import org.apache.ignite.cache.query.SqlFieldsQuery;
import org.apache.ignite.configuration.CacheConfiguration;
import org.apache.ignite.configuration.IgniteConfiguration;
public class LoadTableWithDataStreamer {
public static void main(String[] args) {
try (Ignite ignite =
Ignition.start("E:\\ignite\\apache-ignite-2.7.0-src\\examples\\config\\example-ignite.xml"))
{
IgniteCache personCache =
ignite.getOrCreateCache(new CacheConfiguration<>("PUBLIC")
.setQueryEntities(Collections.singleton(
new QueryEntity(Integer.class,
String.class).setTableName("person_table";
IgniteCache placeCache =
ignite.getOrCreateCache(new CacheConfiguration<>("PUBLIC")
.setQueryEntities(Collections.singleton(
new QueryEntity(Integer.class,
String.class).setTableName("place_table";
try (IgniteDataStreamer ds =
ignite.dataStreamer("person")) {
ds.addData(1, "John");
}
System.err.println("Query result");
personCache.query(new SqlFieldsQuery("select * from
person_table")).getAll().forEach(System.err::println);
}
}
}
I want to create to queryable tables that I can load using the data
streamer. The config is the default config in the java examples
On Mon, Mar 11, 2019 at 3:06 AM Ilya Kasnacheev
wrote:
> Hello!
>
> Can you perhaps post your config and code? Much easier than writing my own
> boilerplate.
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> пт, 8 мар. 2019 г. в 00:36, Mike Needham :
>
>> Would it be possible for someone to provide a sample that uses the
>> DataStreamer for multiple large caches and the resulting caches are
>> queryable from ODBC tools like Tableau and DBeaver? I can get one to work,
>> but cannot get the cache naming to work for a second one.
>>
>> On Thu, Mar 7, 2019 at 7:53 AM Ilya Kasnacheev
>> wrote:
>>
>>> Hello!
>>>
>>> JDBC with SET STREAMING ON should work reasonably well. You could also
>>> use CacheStore.
>>>
>>> With .Net I guess you will have to stick to DataStreamer & learn how to
>>> integrate it with Indexing properly. Or use JDBC from .Net.
>>>
>>> Regards,
>>> --
>>> Ilya Kasnacheev
>>>
>>>
>>> чт, 7 мар. 2019 г. в 16:31, Mike Needham :
>>>
>>>> Is that the most efficient way to load millions of rows from a database
>>>> table into a cache? I guess I am not seeing how this would work for
>>>> millions of rows in the source database. That also appears to be a JAVA
>>>> only solution and it would be preferable to have it be usable for .NET as
>>>> well as java and hopefully python.
>>>>
>>>> On Thu, Mar 7, 2019 at 6:55 AM Ilya Kasnacheev <
>>>> ilya.kasnach...@gmail.com> wrote:
>>>>
>>>>> Hello!
>>>>>
>>>>> What prevents you from reading rows from DB and feeding them to JDBC
>>>>> prepared statement?
>>>>>
>>>>> Regards,
>>>>> --
>>>>> Ilya Kasnacheev
>>>>>
>>>>>
>>>>> чт, 7 мар. 2019 г. в 15:51, Mike Needham :
>>>>>
>>>>>> And what if the data is already in a database table? I do not want
>>>>>> to read from the table to write to a file to load a cache.
>>>>>>
>>>>>> On Tue, Mar 5, 2019 at 4:06 AM Ilya Kasnacheev <
>>>>>> ilya.kasnach...@gmail.com> wrote:
>>>>>>
>>>>>>> Hello!
>>>>>>>
>>>>>>> The preferred approach is to use Thin JDBC client:
>>>>>>> https://apacheignite-sql.readme.io/docs/jdbc-driver
>>>>>>>
>>>>>>> Regards,
>>>>>>> --
>>>>>>> Ilya Kasnacheev
>>>>>>>
>>>>>>>
>>>>>>> пн, 4 мар. 2019 г. в 19:39, Mike Needham :
>>>>>>>
>>>>>>>> Thanks for the links, If SET STREAMING ON is the preferred method,
>>>>>>>> how would you do this in code rather than from a file with all the
&g
Re: Access a cache loaded by DataStreamer with SQL
Would it be possible for someone to provide a sample that uses the
DataStreamer for multiple large caches and the resulting caches are
queryable from ODBC tools like Tableau and DBeaver? I can get one to work,
but cannot get the cache naming to work for a second one.
On Thu, Mar 7, 2019 at 7:53 AM Ilya Kasnacheev
wrote:
> Hello!
>
> JDBC with SET STREAMING ON should work reasonably well. You could also use
> CacheStore.
>
> With .Net I guess you will have to stick to DataStreamer & learn how to
> integrate it with Indexing properly. Or use JDBC from .Net.
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> чт, 7 мар. 2019 г. в 16:31, Mike Needham :
>
>> Is that the most efficient way to load millions of rows from a database
>> table into a cache? I guess I am not seeing how this would work for
>> millions of rows in the source database. That also appears to be a JAVA
>> only solution and it would be preferable to have it be usable for .NET as
>> well as java and hopefully python.
>>
>> On Thu, Mar 7, 2019 at 6:55 AM Ilya Kasnacheev
>> wrote:
>>
>>> Hello!
>>>
>>> What prevents you from reading rows from DB and feeding them to JDBC
>>> prepared statement?
>>>
>>> Regards,
>>> --
>>> Ilya Kasnacheev
>>>
>>>
>>> чт, 7 мар. 2019 г. в 15:51, Mike Needham :
>>>
>>>> And what if the data is already in a database table? I do not want to
>>>> read from the table to write to a file to load a cache.
>>>>
>>>> On Tue, Mar 5, 2019 at 4:06 AM Ilya Kasnacheev <
>>>> ilya.kasnach...@gmail.com> wrote:
>>>>
>>>>> Hello!
>>>>>
>>>>> The preferred approach is to use Thin JDBC client:
>>>>> https://apacheignite-sql.readme.io/docs/jdbc-driver
>>>>>
>>>>> Regards,
>>>>> --
>>>>> Ilya Kasnacheev
>>>>>
>>>>>
>>>>> пн, 4 мар. 2019 г. в 19:39, Mike Needham :
>>>>>
>>>>>> Thanks for the links, If SET STREAMING ON is the preferred method,
>>>>>> how would you do this in code rather than from a file with all the insert
>>>>>> statements.
>>>>>>
>>>>>> On Mon, Mar 4, 2019 at 1:44 AM Ilya Kasnacheev <
>>>>>> ilya.kasnach...@gmail.com> wrote:
>>>>>>
>>>>>>> Hello!
>>>>>>>
>>>>>>> You can see at this page:
>>>>>>> https://apacheignite-sql.readme.io/docs/sql-and-key-value-usage
>>>>>>>
>>>>>>> And then substitite cache.put() with addData() and cache name will
>>>>>>> be SQL_PUBLIC_{table name in caps}
>>>>>>>
>>>>>>> There are not many examples since this is being discouraged in favor
>>>>>>> of SET STREAMING ON, actually:
>>>>>>> https://apacheignite-sql.readme.io/docs/set
>>>>>>>
>>>>>>> Regards,
>>>>>>> --
>>>>>>> Ilya Kasnacheev
>>>>>>>
>>>>>>>
>>>>>>> пт, 1 мар. 2019 г. в 22:48, Mike Needham :
>>>>>>>
>>>>>>>> I have looked at the documentation and the code samples and nothing
>>>>>>>> is doing what I am trying to do. I want to be able to use the
>>>>>>>> datastreamer
>>>>>>>> to load 3 or 4 TABLES in a cache for an application that we use. If I
>>>>>>>> create the tables using a create table syntax how do attach a
>>>>>>>> datastreamer
>>>>>>>> to the different caches if the cache name is PUBLIC for all of them?
>>>>>>>>
>>>>>>>> On Thu, Feb 28, 2019 at 8:13 AM Ilya Kasnacheev <
>>>>>>>> ilya.kasnach...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hello!
>>>>>>>>>
>>>>>>>>> I have linked the documentation page, there are also some code
>>>>>>>>> examples in distribution.
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> --
>>>>>>>>> Ilya Kasnacheev
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> чт, 28 февр. 2019 г. в 17:10, Mike Needham :
>>>>>>>>>
>>>>>>>>>> Is there any examples that show the steps to do this correctly?
>>>>>>>>>> I stumbled upon this but have no idea if it is the best way to do
>>>>>>>>>> this
>>>>>>>>>>
>>>>>>>>>> On Thu, Feb 28, 2019 at 6:27 AM Ilya Kasnacheev <
>>>>>>>>>> ilya.kasnach...@gmail.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hello!
>>>>>>>>>>>
>>>>>>>>>>> There's no restriction on cache name but setting it up for the
>>>>>>>>>>> first time may be tricky indeed.
>>>>>>>>>>>
>>>>>>>>>>> Regards,
>>>>>>>>>>> --
>>>>>>>>>>> Ilya Kasnacheev
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> ср, 27 февр. 2019 г. в 19:48, needbrew99 :
>>>>>>>>>>>
>>>>>>>>>>>> OK, was able to get it working. Apparently the cache name has
>>>>>>>>>>>> to be PUBLIC
>>>>>>>>>>>> and it will create a table based on the object definition that
>>>>>>>>>>>> I have.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> *Some days it just not worth chewing through the restraints*
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> *Some days it just not worth chewing through the restraints*
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Some days it just not worth chewing through the restraints*
>>>>>>
>>>>>
>>>>
>>>> --
>>>> *Some days it just not worth chewing through the restraints*
>>>>
>>>
>>
>> --
>> *Some days it just not worth chewing through the restraints*
>>
>
--
*Some days it just not worth chewing through the restraints*
Re: Access a cache loaded by DataStreamer with SQL
Is that the most efficient way to load millions of rows from a database
table into a cache? I guess I am not seeing how this would work for
millions of rows in the source database. That also appears to be a JAVA
only solution and it would be preferable to have it be usable for .NET as
well as java and hopefully python.
On Thu, Mar 7, 2019 at 6:55 AM Ilya Kasnacheev
wrote:
> Hello!
>
> What prevents you from reading rows from DB and feeding them to JDBC
> prepared statement?
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> чт, 7 мар. 2019 г. в 15:51, Mike Needham :
>
>> And what if the data is already in a database table? I do not want to
>> read from the table to write to a file to load a cache.
>>
>> On Tue, Mar 5, 2019 at 4:06 AM Ilya Kasnacheev
>> wrote:
>>
>>> Hello!
>>>
>>> The preferred approach is to use Thin JDBC client:
>>> https://apacheignite-sql.readme.io/docs/jdbc-driver
>>>
>>> Regards,
>>> --
>>> Ilya Kasnacheev
>>>
>>>
>>> пн, 4 мар. 2019 г. в 19:39, Mike Needham :
>>>
>>>> Thanks for the links, If SET STREAMING ON is the preferred method, how
>>>> would you do this in code rather than from a file with all the insert
>>>> statements.
>>>>
>>>> On Mon, Mar 4, 2019 at 1:44 AM Ilya Kasnacheev <
>>>> ilya.kasnach...@gmail.com> wrote:
>>>>
>>>>> Hello!
>>>>>
>>>>> You can see at this page:
>>>>> https://apacheignite-sql.readme.io/docs/sql-and-key-value-usage
>>>>>
>>>>> And then substitite cache.put() with addData() and cache name will be
>>>>> SQL_PUBLIC_{table name in caps}
>>>>>
>>>>> There are not many examples since this is being discouraged in favor
>>>>> of SET STREAMING ON, actually:
>>>>> https://apacheignite-sql.readme.io/docs/set
>>>>>
>>>>> Regards,
>>>>> --
>>>>> Ilya Kasnacheev
>>>>>
>>>>>
>>>>> пт, 1 мар. 2019 г. в 22:48, Mike Needham :
>>>>>
>>>>>> I have looked at the documentation and the code samples and nothing
>>>>>> is doing what I am trying to do. I want to be able to use the
>>>>>> datastreamer
>>>>>> to load 3 or 4 TABLES in a cache for an application that we use. If I
>>>>>> create the tables using a create table syntax how do attach a
>>>>>> datastreamer
>>>>>> to the different caches if the cache name is PUBLIC for all of them?
>>>>>>
>>>>>> On Thu, Feb 28, 2019 at 8:13 AM Ilya Kasnacheev <
>>>>>> ilya.kasnach...@gmail.com> wrote:
>>>>>>
>>>>>>> Hello!
>>>>>>>
>>>>>>> I have linked the documentation page, there are also some code
>>>>>>> examples in distribution.
>>>>>>>
>>>>>>> Regards,
>>>>>>> --
>>>>>>> Ilya Kasnacheev
>>>>>>>
>>>>>>>
>>>>>>> чт, 28 февр. 2019 г. в 17:10, Mike Needham :
>>>>>>>
>>>>>>>> Is there any examples that show the steps to do this correctly? I
>>>>>>>> stumbled upon this but have no idea if it is the best way to do this
>>>>>>>>
>>>>>>>> On Thu, Feb 28, 2019 at 6:27 AM Ilya Kasnacheev <
>>>>>>>> ilya.kasnach...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hello!
>>>>>>>>>
>>>>>>>>> There's no restriction on cache name but setting it up for the
>>>>>>>>> first time may be tricky indeed.
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> --
>>>>>>>>> Ilya Kasnacheev
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> ср, 27 февр. 2019 г. в 19:48, needbrew99 :
>>>>>>>>>
>>>>>>>>>> OK, was able to get it working. Apparently the cache name has to
>>>>>>>>>> be PUBLIC
>>>>>>>>>> and it will create a table based on the object definition that I
>>>>>>>>>> have.
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> *Some days it just not worth chewing through the restraints*
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Some days it just not worth chewing through the restraints*
>>>>>>
>>>>>
>>>>
>>>> --
>>>> *Some days it just not worth chewing through the restraints*
>>>>
>>>
>>
>> --
>> *Some days it just not worth chewing through the restraints*
>>
>
--
*Some days it just not worth chewing through the restraints*
Re: Access a cache loaded by DataStreamer with SQL
And what if the data is already in a database table? I do not want to read
from the table to write to a file to load a cache.
On Tue, Mar 5, 2019 at 4:06 AM Ilya Kasnacheev
wrote:
> Hello!
>
> The preferred approach is to use Thin JDBC client:
> https://apacheignite-sql.readme.io/docs/jdbc-driver
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> пн, 4 мар. 2019 г. в 19:39, Mike Needham :
>
>> Thanks for the links, If SET STREAMING ON is the preferred method, how
>> would you do this in code rather than from a file with all the insert
>> statements.
>>
>> On Mon, Mar 4, 2019 at 1:44 AM Ilya Kasnacheev
>> wrote:
>>
>>> Hello!
>>>
>>> You can see at this page:
>>> https://apacheignite-sql.readme.io/docs/sql-and-key-value-usage
>>>
>>> And then substitite cache.put() with addData() and cache name will be
>>> SQL_PUBLIC_{table name in caps}
>>>
>>> There are not many examples since this is being discouraged in favor of
>>> SET STREAMING ON, actually:
>>> https://apacheignite-sql.readme.io/docs/set
>>>
>>> Regards,
>>> --
>>> Ilya Kasnacheev
>>>
>>>
>>> пт, 1 мар. 2019 г. в 22:48, Mike Needham :
>>>
>>>> I have looked at the documentation and the code samples and nothing is
>>>> doing what I am trying to do. I want to be able to use the datastreamer to
>>>> load 3 or 4 TABLES in a cache for an application that we use. If I create
>>>> the tables using a create table syntax how do attach a datastreamer to the
>>>> different caches if the cache name is PUBLIC for all of them?
>>>>
>>>> On Thu, Feb 28, 2019 at 8:13 AM Ilya Kasnacheev <
>>>> ilya.kasnach...@gmail.com> wrote:
>>>>
>>>>> Hello!
>>>>>
>>>>> I have linked the documentation page, there are also some code
>>>>> examples in distribution.
>>>>>
>>>>> Regards,
>>>>> --
>>>>> Ilya Kasnacheev
>>>>>
>>>>>
>>>>> чт, 28 февр. 2019 г. в 17:10, Mike Needham :
>>>>>
>>>>>> Is there any examples that show the steps to do this correctly? I
>>>>>> stumbled upon this but have no idea if it is the best way to do this
>>>>>>
>>>>>> On Thu, Feb 28, 2019 at 6:27 AM Ilya Kasnacheev <
>>>>>> ilya.kasnach...@gmail.com> wrote:
>>>>>>
>>>>>>> Hello!
>>>>>>>
>>>>>>> There's no restriction on cache name but setting it up for the first
>>>>>>> time may be tricky indeed.
>>>>>>>
>>>>>>> Regards,
>>>>>>> --
>>>>>>> Ilya Kasnacheev
>>>>>>>
>>>>>>>
>>>>>>> ср, 27 февр. 2019 г. в 19:48, needbrew99 :
>>>>>>>
>>>>>>>> OK, was able to get it working. Apparently the cache name has to
>>>>>>>> be PUBLIC
>>>>>>>> and it will create a table based on the object definition that I
>>>>>>>> have.
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Some days it just not worth chewing through the restraints*
>>>>>>
>>>>>
>>>>
>>>> --
>>>> *Some days it just not worth chewing through the restraints*
>>>>
>>>
>>
>> --
>> *Some days it just not worth chewing through the restraints*
>>
>
--
*Some days it just not worth chewing through the restraints*
Re: Access a cache loaded by DataStreamer with SQL
Thanks for the links, If SET STREAMING ON is the preferred method, how
would you do this in code rather than from a file with all the insert
statements.
On Mon, Mar 4, 2019 at 1:44 AM Ilya Kasnacheev
wrote:
> Hello!
>
> You can see at this page:
> https://apacheignite-sql.readme.io/docs/sql-and-key-value-usage
>
> And then substitite cache.put() with addData() and cache name will be
> SQL_PUBLIC_{table name in caps}
>
> There are not many examples since this is being discouraged in favor of
> SET STREAMING ON, actually:
> https://apacheignite-sql.readme.io/docs/set
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> пт, 1 мар. 2019 г. в 22:48, Mike Needham :
>
>> I have looked at the documentation and the code samples and nothing is
>> doing what I am trying to do. I want to be able to use the datastreamer to
>> load 3 or 4 TABLES in a cache for an application that we use. If I create
>> the tables using a create table syntax how do attach a datastreamer to the
>> different caches if the cache name is PUBLIC for all of them?
>>
>> On Thu, Feb 28, 2019 at 8:13 AM Ilya Kasnacheev <
>> ilya.kasnach...@gmail.com> wrote:
>>
>>> Hello!
>>>
>>> I have linked the documentation page, there are also some code examples
>>> in distribution.
>>>
>>> Regards,
>>> --
>>> Ilya Kasnacheev
>>>
>>>
>>> чт, 28 февр. 2019 г. в 17:10, Mike Needham :
>>>
>>>> Is there any examples that show the steps to do this correctly? I
>>>> stumbled upon this but have no idea if it is the best way to do this
>>>>
>>>> On Thu, Feb 28, 2019 at 6:27 AM Ilya Kasnacheev <
>>>> ilya.kasnach...@gmail.com> wrote:
>>>>
>>>>> Hello!
>>>>>
>>>>> There's no restriction on cache name but setting it up for the first
>>>>> time may be tricky indeed.
>>>>>
>>>>> Regards,
>>>>> --
>>>>> Ilya Kasnacheev
>>>>>
>>>>>
>>>>> ср, 27 февр. 2019 г. в 19:48, needbrew99 :
>>>>>
>>>>>> OK, was able to get it working. Apparently the cache name has to be
>>>>>> PUBLIC
>>>>>> and it will create a table based on the object definition that I
>>>>>> have.
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>>>>>>
>>>>>
>>>>
>>>> --
>>>> *Some days it just not worth chewing through the restraints*
>>>>
>>>
>>
>> --
>> *Some days it just not worth chewing through the restraints*
>>
>
--
*Some days it just not worth chewing through the restraints*
Re: Access a cache loaded by DataStreamer with SQL
I have looked at the documentation and the code samples and nothing is doing what I am trying to do. I want to be able to use the datastreamer to load 3 or 4 TABLES in a cache for an application that we use. If I create the tables using a create table syntax how do attach a datastreamer to the different caches if the cache name is PUBLIC for all of them? On Thu, Feb 28, 2019 at 8:13 AM Ilya Kasnacheev wrote: > Hello! > > I have linked the documentation page, there are also some code examples in > distribution. > > Regards, > -- > Ilya Kasnacheev > > > чт, 28 февр. 2019 г. в 17:10, Mike Needham : > >> Is there any examples that show the steps to do this correctly? I >> stumbled upon this but have no idea if it is the best way to do this >> >> On Thu, Feb 28, 2019 at 6:27 AM Ilya Kasnacheev < >> ilya.kasnach...@gmail.com> wrote: >> >>> Hello! >>> >>> There's no restriction on cache name but setting it up for the first >>> time may be tricky indeed. >>> >>> Regards, >>> -- >>> Ilya Kasnacheev >>> >>> >>> ср, 27 февр. 2019 г. в 19:48, needbrew99 : >>> >>>> OK, was able to get it working. Apparently the cache name has to be >>>> PUBLIC >>>> and it will create a table based on the object definition that I have. >>>> >>>> >>>> >>>> -- >>>> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >>>> >>> >> >> -- >> *Some days it just not worth chewing through the restraints* >> > -- *Some days it just not worth chewing through the restraints*
Re: Access a cache loaded by DataStreamer with SQL
Is there any examples that show the steps to do this correctly? I stumbled upon this but have no idea if it is the best way to do this On Thu, Feb 28, 2019 at 6:27 AM Ilya Kasnacheev wrote: > Hello! > > There's no restriction on cache name but setting it up for the first time > may be tricky indeed. > > Regards, > -- > Ilya Kasnacheev > > > ср, 27 февр. 2019 г. в 19:48, needbrew99 : > >> OK, was able to get it working. Apparently the cache name has to be >> PUBLIC >> and it will create a table based on the object definition that I have. >> >> >> >> -- >> Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >> > -- *Some days it just not worth chewing through the restraints*
Re: Access a cache loaded by DataStreamer with SQL
I have looked at the docs and it is not clear to me how to set-up a queryable table that can be loaded with a datastreamer. If I want to use the datastreamer and still have it queryable from a third party tool like Tableau what would I need to set-up. I tried one thing and it showed up in the DBeaver but under a schema of Test, that was my cache name, but I cannot query it as it says invalid schema. Is there some config when the cache is created that needs to be set so that it also generates TABLES that are queryable. Sorry for all the questions as I am trying to do a quick proof of concept for our users and need to load 10 million initially into a cache and have it queryable from SQL interfaces. On Wed, Feb 27, 2019 at 8:14 AM Ilya Kasnacheev wrote: > Hello! > > Please refer to this page: https://apacheignite.readme.io/docs/indexes > > In short, you can use CREATE TABLE or GetOrCreateCache > indexedTypes+annotations or QueryEntities. All of those are compatible with > DataStreamer as long as type name and field/column names match. > > By default caches do not have corresponding tables. > > Regards, > -- > Ilya Kasnacheev > > > вт, 26 февр. 2019 г. в 21:35, Mike Needham : > >> Hi All, >> >> I have a cache that I have loaded using the DataStreamer and can confirm >> there is a cache created by using the ignitevisor utility with the cache >> command. I cannot query it from any JDBC tools and am not sure why. Do I >> need to use a CREATE TABLE syntax in order for this to work instead of the >> GetOrCreateCache<>(CacheName). Or is there someother thing on the config >> side that I am missiung >> >> Any help appreciated as I am just starting to evaluate this for a project. >> >> >> -- >> *Some days it just not worth chewing through the restraints* >> > -- *Some days it just not worth chewing through the restraints*
Access a cache loaded by DataStreamer with SQL
Hi All, I have a cache that I have loaded using the DataStreamer and can confirm there is a cache created by using the ignitevisor utility with the cache command. I cannot query it from any JDBC tools and am not sure why. Do I need to use a CREATE TABLE syntax in order for this to work instead of the GetOrCreateCache<>(CacheName). Or is there someother thing on the config side that I am missiung Any help appreciated as I am just starting to evaluate this for a project. -- *Some days it just not worth chewing through the restraints*
