Hello Folks,
Just to add a little bit more clarity & context...taking the Cross-Cache
querying example from the ignite docs (copied below) if one were to select
fields from both Person & Organization table caches in the select query
what would be the elegant way to construct a domain POJO from the
Hi Humphrey,
I am overriding toString in the Bus class like;
and I have created a schema and dummy data in my TestMyExtractor class like;
when i print "record.value()", I am getting;
and when I print "record", I am getting;
This shows that key is set, right? If then, why it shows no ke
Hi Humphrey, Thank you so much.
gives me
I wonder why busID is missing :(
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/How-to-solve-SinkRecord-cannot-be-cast-exception-unsolved-tp13221p13301.html
Sent from the Apache Ignite Users mailing list archive at
Hi Guys,
A new write sync mode
CacheWriteSynchronizationMode.LOCAL_SYNC
Would be very handy for us. Has this been brought up before? Any plan to
implement it?
We are running in REPLICATED and we want the local node to be updated sync, but
other nodes async. Using PRIMARY_SYNC doesn't quite wo
A bug to track this would be great. I've also noticed this behavior occur
without nodes rejoining, so the root cause may not be due to that, but it
probably more likely triggers the loop. I've tried the following
configurations, and they all exhibit this issue:
- 1.9 with igfs-meta replicated
- 2.
Sure thanks Roman, i guess i can work with setting up IGNITE_HOME & placing
the config xml there. Curiously in the same page there is this line "Path
to configuration file can be absolute, or relative to either IGNITE_HOME
(Ignite installation folder) *or META-INF folder in your classpath.*"
https
I've just noticed your Bus domain class above:
So your code will look like the following when you figure out how to extract
your values from the SinkRecord record.
The only thing you need to find out is how to extract the values from your
record. Here I point you to check the Kafka documentat
Has anyone gotten a chance to look at issue IGNITE-5183 ?
I had an (I think) unrelated compute failure today and was reminded that
I'm still using my own hacked together work-around.
FifoQueueCollisionSpi only has a handful of config options and
parallelJobsNumber is the only one that is demo
I'm using TcpDiscovery with the nodes running at Amazon. So far the
networking inside the Amazon cloud has been rock solid. That said, over
the weekend I had two compute tasks fail because of an empty
projection. It looks like the compute nodes all disconnected.
Its unclear why exactly the
Hi Denis,
Thanks. It worked that way.
return(BinaryObject)
ignite.cache("ExchangeRateCache").withKeepBinary().get(Key);
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/BinaryObjects-in-IgniteCallable-tp13152p13294.html
Sent from the Apache Ignite Users mailing
I edit the message above. See extra comments added to the end.
Looks like the key is null, exactly what the error says.
Try to print out the values from the SinkRecord record, I think that would
be the first step you should take.
You still not doing extracting values you just trying to cast the o
Hi,
Agree, I dont need those private methods. I made Bus class and extractor
class into jar file and deployed in confluent. But nothing is getting
inserted into ignite. I am getting this;
and
Why is this happening? How to fix this?
Thank you.
--
View this message in context:
http://apac
Hi
I am using IgniteDataStreamer to take records and process them via the
receiver in IgniteDataStreamer and as a result of the process, for some
records, I would like to send messages into another Kafka Topic inside the
receiver. Could you please advice a good way to do that or maybe this is
alre
I'm not sure how your Bus class is implemented.
For sure you won't be needing those private methods. If that Bus class
represends that Object you are getting as record (SinkRecord) then you can
cast that object to Bus.
Still you are not using the Kafka API to extract your values, you are just
c
Hi Humphrey,
so here is my final Extractor;
Is this the correct method of doing this? or did I went wrong somewhere?
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/How-to-solve-SinkRecord-cannot-be-cast-exception-unsolved-tp13221p13289.html
Sent from the Apa
Hi,
Yes Humphrey, I know, I am testing and learning, and I will deploy in Kafka
after this. Kindly tell me so how should I modify public Entry
to get Bus ID and Bus object to push into Ignite? Thank you.
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/How-to-sol
The only thing you doing now is creating a new SinkRecord manually. And pass
it to your method.
Instead of getting the values out of your Kafka SinkRecord you are creating
a different one. I'm not sure how this will help you.
--
View this message in context:
http://apache-ignite-users.70518.x6.
Hi Humphrey, I have modified it like;
and I called
I overrided toString() method in Bus class and I am getting the below
output;
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/How-to-solve-SinkRecord-cannot-be-cast-exception-unsolved-tp13221p13286.html
Se
I'm not sure what are you trying to achive by this?
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/How-to-solve-SinkRecord-cannot-be-cast-exception-unsolved-tp13221p13285.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Hi Humphrey,
Yes, I am getting, but I need to deploy it in Kafka to get it work. So I
created this;
and changed sink record like;
and I am printing the value in my method
it returns
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/How-to-solve-SinkReco
Hi, Joe, you're right, these files do not exist. These are special "trash"
files.
In IGFS deletion is performed in 2 phases: 1st a file is moved to special
"trash" folder (which does not have normal path and thus cannot be found on
the file system), and 2nd -- deletion of the trash entries perform
See my previous updated answer.
You don't need to create a new SinkRecord, you are getting already your
values from Kafka in the SinkRecord:
You need to extract the valeus from the record (step 2 I mentioned in
previous post).
Now I know your next question is how do you extract the values from
Hi, I got it.
So, for testing, I made
but I need to replace "stringschema" with my "bus_schema". How can I define
that schema? I think there is something in my kafka record;
How to implement this?
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/How-to-sol
Hi, you were very good busy above.
Let me try to explain you what needs to be done.
1) The method that you need to finish is the method you are overriding:
2) What you need to do here is first get the values you need out from the
SinkRecord record. Look in the Kafka API how to do this.
3) Firs
Hi Humphrey,
So, I think I need to replace
with
and call . DOnt know how to give
You may feel like you are "Spoon feeding" me, but kindly understand the
situation of a self learning beginner.
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/How-to-solve-Si
Hi, Sergey,
1) OOME happens because Ignite 2.0 by default uses off-heap memory for
caches. So, you should not give Ignite large heap any more. Instead, you
should properly configure the offheap memory policies for the caches.
This is the configuration defined by bean
class org.apache.ignite.config
Hi Igor,
Yes, that worked but now make has an error - cc1plus: error: unrecognized
command line option "-std=c++03"
config.status: creating common/os/linux/include/Makefile
make[3]: Leaving directory
`/opt/apache-ignite-2.0.0-src/target/release-package/platforms/cpp/common/os/linux/include'
make
You have to handle the deletion manually in some way or another:
delete entry from Ignite when deleting it from DB, or use some DB change
listener.
On Wed, May 31, 2017 at 1:13 PM, Chetan D wrote:
> Hi Pavel,
>
> I was going through all methods and trying to implement cache using
> ado.net while
What did the System.out.println(record.value()); print out in the console?
You let say that record.value() gave you an object named Car which should
have a method getColor and getId. Then you should could call the method from
getColor to get the color of the Car (which comes from SinkRecord value)
That's weird.
Try changing AC_PROG_CPP to AC_PROG_CXX in configure.ac file.
Best Regards,
Igor
On Wed, May 31, 2017 at 1:25 PM, vikrantkamble
wrote:
> Hi Igor,
>
> Following are already installed on the server.
> gcc-gfortran-4.4.7-18.el6.x86_64
> gcc-objc-4.4.7-18.el6.x86_64
> gcc-objc++-4.4.7
Hi Igor,
Following are already installed on the server.
gcc-gfortran-4.4.7-18.el6.x86_64
gcc-objc-4.4.7-18.el6.x86_64
gcc-objc++-4.4.7-18.el6.x86_64
gcc-4.4.7-18.el6.x86_64
gcc-gnat-4.4.7-18.el6.x86_64
libgcc-4.4.7-18.el6.x86_64
libgcc-4.4.7-18.el6.i686
gcc-java-4.4.7-18.el6.x86_64
gcc-c++-4.4.7-1
Hi Roman Shtykh,
As advised, I am continuing in the parent thread. Could you kindly have a
look at this post. Thanks a bunch for your help.
http://apache-ignite-users.70518.x6.nabble.com/How-to-solve-SinkRecord-cannot-be-cast-exception-unsolved-td13221.html#a13270
--
View this message in conte
Hi Humphrey,
As advised, I am continuing in this parent thread.
I changed the class like;
and I dont know what to be given inside brackets. Is it like;
or something?
I have no idea what to do. Your example was very much helpful to learn, but
as a beginner like me, I feels like 'm lost in no
It seems like you don't have C++ compiler on your system.
You need one to compile ODBC driver.
Best Regards,
Igor
On Wed, May 31, 2017 at 1:03 PM, vikrantkamble
wrote:
> Hi Igor,
>
> Below is the output for automake
>
> [root@hostname cpp]# automake
> configure.ac:39: warning: AC_LANG_CONFTEST:
Hi Pavel,
I was going through all methods and trying to implement cache using ado.net
while doing that i came across some scenario which are as follows,
1.Data is added to cache and when trying to retrieve it using key first it
checks if it is present in cache then gets it from cache if not then
Hi Igor,
Below is the output for automake
[root@hostname cpp]# automake
configure.ac:39: warning: AC_LANG_CONFTEST: no AC_LANG_SOURCE call detected
in body
../../lib/autoconf/lang.m4:193: AC_LANG_CONFTEST is expanded from...
../../lib/autoconf/general.m4:2661: _AC_LINK_IFELSE is expanded from...
Hello,
Makefile.in should be created by automake.
Can you share an output of automake?
Best Regards,
Igor
On Wed, May 31, 2017 at 10:58 AM, vikrantkamble
wrote:
> Hi,
>
> I am trying to install odbc driver, running libtoolize && aclocal &&
> autoheader && automake --add-missing && autoreconf m
Check SinkRecord#value() [1]. Cast the object to the data type you use in your
Kafka connector and extract the field you need.
And please continue posting your questions related to this topic in one thread
-- we have a bunch already. Thank you!
[1]
https://kafka.apache.org/0100/javadoc/index.h
Can you keep everything in one thread, not creating new threads for each
question you have? Makes easy to follow the whole conversation.
You almost there, you just need to extract the values from the SinkRecord
and add them to your Bus object. See the Kafka API how to do extract values
from SinkRe
In addition, it is not a problem if I only run 1 client. The problem arise
when I run more than 1 client.
-
-- Ricky
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Client-Server-Persistent-Store-Fault-Tolerance-tp13054p13263.html
Sent from the Apache Ignite
Evgenii Zhuravlev wrote
> You don't have inconsistent data.
It turns out that the remaining server (the one that I didn't stop)
automatically load the data from the database (because, by this example [1],
/this method is called whenever IgniteCache.get() method is called/), but
only one of the cl
hi,
I have records in kafka like;
Each record represents a "Bus" entry, with bus ID, route, etc. The records
are fetched from DB using Kafka JDBC Connector. I want to insert them to
Ignite, having "BUS_ID" as the key, and Bus object as the value. I got to
know that there need to do something li
Hi,
I am trying to install odbc driver, running libtoolize && aclocal &&
autoheader && automake --add-missing && autoreconf manually one by one
creates configure file.
running ./configure --enable-odbc --disable-node --disable-core
Makefile.in is not getting created
below is the error.
./con
Hi all,
somebody kindly tell me how to implement
so that *BUS_ID* will be extracted and set as Ignbite key and *Bus Object*
as the Ignite entry.
Thanks in advance.
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/How-to-solve-SinkRecord-cannot-be-cast-excepti
44 matches
Mail list logo
