Re: Cannot connect to Ignite

2020-03-08 Thread Stéphane Thibaud
Since I think this was more of a GCP-related question, I have asked on Stackoverflow in the meantime: https://stackoverflow.com/questions/60584349/any-idea-why-this-port-is-not-reachable-from-another-gcp-instance Kind regards, Stéphane Thibaud On Sun, Mar 1, 2020 at 9:27 PM Stéphane Thibaud

Re: Cannot connect to Ignite

2020-03-01 Thread Stéphane Thibaud
would expect the default firewall rules to expose the port. Kind regards, Stéphane Thibaud 2020年3月1日(日) 19:35 Gianluca Bonetti : > Hello Stéphane > > GCP should allow internal traffic using the internal IP address (static or > not), usually a 10.xxx.xxx.xxx, but should deny connection

Cannot connect to Ignite

2020-02-29 Thread Stéphane Thibaud
the machine without problem. Any ideas for additional checks? Kind regards, Stéphane Thibaud

Re: Nodes started on local machine require more than 80% of physical RAM

2020-02-12 Thread Stéphane Thibaud
Thank you. I am running this on a Google Cloud instance with Container OS and was trying to find a minimal setup first. Maybe I need to add some more RAM to the instance, but 4GB for container OS seems a bit much. Thanks for letting me know in any case! :-) Kind regards, Stéphane 2020年2月13日(木)

Re: Ignite 'complex' type

2019-05-20 Thread Stéphane Thibaud
Thank you Dmitry. I will use serialization in this case. Kind regards, Stéphane Thibaud 2019年5月21日(火) 9:01 Dmitry Melnichuk : > Stéphane, > > I afraid this won't work. Ignite storage is typed, thus you can not use > values of arbitrary type, but only of Pythonic types that defi

Re: Ignite 'complex' type

2019-05-20 Thread Stéphane Thibaud
Any thoughts about this one? Kind regards, Stéphane Thibaud 2019年5月16日(木) 20:55 Stéphane Thibaud : > Hello Ignite experts, > > I am trying to store a python value of type > > Tuple[Dict[str, float], bytes] > > in an Ignite cache. However, doing that without type hints

Re: Multithreading using pyignite

2019-05-20 Thread Stéphane Thibaud
Great. Thank you. I went with an awesome pip package called 'resource-pool'. Kind regards, Stéphane Thibaud 2019年5月20日(月) 15:44 Ilya Kasnacheev : > Hello! > > I guess the recommendation here is to create a new client in every thread > where you need them. > > Regards, >

Re: Recommended way of random sampling

2019-05-20 Thread Stéphane Thibaud
Hello Ilya, Yes, you are right. I sent my first response too quickly. With an extra column it will work. I will go with the approach you suggest. :-) Kind regards, Stéphane Thibaud 2019年5月20日(月) 20:26 Ilya Kasnacheev : > Hello! > > I'm not sure why you think it will not scale. If t

Re: Recommended way of random sampling

2019-05-20 Thread Stéphane Thibaud
, Stéphane Thibaud 2019年5月20日(月) 15:53 Ilya Kasnacheev : > Hello! > > You can have a random indexed field in your table and do queries like > SELECT * FROM table WHERE rand_field < RAND() LIMIT 1; to sample random > item. > > Regards, > -- > Ilya Kasnacheev > > &g

Re: Recommended way of random sampling

2019-05-20 Thread Stéphane Thibaud
Excuse me, I just sent my response, but I see that you actually suggested a new column... in that case this would work, but I think it's a bit unfortunate to have to store random numbers. Kind regards, Stéphane Thibaud 2019年5月20日(月) 19:22 Stéphane Thibaud : > Hello Ilya, > >

Re: Recommended way of random sampling

2019-05-19 Thread Stéphane Thibaud
As a small addition: it would really help if Ignite had a hashing function for this, but I only see AES encryption. Kind regards, Stéphane Thibaud 2019年5月19日(日) 20:59 Stéphane Thibaud : > Hello Ignite users, > > I am considering to sample randomly on large amounts of da

Recommended way of random sampling

2019-05-19 Thread Stéphane Thibaud
/sampling-SQL.html I currently have a UUID column (uuid4), which I think can be used for it, but I might need some bit manipulation to get the non-random parts out of the UUID. Do you think this is indeed the most straightforward way to do it? Kind regards, Stéphane Thibaud

Multithreading using pyignite

2019-05-18 Thread Stéphane Thibaud
ut("a", "b") for _ in range(1000): Thread(target=lambda: print(test_cache.get("a"))).start() Kind regards, Stéphane Thibaud

Re: Timestamp with Python thin client

2019-05-17 Thread Stéphane Thibaud
Thank you very much. It is completely clear to me now. Kind regards, Stéphane Thibaud 2019年5月17日(金) 20:56 Igor Sapego : > These are nanosecond fraction of the last microsecond (It can be only from > 0 to 999). > > Ignite's Timestamp have a nanoseconds precision, so it can not be &

Ignite 'complex' type

2019-05-16 Thread Stéphane Thibaud
Hello Ignite experts, I am trying to store a python value of type Tuple[Dict[str, float], bytes] in an Ignite cache. However, doing that without type hints I get: TypeError: Type `array of None` is invalid Do you know if this is possible? Kind regards, Stéphane Thibaud

Re: Timestamp with Python thin client

2019-05-16 Thread Stéphane Thibaud
I see. Thank you. I am still a bit unsure about what the second value in the tuple represents. Are these indeed the nanoseconds? Apparently a Python datetime can have differing precisions (perhaps depending on platform)... Kind regards, Stéphane Thibaud 2019年5月16日(木) 0:10 Igor Sapego : >

Re: Timestamp with Python thin client

2019-05-15 Thread Stéphane Thibaud
ot;/home/snthibaud/PycharmProjects/tabee/venv/lib/python3.7/site-packages/pyignite/datatypes/internal.py", >>> line 399, in infer_from_python >>> if is_hinted(value): >>> File >>> "/home/snthibaud/PycharmProjects/tabee/venv/lib/python3.7/site-packages/pyignite/utils.py", >>> line 51, in is_hinted >>> and issubclass(value[1], IgniteDataType) >>> File "/usr/lib/python3.7/abc.py", line 143, in __subclasscheck__ >>> return _abc_subclasscheck(cls, subclass) >>> TypeError: issubclass() arg 1 must be a class >>> >>> Kind regards, >>> >>> Stéphane Thibaud >>> >>> >>>

Re: Ignite many to many relationship

2019-05-09 Thread Stéphane Thibaud
Hello Ivan, I am glad to have this suspicion confirmed. With a bit of luck the storage overhead will be small if Null values are stored efficiently, but who knows. I will create a ticket if none exists. Thanks a lot! Kind regards, Stéphane Thibaud 2019年5月9日(木) 19:58 Ivan Pavlukhina : >

Re: Ignite many to many relationship

2019-05-05 Thread Stéphane Thibaud
for a many-to-many relationship. Am I missing something? Kind regards, Stéphane Thibaud 2019年5月4日(土) 22:46 Stéphane Thibaud : > Hello Apache Ignite users, > > I was wondering what would be the best way to model a many to many > relationship. Since uniqueness constraints do not exist

Ignite many to many relationship

2019-05-04 Thread Stéphane Thibaud
primary key column needs to exist in this case. I could come up maybe come up with a column like 'created date', but it seems like a waste of space if not truly necessary. Otherwise I might have to accept duplicates and filter on selection. What approach would you suggest? Kind regards, Stéphane

Timestamp with Python thin client

2019-05-04 Thread Stéphane Thibaud
site-packages/pyignite/utils.py", line 51, in is_hinted and issubclass(value[1], IgniteDataType) File "/usr/lib/python3.7/abc.py", line 143, in __subclasscheck__ return _abc_subclasscheck(cls, subclass) TypeError: issubclass() arg 1 must be a class Kind regards, Stéphane Thibaud

Re: Transactions from Python

2019-05-02 Thread Stéphane Thibaud
Hello Evgenii, Thank you for the quick answer. I will follow this feature attentively. Kind regards, Stéphane Thibaud 2019年5月2日(木) 17:38 Evgenii Zhuravlev : > Hi Stéphane > > Community is working on this functionality at the moment, here you can > find design document an

Transactions from Python

2019-05-01 Thread Stéphane Thibaud
Hello Apache Ignite users, I recently started writing my web service using the thin client of Apache Ignite, but was shocked to discover that transactions seem absent in the Python thin client API. Any recommendations? Kind regards, Stéphane Thibaud

Discovery on Google Cloud

2018-02-18 Thread Stéphane Thibaud
Hello! I am trying to enable Cloud Storage based discovery as described on https://apacheignite-mix.readme.io/docs/google-compute-engine I noticed that I need to define a P12 credential file path, so I created a script that runs on

Moving a folder when deployed on Kubernetes

2018-02-15 Thread Stéphane Thibaud
Hello! I am wondering how I should move the folder as suggested on https://apacheignite-tools.readme.io/docs/getting-started#ignite-web-agent , when I have deployed on Google Cloud’s Kubernetes using this guide:

Re: Failed to parse query

2018-02-15 Thread Stéphane Thibaud
ti...@gmail.com> wrote: > > Hi Stéphane, > > The parametrized queries are supported by the thin JDBC driver. > > Could you please share a code snippet that illustrates table 'device' > creation and JDBC driver using? > Please provide the log from the server node. It should

Re: Failed to parse query

2018-02-15 Thread Stéphane Thibaud
Thank you for your answer! I am not sure about the cache name. Where would I have created this cache? The ‘first ignite sql application does not mention it either. Wouldn’t the table creation suffice? I have also looked at the logs of the kubernetes node and saw this: ignite-node <>

Failed to parse query

2018-02-15 Thread Stéphane Thibaud
Hello! I am trying to convert our Play Framework application to use Apache Ignite. I encountered a failure to parse an existing query, but I do not see what is so special about this query: java.sql.SQLException: Failed to parse query: insert into device(id, secret, updated_at, created_at)