Re: [Neo4j] indexquery 12times faster than cypher --> neostore-upgrade-question

[st.pa]

Hi, this is great, I was still holding my breath and at first didnt even 
notice, then I got the snapshot and changed classpaths in my project to 
use 1.5.m, when I noticed the following error

org.neo4j.graphdb.TransactionFailureException: Could not create data 
source [nioneodb], see nested exception for cause of error
org.neo4j.kernel.impl.transaction.TxModule.registerDataSource(TxModule.java:153)
org.neo4j.kernel.GraphDbInstance.start(GraphDbInstance.java:112)
at 
org.neo4j.kernel.EmbeddedGraphDbImpl.(EmbeddedGraphDbImpl.java:190)
at 
org.neo4j.kernel.EmbeddedGraphDatabase.(EmbeddedGraphDatabase.java:80)
...
Caused by: 
org.neo4j.kernel.impl.storemigration.UpgradeNotAllowedByConfigurationException: 
To enable automatic upgrade, please set allow_store_upgrade in 
configuration properties
at 
org.neo4j.kernel.impl.storemigration.ConfigMapUpgradeConfiguration.checkConfigurationAllowsAutomaticUpgrade(ConfigMapUpgradeConfiguration.java:41)
at 
org.neo4j.kernel.impl.storemigration.StoreUpgrader.attemptUpgrade(StoreUpgrader.java:50)
at 
org.neo4j.kernel.impl.nioneo.store.NeoStore.tryToUpgradeStores(NeoStore.java:127)
at 
org.neo4j.kernel.impl.nioneo.store.NeoStore.verifyCorrectTypeDescriptorAndVersion(NeoStore.java:98)
at 
org.neo4j.kernel.impl.nioneo.store.CommonAbstractStore.loadStorage(CommonAbstractStore.java:196)
at 
org.neo4j.kernel.impl.nioneo.store.CommonAbstractStore.(CommonAbstractStore.java:104)
at 
org.neo4j.kernel.impl.nioneo.store.AbstractStore.(AbstractStore.java:120)
at org.neo4j.kernel.impl.nioneo.store.NeoStore.(NeoStore.java:72)
at 
org.neo4j.kernel.impl.nioneo.xa.NeoStoreXaDataSource.(NeoStoreXaDataSource.java:137)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at 
org.neo4j.kernel.impl.transaction.XaDataSourceManager.create(XaDataSourceManager.java:75)
at 
org.neo4j.kernel.impl.transaction.TxModule.registerDataSource(TxModule.java:147)
... 24 more


which tells me to allow the neo-store to be updated. That spooked me so 
much that I didnt yet try it in earnest, focusing instead on rewriting 
my app to work without thread-interrupts because that was apparently 
messing with lucene, and trying to find the reason why the 
worker-threads' transactions always keep deadlocking... as much as I 
desired that cypher-feature with the RelationshipIndexLookup, there are 
work-arounds, but I'll get around to testing it sometime soon.

Before I do upgrade the store,

   39 MB  neostore.nodestore.db
  412 MB  neostore.propertystore.db
4315 MB  neostore.propertystore.db.arrays
1857 MB  neostore.propertystore.db.strings
1090 MB  neostore.relationshipstore.db
plus 1.6GB of indices,

any idea how long such a neostore-upgrade might take from 1.4.1. to that 
1.5.snapshot? like seconds, minutes, hours, or worse?


Am 02.10.2011 19:25, schrieb Andres Taylor:
> And now it's ready.
>
> If you are using SNAPSHOT, please update your dependencies, and check it
> out.
> http://docs.neo4j.org/chunked/snapshot/query-start.html#start-relationship-by-index-lookup
>
> Thanks again for providing feedback. It's much more fun coding when I know
> someone is using it.
>
> Andrés
>
> On Fri, Sep 30, 2011 at 10:37 AM, Andres Taylor<
> andres.tay...@neotechnology.com>  wrote:
>
>> Hey!
>>
>> This is something that has been planned since the very first iteration of
>> Cypher, but no-one seemed to need it, so I have pushed it in front of me.
>>
>> Now we seem to have an user that wants it, so I'll add it.
>>
>> Don't hold your breath though - it'll be ready when it's ready.
>>
>> Andrés
>>
>>
>> On Thu, Sep 29, 2011 at 1:10 PM, st.pa  wrote:
>>
>>> hi.
>>> when i use a cypher query to get the queued nodes associated via
>>> queue-relationships to a repository-node which has several million other
>>> relationships then it takes about six minutes to fill that result list:
>>>
>>> 
>>> List  list = new ArrayList();
>>> StringBuffer s = new StringBuffer();
>>> s.append("START repository = (");
>>> s.append((Long) controller.getRepositoryNode().getId());
>>> s.append(") MATCH (repository)-[:");
>>> s.append(Rels.REL_REPOSITORY_QUEUE);
>>> s.append("]->(node) RETURN node ORDER BY node.");
>>> s.append(Keys.KEY_TIMESTAMP);
>>> s.append(" SKIP ");
>>> s.append(Integer.toString(offset));
>>> s.append(" LIMIT ");
>>> s.append(Integer.toString(buffersize));
>>> Log.log(s.toString());
>>> Query query = this.parser.parse(s.toString());
>>> ExecutionResult result = this.engine.execute(query);
>>> Iterator  iterator = result.columnAs("node");
>>> while (iterator.hasNext()) {
>>>list.add(iterator.next());
>>> }

Re: [Neo4j] Transparent Distributed Queries?

[amitp]

Hey thanks,

I've just read goldenOrb wiki, it's seem related BUT if I understand
correctly it's helps just with the distribution. I'm looking for a more
complete graph package that can be easily distributed  (I don't want to
implement my own query engine).

So I think I'll need to get into the depths of neo4j and see if I can change
the implentation to work on GoldenOrb Nodes...

Does this make sense? any points before I get lost in the code?

Thanks again,
Amit

--
View this message in context: 
http://neo4j-community-discussions.438527.n3.nabble.com/Transparent-Distributed-Queries-tp3414168p3414876.html
Sent from the Neo4j Community Discussions mailing list archive at Nabble.com.
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Transparent Distributed Queries?

[Alexander Smirnov]

You can try to implement Google Pregel
http://dl.acm.org/citation.cfm?id=1807167.1807184 algorithm on top of Neo4j
or use existing implementation http://www.goldenorbos.org/

On Tue, Oct 11, 2011 at 3:26 PM, amitp  wrote:

> Hey,
>
> - I'm designing a P2P application in which every peer have a partial graph
>
> - some nodes in the partial graph can be proxy nodes which contain contact
> information for another peer
>
> - that peer's partial graph includes that proxy node (and potentially other
> parts of the complete graph)
>
> Any chance you can give me some direction on how to implement this?
> is neo4j suitable? can you recommand something else?
>
> Thanks,
> Amit
>
> --
> View this message in context:
> http://neo4j-community-discussions.438527.n3.nabble.com/Transparent-Distributed-Queries-tp3414168p3414168.html
> Sent from the Neo4j Community Discussions mailing list archive at
> Nabble.com.
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>



-- 
_
entia non sunt multiplicanda praeter necessitatem,
(entities should not be multiplied beyond necessity.)
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

[Neo4j] Transparent Distributed Queries?

[amitp]

Hey,

- I'm designing a P2P application in which every peer have a partial graph

- some nodes in the partial graph can be proxy nodes which contain contact
information for another peer

- that peer's partial graph includes that proxy node (and potentially other
parts of the complete graph)

Any chance you can give me some direction on how to implement this?
is neo4j suitable? can you recommand something else?

Thanks,
Amit

--
View this message in context: 
http://neo4j-community-discussions.438527.n3.nabble.com/Transparent-Distributed-Queries-tp3414168p3414168.html
Sent from the Neo4j Community Discussions mailing list archive at Nabble.com.
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Neo4J + ThingWorx Presentation from QCon...

[Marko Rodriguez]

I thoroughly enjoyed the presentation. Well done.

Marko.

http://markorodriguez.com

On Oct 11, 2011, at 2:01 PM, Rick Bullotta wrote:

> ...is now online.
> 
> http://www.infoq.com/presentations/Graph-Database-Power-Web-of-Things
> 
> Enjoy.
> 
> 
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user

___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

[Neo4j] Neo4J + ThingWorx Presentation from QCon...

[Rick Bullotta]

...is now online.

http://www.infoq.com/presentations/Graph-Database-Power-Web-of-Things

Enjoy.


___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] way to combine search and traversal

[Andres Taylor]

On Tue, Oct 11, 2011 at 10:00 PM,  wrote:

> Hi,
>
> in my database I have different types of data (e.g. addresses, projects,
> activities, milestones, documents) that are connected via relationships.
> Now, I want to give the user of my application the possibilites to find
> parts of the graph which entirely fits the criteria. The criteria targets
> the data (e.g. only addresses from the US) as well as the relationships
> between the data (e.g. only relationships that have the type "general").
> From what understood this can easily be done with cypher.
>
> However, how do I do it when the number of relationships and nodes is more
> than 1?
>

Have a look here:
http://docs.neo4j.org/chunked/snapshot/query-match.html#match-multiple-relationships


>
> Here an example:
>
> Address
> (only addresses from the US)
>  |
> (relationship with the type "contract")
>  |
> Project
> (only projects for which the end date is in the future)
>  |
>  |
>  |
> Milestone
> (only milestones that are this month)
>


A query to get related data given a known project, could look something like
this.

START project=node(...)
MATCH address-[:contract]->project<--milestone
RETURN address, milestone

Did that answer your questions?

Andrés



> And there are more examples possible with even longer paths...
>
> Thanks!
> --
> Empfehlen Sie GMX DSL Ihren Freunden und Bekannten und wir
> belohnen Sie mit bis zu 50,- Euro! https://freundschaftswerbung.gmx.de
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] MUST_NOT in Index.query leads to NPE

[Peter Neubauer]

Dieter,
Could you please raise an issue so we can improve on the exception, maybe
with a test to do this against?

/peter

Sent from my phone.
On Oct 11, 2011 9:39 PM, "D. Frej"  wrote:

> I wrote a small app that entirely uses Lucene and MUST_NOT works fine. On
> the other hand I have no problem using the NOT statement you suggested.
>
> However, I think neo4j should not throw a NPE there. A more comprehensive
> exception would be nice
>
>
>  Original-Nachricht 
> > Datum: Fri, 7 Oct 2011 22:30:00 +0200
> > Von: Michael Hunger 
> > An: Neo4j user discussions 
> > Betreff: Re: [Neo4j] MUST_NOT in Index.query leads to NPE
>
> > I haven't found any lucene docs that describe the use of MUST_NOT in
> > queries:
> >
> > what I found was:
> > http://semeru2007.wordpress.com/2007/10/17/lucene-an-introduction/
> >
> > which would applied to your query mean:
> > > StreetAddress:"Kurfürstendamm 41" AND City:"Zwickau" AND State:"SN" AND
> > ZipCode:"08001" AND Country:"DE" AND
> > -UUID:"03df5826-5236-4075-86dd-1d121e127ade"
> >
> >
> > Am 07.10.2011 um 22:05 schrieb D. Frej:
> >
> > > the final query looks like
> > >
> > > StreetAddress:"Kurfürstendamm 41" AND City:"Zwickau" AND State:"SN" AND
> > ZipCode:"08001" AND Country:"DE" AND UUID:MUST_NOT
> > "03df5826-5236-4075-86dd-1d121e127ade"
> > >
> > > My nodes only have properties of type String
> > >
> > >
> > >
> > >  Original-Nachricht 
> > >> Datum: Fri, 7 Oct 2011 20:50:25 +0200
> > >> Von: Michael Hunger 
> > >> An: Neo4j user discussions 
> > >> Betreff: Re: [Neo4j] MUST_NOT in Index.query leads to NPE
> > >
> > >> What value is your uuid in that case? is it probably null or empty?
> > >>
> > >> Can we see the final query string?
> > >>
> > >> Am 07.10.2011 um 20:25 schrieb dieter_f...@gmx.net:
> > >>
> > >>> Hi everybody,
> > >>>
> > >>> I want to query the Index with the Method query(String). Therefore, I
> > >> build my query and execute the method:
> > >>>
> > >>> StringBuffer query = new StringBuffer();
> > >>> ...
> > >>> query.append(" AND ");
> > >>> query.append("UUID:");
> > >>> query.append("MUST_NOT ");
> > >>> query.append("\"" + uuid + "\"");
> > >>>
> > >>> IndexHits hits = nodeIndex.query(query.toString());
> > >>>
> > >>> This leads to the following Exception:
> > >>>
> > >>> Exception in thread "main" java.lang.NullPointerException
> > >>>   at
> > >>
> >
> org.apache.lucene.util.SimpleStringInterner.intern(SimpleStringInterner.java:54)
> > >>>   at org.apache.lucene.util.StringHelper.intern(StringHelper.java:36)
> > >>>   at org.apache.lucene.index.Term.(Term.java:38)
> > >>>   at
> > >>
> >
> org.apache.lucene.queryParser.QueryParser.getFieldQuery(QueryParser.java:643)
> > >>>   at
> > >>
> >
> org.apache.lucene.queryParser.QueryParser.getFieldQuery(QueryParser.java:752)
> > >>>   at
> > >> org.apache.lucene.queryParser.QueryParser.Term(QueryParser.java:1556)
> > >>>   at
> > >>
> org.apache.lucene.queryParser.QueryParser.Clause(QueryParser.java:1309)
> > >>>   at
> > >> org.apache.lucene.queryParser.QueryParser.Query(QueryParser.java:1266)
> > >>>   at
> > >>
> >
> org.apache.lucene.queryParser.QueryParser.TopLevelQuery(QueryParser.java:1226)
> > >>>   at
> > >> org.apache.lucene.queryParser.QueryParser.parse(QueryParser.java:206)
> > >>>   at org.neo4j.index.impl.lucene.IndexType.query(IndexType.java:281)
> > >>>   at
> > org.neo4j.index.impl.lucene.LuceneIndex.query(LuceneIndex.java:207)
> > >>>   at
> > org.neo4j.index.impl.lucene.LuceneIndex.query(LuceneIndex.java:218)
> > >>>   at testdata.ReadTestData.listInformation(ReadTestData.java:112)
> > >>>   at testdata.ReadTestData.main(ReadTestData.java:153)
> > >>>
> > >>> The syntax of the build query is correct - at least it executes in
> > Luke
> > >> (https://code.google.com/p/luke/) without complaining.
> > >>>
> > >>> Am I doing something wrong or did I miss something?
> > >>>
> > >>> Cheers,
> > >>>
> > >>> Didi
> > >>> --
> > >>> Empfehlen Sie GMX DSL Ihren Freunden und Bekannten und wir
> > >>> belohnen Sie mit bis zu 50,- Euro!
> https://freundschaftswerbung.gmx.de
> > >>> ___
> > >>> Neo4j mailing list
> > >>> User@lists.neo4j.org
> > >>> https://lists.neo4j.org/mailman/listinfo/user
> > >>
> > >> ___
> > >> Neo4j mailing list
> > >> User@lists.neo4j.org
> > >> https://lists.neo4j.org/mailman/listinfo/user
> > >
> > > --
> > > NEU: FreePhone - 0ct/min Handyspartarif mit Geld-zurück-Garantie!
> > > Jetzt informieren: http://www.gmx.net/de/go/freephone
> > > ___
> > > Neo4j mailing list
> > > User@lists.neo4j.org
> > > https://lists.neo4j.org/mailman/listinfo/user
> >
> > ___
> > Neo4j mailing list
> > User@lists.neo4j.org
> > https://lists.neo4j.org/mailman/listinfo/user
>
> --
> NEU: FreePhone - 0ct/min Handyspartarif mit Geld-zurück-Garantie!
> Jetzt informieren: http://ww

[Neo4j] way to combine search and traversal

[dieter_frej]

Hi,

in my database I have different types of data (e.g. addresses, projects, 
activities, milestones, documents) that are connected via relationships. Now, I 
want to give the user of my application the possibilites to find parts of the 
graph which entirely fits the criteria. The criteria targets the data (e.g. 
only addresses from the US) as well as the relationships between the data (e.g. 
only relationships that have the type "general"). From what understood this can 
easily be done with cypher.

However, how do I do it when the number of relationships and nodes is more than 
1?

Here an example:

Address
(only addresses from the US)
 |
(relationship with the type "contract")
 |
Project
(only projects for which the end date is in the future)
 |
 |
 |
Milestone
(only milestones that are this month)

And there are more examples possible with even longer paths...

Thanks!
-- 
Empfehlen Sie GMX DSL Ihren Freunden und Bekannten und wir
belohnen Sie mit bis zu 50,- Euro! https://freundschaftswerbung.gmx.de
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] MUST_NOT in Index.query leads to NPE

[D. Frej]

I wrote a small app that entirely uses Lucene and MUST_NOT works fine. On the 
other hand I have no problem using the NOT statement you suggested.

However, I think neo4j should not throw a NPE there. A more comprehensive 
exception would be nice


 Original-Nachricht 
> Datum: Fri, 7 Oct 2011 22:30:00 +0200
> Von: Michael Hunger 
> An: Neo4j user discussions 
> Betreff: Re: [Neo4j] MUST_NOT in Index.query leads to NPE

> I haven't found any lucene docs that describe the use of MUST_NOT in
> queries:
> 
> what I found was:
> http://semeru2007.wordpress.com/2007/10/17/lucene-an-introduction/
> 
> which would applied to your query mean:
> > StreetAddress:"Kurfürstendamm 41" AND City:"Zwickau" AND State:"SN" AND
> ZipCode:"08001" AND Country:"DE" AND 
> -UUID:"03df5826-5236-4075-86dd-1d121e127ade"
> 
> 
> Am 07.10.2011 um 22:05 schrieb D. Frej:
> 
> > the final query looks like
> > 
> > StreetAddress:"Kurfürstendamm 41" AND City:"Zwickau" AND State:"SN" AND
> ZipCode:"08001" AND Country:"DE" AND UUID:MUST_NOT
> "03df5826-5236-4075-86dd-1d121e127ade"
> > 
> > My nodes only have properties of type String
> > 
> > 
> > 
> >  Original-Nachricht 
> >> Datum: Fri, 7 Oct 2011 20:50:25 +0200
> >> Von: Michael Hunger 
> >> An: Neo4j user discussions 
> >> Betreff: Re: [Neo4j] MUST_NOT in Index.query leads to NPE
> > 
> >> What value is your uuid in that case? is it probably null or empty?
> >> 
> >> Can we see the final query string?
> >> 
> >> Am 07.10.2011 um 20:25 schrieb dieter_f...@gmx.net:
> >> 
> >>> Hi everybody,
> >>> 
> >>> I want to query the Index with the Method query(String). Therefore, I
> >> build my query and execute the method:
> >>> 
> >>> StringBuffer query = new StringBuffer();
> >>> ...
> >>> query.append(" AND ");
> >>> query.append("UUID:");
> >>> query.append("MUST_NOT ");
> >>> query.append("\"" + uuid + "\"");
> >>> 
> >>> IndexHits hits = nodeIndex.query(query.toString());
> >>> 
> >>> This leads to the following Exception:
> >>> 
> >>> Exception in thread "main" java.lang.NullPointerException
> >>>   at
> >>
> org.apache.lucene.util.SimpleStringInterner.intern(SimpleStringInterner.java:54)
> >>>   at org.apache.lucene.util.StringHelper.intern(StringHelper.java:36)
> >>>   at org.apache.lucene.index.Term.(Term.java:38)
> >>>   at
> >>
> org.apache.lucene.queryParser.QueryParser.getFieldQuery(QueryParser.java:643)
> >>>   at
> >>
> org.apache.lucene.queryParser.QueryParser.getFieldQuery(QueryParser.java:752)
> >>>   at
> >> org.apache.lucene.queryParser.QueryParser.Term(QueryParser.java:1556)
> >>>   at
> >> org.apache.lucene.queryParser.QueryParser.Clause(QueryParser.java:1309)
> >>>   at
> >> org.apache.lucene.queryParser.QueryParser.Query(QueryParser.java:1266)
> >>>   at
> >>
> org.apache.lucene.queryParser.QueryParser.TopLevelQuery(QueryParser.java:1226)
> >>>   at
> >> org.apache.lucene.queryParser.QueryParser.parse(QueryParser.java:206)
> >>>   at org.neo4j.index.impl.lucene.IndexType.query(IndexType.java:281)
> >>>   at
> org.neo4j.index.impl.lucene.LuceneIndex.query(LuceneIndex.java:207)
> >>>   at
> org.neo4j.index.impl.lucene.LuceneIndex.query(LuceneIndex.java:218)
> >>>   at testdata.ReadTestData.listInformation(ReadTestData.java:112)
> >>>   at testdata.ReadTestData.main(ReadTestData.java:153)
> >>> 
> >>> The syntax of the build query is correct - at least it executes in
> Luke
> >> (https://code.google.com/p/luke/) without complaining.
> >>> 
> >>> Am I doing something wrong or did I miss something?
> >>> 
> >>> Cheers,
> >>> 
> >>> Didi
> >>> -- 
> >>> Empfehlen Sie GMX DSL Ihren Freunden und Bekannten und wir
> >>> belohnen Sie mit bis zu 50,- Euro! https://freundschaftswerbung.gmx.de
> >>> ___
> >>> Neo4j mailing list
> >>> User@lists.neo4j.org
> >>> https://lists.neo4j.org/mailman/listinfo/user
> >> 
> >> ___
> >> Neo4j mailing list
> >> User@lists.neo4j.org
> >> https://lists.neo4j.org/mailman/listinfo/user
> > 
> > -- 
> > NEU: FreePhone - 0ct/min Handyspartarif mit Geld-zurück-Garantie!   
> > Jetzt informieren: http://www.gmx.net/de/go/freephone
> > ___
> > Neo4j mailing list
> > User@lists.neo4j.org
> > https://lists.neo4j.org/mailman/listinfo/user
> 
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user

-- 
NEU: FreePhone - 0ct/min Handyspartarif mit Geld-zurück-Garantie!   
Jetzt informieren: http://www.gmx.net/de/go/freephone
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

[Neo4j] [Announcement] Neo4j 1.5.M02 released

[Peter Neubauer]

Hi all,
finally we could release Neo4j 1.5.M02 after some intensive QA run. A
big thanks to everyone that has given input to the issues at
https://github.com/neo4j/community/issues?milestone=1&state=closed and
helped making this a good last test before 1.5 GA!

For more details, see
http://blog.neo4j.org/2011/10/announcing-neo4j-15-boden-bord.html
(don't mind the guy on the pic, it IS a good summary :)

Cheers,

/peter neubauer

GTalk:      neubauer.peter
Skype       peter.neubauer
Phone       +46 704 106975
LinkedIn   http://www.linkedin.com/in/neubauer
Twitter      http://twitter.com/peterneubauer

http://www.neo4j.org               - Your high performance graph database.
http://startupbootcamp.org/    - Öresund - Innovation happens HERE.
http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

[Neo4j] Node index in Neo4j REST server

[andrew ton]

Hello,

I have a question about indexing in Neo4j REST server. For some reason I may 
need to create multiple node indexes in REST server.
Is there any limit number of indexing I am allowed to create?

Thanks,
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Mapping domain graph to spatial layer

[Marcin Zpa]

Hi Peter,
thanks a lot for your quick feedback. What do you mean with skipping
encoding step? That means that i could directly index my domain
coordinate node and do not create any additional "geo" nodes. Sorry if
you find this question stupid or obvious but i cant follow your
suggestion. For me important thing is that after invoking search i
want to somehow get back from results provided as
SpatialDatabaserecord to domain nodes as for example user.

Thanks in advance!


--
View this message in context: 
http://neo4j-community-discussions.438527.n3.nabble.com/Mapping-domain-graph-to-spatial-layer-tp3409159p3413184.html
Sent from the Neo4j Community Discussions mailing list archive at Nabble.com.
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] count(distinct) with Cypher?

[Andres Taylor]

On Mon, Oct 10, 2011 at 9:42 PM, Andres Taylor <
andres.tay...@neotechnology.com> wrote:

> On Mon, Oct 10, 2011 at 9:10 PM, Tero Paananen  wrote:
>
>> Does Cypher support count(distinct) type of queries?
>>
>
> Tero,
>
> No, it doesn't yet.  It's planned for, but won't make it into 1.5.
>

I lied. After talking it through with Tobias Ivarsson, I realized that it
was easier than I first thought.

It's in now. If you are using snapshot, update to the latest version.

Andrés
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Trying to use Neo4J with Atomikos transaction manager, issues with Lucene index

[tcolar]

Very good, thanks a lot.

On 10/11/11 1:21 AM, chris.gioran [via Neo4j Community Discussions] wrote:
> Hi Thibaut,
>
> we currently have a working solution that changes the commitCows()
> call from a during commit call to an afterCompletion synchronization.
> It seems to work fine and your test case passes. Essentially it roots
> out the implicit assumption in that part of the kernel that he
> transaction should be available during the commit.
> There is a code freeze in place however in preparation for the
> upcoming milestone release, so you could either wait for the release
> after that or clone the source shortly after, probably late this week.
>
> hope that helps,
> CG
>
> On Tue, Oct 11, 2011 at 8:01 AM, tcolar <[hidden email] 
> > wrote:
>
> > Hi Chris.
> > I don't mean to pressure, I write OSS myself and I know time is
> > available whenever it is, so i just have some quick questions about 
> this
> > issue.
> >
> > Basically I just need to decided whether to shelf this feature of our
> > project for now or if i can get any idea on how much work / how long it
> > would take to get it working.
> >
> > 1) Do you think it's an issue with atomikos itself and I should I bring
> > the issue to them ?
> > 2) Is that something that would be fixed in neo4j itself, if so do you
> > have any rough estimates ?
> > 3) Is there some sort of workaround you could think of that I could
> > implement ?
> >
> > Any other suggestions or ammount of work/time needed would be 
> appreciated.
> >
> > Thanks.
> >
> >
> > --
> > View this message in context: 
> http://neo4j-community-discussions.438527.n3.nabble.com/Trying-to-use-Neo4J-with-Atomikos-transaction-manager-issues-with-Lucene-index-tp3400319p3411656.html
> > Sent from the Neo4j Community Discussions mailing list archive at 
> Nabble.com.
> > ___
> > Neo4j mailing list
> > [hidden email] 
> > https://lists.neo4j.org/mailman/listinfo/user
> >
> ___
> Neo4j mailing list
> [hidden email] 
> https://lists.neo4j.org/mailman/listinfo/user
>
>
> 
> If you reply to this email, your message will be added to the 
> discussion below:
> http://neo4j-community-discussions.438527.n3.nabble.com/Trying-to-use-Neo4J-with-Atomikos-transaction-manager-issues-with-Lucene-index-tp3400319p3411962.html
>  
>
> To unsubscribe from Trying to use Neo4J with Atomikos transaction 
> manager, issues with Lucene index, click here 
> .
>  
>



--
View this message in context: 
http://neo4j-community-discussions.438527.n3.nabble.com/Trying-to-use-Neo4J-with-Atomikos-transaction-manager-issues-with-Lucene-index-tp3400319p3412696.html
Sent from the Neo4j Community Discussions mailing list archive at Nabble.com.
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Big Traverser perfomance : are '23 rels per milliseconds' good ?

[Guillaume ALLEE]

Hi Peter,

Now It seems ok (though I do not know why).

I even tried to increase the value to :
neostore.nodestore.db.mapped_memory=400M
neostore.propertystore.db.arrays.mapped_memory=200M
neostore.propertystore.db.index.keys.mapped_memory=10M
neostore.propertystore.db.index.mapped_memory=10M
neostore.propertystore.db.mapped_memory=2000M
neostore.propertystore.db.strings.mapped_memory=400M
neostore.relationshipstore.db.mapped_memory=1600M

However, the performance increased a bit (20%)  but not that much : I am 
traversing 130 rels per millisecond.
I would be cool to have 500 rels per millisec ;-)
I did check vmstat during the run and it does not seem to swap.

BR.

Guillaume

De : Peter Neubauer [via Neo4j Community Discussions] 
[mailto:ml-node+s438527n3411947...@n3.nabble.com]
Envoyé : mardi 11 octobre 2011 10:16
À : Allee, Guillaume
Objet : Re: [Neo4j] Big Traverser perfomance : are '23 rels per milliseconds' 
good ?

Guillaume,
the memory mapping happens outside the JVM. As such there is no
guarantee that you actually have that memory and you need to make sure
no other proceses are competing on that, e.g. you browser which might
take a large chunk of the memory you have on the machine (5GB-2.2GB
for the JVM)

Could you check that you have memory available?

Cheers,

/peter neubauer

GTalk:  neubauer.peter
Skype   peter.neubauer
Phone   +46 704 106975
LinkedIn   http://www.linkedin.com/in/neubauer
Twitter  http://twitter.com/peterneubauer

http://www.neo4j.org ">http://www.neo4j.org   - Your high 
performance graph database.
http://startupbootcamp.org/- Öresund - Innovation happens HERE.
http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.



On Mon, Oct 10, 2011 at 1:54 PM, Guillaume ALLEE
<[hidden email]> wrote:

> Hi Michael,
>
> I tried to lower the values by 30% => same and then by 50% => same again.
> (MapMemException)
> Here is the message.log http://pastebin.com/bvhhZfjZ
>
> My neo4j.properties looks like that :
>
> neostore.nodestore.db.mapped_memory=100M
> neostore.propertystore.db.arrays.mapped_memory=50M
> neostore.propertystore.db.index.keys.mapped_memory=1M
> neostore.propertystore.db.index.mapped_memory=1M
> neostore.propertystore.db.mapped_memory=500M
> neostore.propertystore.db.strings.mapped_memory=200M
> neostore.relationshipstore.db.mapped_memory=400M
>
> Any idea ?
>
> --
> View this message in context: 
> http://neo4j-community-discussions.438527.n3.nabble.com/Big-Traverser-perfomance-are-23-rels-per-milliseconds-good-tp3400711p3409259.html
> Sent from the Neo4j Community Discussions mailing list archive at Nabble.com.
> ___
> Neo4j mailing list
> [hidden email]
> https://lists.neo4j.org/mailman/listinfo/user
>
___
Neo4j mailing list
[hidden email]
https://lists.neo4j.org/mailman/listinfo/user


If you reply to this email, your message will be added to the discussion below:
http://neo4j-community-discussions.438527.n3.nabble.com/Big-Traverser-perfomance-are-23-rels-per-milliseconds-good-tp3400711p3411947.html
To unsubscribe from Big Traverser perfomance : are '23 rels per milliseconds' 
good ?, click 
here.






This message contains information that may be privileged or confidential and is 
the property of the Capgemini Group. It is 
intended only for the person to whom it is addressed. If you are not the 
intended recipient, you are not authorized to 
read, print, retain, copy, disseminate, distribute, or use this message or any 
part thereof. If you receive this message 
in error, please notify the sender immediately and delete all copies of this 
message.


--
View this message in context: 
http://neo4j-community-discussions.438527.n3.nabble.com/Big-Traverser-perfomance-are-23-rels-per-milliseconds-good-tp3400711p3412391.html
Sent from the Neo4j Community Discussions mailing list archive at Nabble.com.
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Importing data from oracle to neo4j

[Peter Neubauer]

Hi there,
yes, the utility is converting m:n into relationships, see
https://github.com/peterneubauer/sql-import and
https://github.com/peterneubauer/sql-import/blob/master/src/test/java/com/neo4j/sqlimport/InsertTest.java
fro an eample.

Let me know if that helps!

Cheers,

/peter neubauer

GTalk:      neubauer.peter
Skype       peter.neubauer
Phone       +46 704 106975
LinkedIn   http://www.linkedin.com/in/neubauer
Twitter      http://twitter.com/peterneubauer

http://www.neo4j.org               - Your high performance graph database.
http://startupbootcamp.org/    - Öresund - Innovation happens HERE.
http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.



On Sat, Oct 8, 2011 at 11:14 PM, Michael Hunger
 wrote:
> What is your use-case for importing the DWH data?
>
> How are you going to model the data of the DWH in neo4j. How does the 
> domain-model look like?
>
> BI data is normally denormalized. So for creating a good graph structure it 
> would be sensible to normalize it during the import.
>
> 10k rows is not that much. You can import them using the normal neo4j 
> transactional facilities in a few seconds.
> For building up your graph model you probably want to index your data or 
> create category nodes to access certain parts of your domain model.
>
> Peter wrote a tool to import relational data into neo4j but that was 
> normalized data where each table was represented by a certain type of node in 
> the graph and foreign key relationships were converted to graph 
> relationships. I don't know if that also handled m:n connection tables 
> efficiently by converting them to relationships too.
>
> HTH
>
> Michael
>
> Am 08.10.2011 um 23:05 schrieb jiteshks:
>
>> I am very new to neo4j.So I don't know all of its features.I am reading its
>> documentation to understand how it works.
>>
>> My project's requirement is to import the data from a data warehouse( which
>> is an oracle db) once every month.We are thinking of implementing neo4j in
>> our project which means we will have to read the data from oracle db and put
>> it into neo4j.
>> There will be around 1 lakh rows(10^5) to be fetched from oracle db.What is
>> the fast/efficient way of doing it?
>>
>> Thanks!
>>
>> --
>> View this message in context: 
>> http://neo4j-community-discussions.438527.n3.nabble.com/Importing-data-from-oracle-to-neo4j-tp3406024p3406024.html
>> Sent from the Neo4j Community Discussions mailing list archive at Nabble.com.
>> ___
>> Neo4j mailing list
>> User@lists.neo4j.org
>> https://lists.neo4j.org/mailman/listinfo/user
>
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Trying to use Neo4J with Atomikos transaction manager, issues with Lucene index

[Chris Gioran]

Hi Thibaut,

we currently have a working solution that changes the commitCows()
call from a during commit call to an afterCompletion synchronization.
It seems to work fine and your test case passes. Essentially it roots
out the implicit assumption in that part of the kernel that he
transaction should be available during the commit.
There is a code freeze in place however in preparation for the
upcoming milestone release, so you could either wait for the release
after that or clone the source shortly after, probably late this week.

hope that helps,
CG

On Tue, Oct 11, 2011 at 8:01 AM, tcolar  wrote:
> Hi Chris.
> I don't mean to pressure, I write OSS myself and I know time is
> available whenever it is, so i just have some quick questions about this
> issue.
>
> Basically I just need to decided whether to shelf this feature of our
> project for now or if i can get any idea on how much work / how long it
> would take to get it working.
>
> 1) Do you think it's an issue with atomikos itself and I should I bring
> the issue to them ?
> 2) Is that something that would be fixed in neo4j itself, if so do you
> have any rough estimates ?
> 3) Is there some sort of workaround you could think of that I could
> implement ?
>
> Any other suggestions or ammount of work/time needed would be appreciated.
>
> Thanks.
>
>
> --
> View this message in context: 
> http://neo4j-community-discussions.438527.n3.nabble.com/Trying-to-use-Neo4J-with-Atomikos-transaction-manager-issues-with-Lucene-index-tp3400319p3411656.html
> Sent from the Neo4j Community Discussions mailing list archive at Nabble.com.
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Big Traverser perfomance : are '23 rels per milliseconds' good ?

[Peter Neubauer]

Guillaume,
the memory mapping happens outside the JVM. As such there is no
guarantee that you actually have that memory and you need to make sure
no other proceses are competing on that, e.g. you browser which might
take a large chunk of the memory you have on the machine (5GB-2.2GB
for the JVM)

Could you check that you have memory available?

Cheers,

/peter neubauer

GTalk:      neubauer.peter
Skype       peter.neubauer
Phone       +46 704 106975
LinkedIn   http://www.linkedin.com/in/neubauer
Twitter      http://twitter.com/peterneubauer

http://www.neo4j.org               - Your high performance graph database.
http://startupbootcamp.org/    - Öresund - Innovation happens HERE.
http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.



On Mon, Oct 10, 2011 at 1:54 PM, Guillaume ALLEE
 wrote:
> Hi Michael,
>
> I tried to lower the values by 30% => same and then by 50% => same again.
> (MapMemException)
> Here is the message.log http://pastebin.com/bvhhZfjZ
>
> My neo4j.properties looks like that :
>
> neostore.nodestore.db.mapped_memory=100M
> neostore.propertystore.db.arrays.mapped_memory=50M
> neostore.propertystore.db.index.keys.mapped_memory=1M
> neostore.propertystore.db.index.mapped_memory=1M
> neostore.propertystore.db.mapped_memory=500M
> neostore.propertystore.db.strings.mapped_memory=200M
> neostore.relationshipstore.db.mapped_memory=400M
>
> Any idea ?
>
> --
> View this message in context: 
> http://neo4j-community-discussions.438527.n3.nabble.com/Big-Traverser-perfomance-are-23-rels-per-milliseconds-good-tp3400711p3409259.html
> Sent from the Neo4j Community Discussions mailing list archive at Nabble.com.
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Embedded neo4j in Python up to date again

[Jacob Hansson]

Agreed. It was Tobias that came up with that solution, I quite like it as
well, clean and simple.

/Jake

On Tue, Oct 11, 2011 at 6:00 AM, Tim McNamara
wrote:

> This is great news. I love that it uses context managers for transactions.
>
> On 7 October 2011 02:06, Jacob Hansson 
> wrote:
> > On Thu, Oct 6, 2011 at 1:57 PM, Peter Neubauer <
> > peter.neuba...@neotechnology.com> wrote:
> >
> >> Yes Javier,
> >> that would be great! Do you think you could open an issue and provide
> >> some details on how to go about it?
> >>
> >> Cheers,
> >>
> >> /peter neubauer
> >>
> >> GTalk:  neubauer.peter
> >> Skype   peter.neubauer
> >> Phone   +46 704 106975
> >> LinkedIn   http://www.linkedin.com/in/neubauer
> >> Twitter  http://twitter.com/peterneubauer
> >>
> >> http://www.neo4j.org   - Your high performance graph
> database.
> >> http://startupbootcamp.org/- Öresund - Innovation happens HERE.
> >> http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.
> >>
> >>
> >>
> >> On Wed, Oct 5, 2011 at 5:15 PM, Javier de la Rosa 
> >> wrote:
> >> > On Wed, Oct 5, 2011 at 07:48, Jacob Hansson
> >> >  wrote:
> >> >> there is now a first stable release of the new "neo4j-embedded"
> >> >> python package available from PyPi.
> >> >
> >> > This news is really great! And I'm very glad to see that some methods
> >> > are seemed to the neo4j-rest-client [1]. Is there any chance to find
> >> > some day from neo4j import restgraphdatabase and to make both
> >> > API's totally equal?
> >> >
> >> > Thank you very much for all the work involved.
> >> > Regards!
> >> >
> >> >
> >> >
> >> > [1] https://github.com/versae/neo4j-rest-client
> >> >
> >> > --
> >> > Javier de la Rosa
> >> > http://versae.es
> >> > ___
> >> > Neo4j mailing list
> >> > User@lists.neo4j.org
> >> > https://lists.neo4j.org/mailman/listinfo/user
> >> >
> >> ___
> >> Neo4j mailing list
> >> User@lists.neo4j.org
> >> https://lists.neo4j.org/mailman/listinfo/user
> >>
> >
> > Javier,
> >
> > it would be really awesome to combine the two, or at least make sure the
> > APIs are completely compatible.
> >
> > I'm hesitant to bundle them together, because the REST client is pure
> > python, and can keep a very small footprint. The embedded package, on the
> > other hand, bundles the full Neo4j distribution, and so it's a full 10MB
> > large.
> >
> > In most settings, this won't matter much, but it still feels unnecessary
> to
> > force people who just want the REST client to include the full DB
> > distribution in their projects.
> >
> >
> > Architecture-wise, perhaps we can have a common front for them, that can
> > then be powered either by the embedded implementation, or by the REST
> > client, and then use something like the db path to determine which one to
> > use:
> >
> > from neo4j import GraphDatabase
> >
> > embeddeddb = GraphDatabase('/home/data')
> > serverdb = GraphDatabase('http://localhost:7474')
> >
> >
> > There is one major hurdle we need to get past first, we need to implement
> > transaction support in the REST API that is feature-compatible with the
> > embedded transaction API. When that is in place, the REST client will be
> > able to behave exactly like the embedded client, and we can combine them.
> >
> > /Jake
> >
> > --
> > Jacob Hansson
> > Phone: +46 (0) 763503395
> > Twitter: @jakewins
> > ___
> > Neo4j mailing list
> > User@lists.neo4j.org
> > https://lists.neo4j.org/mailman/listinfo/user
> >
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>



-- 
Jacob Hansson
Phone: +46 (0) 763503395
Twitter: @jakewins
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user

Re: [Neo4j] Boston meet-up

[Peter Neubauer]

Argh,
most of the Neo team are in Chicago at that time. Anyone else around
to talk Bio, Genes and Graphs?

Cheers,

/peter neubauer

GTalk:      neubauer.peter
Skype       peter.neubauer
Phone       +46 704 106975
LinkedIn   http://www.linkedin.com/in/neubauer
Twitter      http://twitter.com/peterneubauer

http://www.neo4j.org               - Your high performance graph database.
http://startupbootcamp.org/    - Öresund - Innovation happens HERE.
http://www.thoughtmade.com - Scandinavia's coolest Bring-a-Thing party.



On Mon, Oct 10, 2011 at 9:56 PM, Pablo Pareja  wrote:
> Hi!
>
> I'll be in Boston from October 25th to October 29th, will any of you be in
> the area
> any of these days?
> Cheers,
>
> Pablo
>
> --
> Pablo Pareja Tobes
> LinkedIn    http://www.linkedin.com/in/pabloparejatobes
> Twitter       http://www.twitter.com/pablopareja
>
> http://about.me/pablopareja
> http://www.ohnosequences.com
> ___
> Neo4j mailing list
> User@lists.neo4j.org
> https://lists.neo4j.org/mailman/listinfo/user
>
___
Neo4j mailing list
User@lists.neo4j.org
https://lists.neo4j.org/mailman/listinfo/user