stanbol.enhancer.chain.weighted.chain=["tika;optional","langdetect","opennlp-sentence","opennlp-token","opennlp-pos","opennlp-ner","dbpediaLinking","entityhubExtraction","dbpedia-dereference","pos-chunker"]
service.ranking=I"-2147483648"
stanbol.enhancer.chain.name="default"
2014-03-20 7:39 GMT+02:00 Rupert Westenthaler <rupert.westentha...@gmail.com
>:
> Hi Cristian,
>
> you can not send attachments to the list. Please copy the contents
> directly to the mail
>
> thx
> Rupert
>
> On Wed, Mar 19, 2014 at 9:20 PM, Cristian Petroaca
> <cristian.petro...@gmail.com> wrote:
> > The config attached.
> >
> >
> > 2014-03-19 9:09 GMT+02:00 Rupert Westenthaler
> > <rupert.westentha...@gmail.com>:
> >
> >> Hi Cristian,
> >>
> >> can you provide the contents of the chain after your modifications?
> >> Would be interesting to test why the chain is no longer active after
> >> the restart.
> >>
> >> You can find the config file in the 'stanbol/fileinstall' folder.
> >>
> >> best
> >> Rupert
> >>
> >> On Tue, Mar 18, 2014 at 8:24 PM, Cristian Petroaca
> >> <cristian.petro...@gmail.com> wrote:
> >> > Related to the default chain selection rules : before restart I had a
> >> > chain
> >> > with the name 'default' as in I could access it via
> >> > enhancer/chain/default.
> >> > Then I just added another engine to the 'default' chain. I assumed
> that
> >> > after the restart the chain with the 'default' name would be
> persisted.
> >> > So
> >> > the first rule should have been applied after the restart as well. But
> >> > instead I cannot reach it via enhancer/chain/default anymore so its
> >> > gone.
> >> > Anyway, this is not a big deal, it's not blocking me in any way, I
> just
> >> > wanted to understand where the problem is.
> >> >
> >> >
> >> > 2014-03-18 7:15 GMT+02:00 Rupert Westenthaler
> >> > <rupert.westentha...@gmail.com
> >> >>:
> >> >
> >> >> Hi Cristian
> >> >>
> >> >> On Mon, Mar 17, 2014 at 9:43 PM, Cristian Petroaca
> >> >> <cristian.petro...@gmail.com> wrote:
> >> >> > 1. Updated to the latest code and it's gone. Cool
> >> >> >
> >> >> > 2. I start the stable launcher -> create a new instance of the
> >> >> > PosChunkerEngine -> add it to the default chain. At this point
> >> >> > everything
> >> >> > looks good and works ok.
> >> >> > After I restart the server the default chain is gone and instead I
> >> >> > see
> >> >> this
> >> >> > in the enhancement chains page : all-active (default, id: 149,
> >> >> > ranking:
> >> >> 0,
> >> >> > impl: AllActiveEnginesChain ). all-active did not contain the
> >> >> > 'default'
> >> >> > word before the restart.
> >> >> >
> >> >>
> >> >> Please note the default chain selection rules as described at [1].
> You
> >> >> can also access chains chains under '/enhancer/chain/{chain-name}'
> >> >>
> >> >> best
> >> >> Rupert
> >> >>
> >> >> [1]
> >> >>
> >> >>
> http://stanbol.staging.apache.org/docs/trunk/components/enhancer/chains/#default-chain
> >> >>
> >> >> > It looks like the config files are exactly what I need. Thanks.
> >> >> >
> >> >> >
> >> >> > 2014-03-17 9:26 GMT+02:00 Rupert Westenthaler <
> >> >> rupert.westentha...@gmail.com
> >> >> >>:
> >> >> >
> >> >> >> On Sat, Mar 15, 2014 at 8:34 PM, Cristian Petroaca
> >> >> >> <cristian.petro...@gmail.com> wrote:
> >> >> >> > Thanks Rupert.
> >> >> >> >
> >> >> >> > A couple more questions/issues :
> >> >> >> >
> >> >> >> > 1. Whenever I start the stanbol server I'm seeing this in the
> >> >> >> > console
> >> >> >> > output :
> >> >> >> >
> >> >> >>
> >> >> >> This should be fixed with STANBOL-1278 [1] [2]
> >> >> >>
> >> >> >> > 2. Whenever I restart the server the Weighted Chains get messed
> >> >> >> > up. I
> >> >> >> > usually use the 'default' chain and add my engine to it so there
> >> >> >> > are
> >> >> 11
> >> >> >> > engines in it. After the restart this chain now contains around
> 23
> >> >> >> engines
> >> >> >> > in total.
> >> >> >>
> >> >> >> I was not able to replicate this. What I tried was
> >> >> >>
> >> >> >> (1) start up the stable launcher
> >> >> >> (2) add an additional engine to the default chain
> >> >> >> (3) restart the launcher
> >> >> >>
> >> >> >> The default chain was not changed after (2) and (3). So I would
> need
> >> >> >> further information for knowing why this is happening.
> >> >> >>
> >> >> >> Generally it is better to create you own chain instance as
> modifying
> >> >> >> one that is provided by the default configuration. I would also
> >> >> >> recommend that you keep your test configuration in text files and
> to
> >> >> >> copy those to the 'stanbol/fileinstall' folder. Doing so prevent
> you
> >> >> >> from manually entering the configuration after a software update.
> >> >> >> The
> >> >> >> production-mode section [3] provides information on how to do
> that.
> >> >> >>
> >> >> >> best
> >> >> >> Rupert
> >> >> >>
> >> >> >> [1] https://issues.apache.org/jira/browse/STANBOL-1278
> >> >> >> [2] http://svn.apache.org/r1576623
> >> >> >> [3] http://stanbol.apache.org/docs/trunk/production-mode
> >> >> >>
> >> >> >> > ERROR: Bundle org.apache.stanbol.enhancer.engine.topic.web
> [153]:
> >> >> Error
> >> >> >> > starting
> >> >> >> >
> >> >> >>
> >> >>
> >> >>
> slinginstall:c:\Data\Projects\Stanbol\main\launchers\stable\target\stanbol\star
> >> >> >> >
> >> >> >> >
> tup\35\org.apache.stanbol.enhancer.engine.topic.web-1.0.0-SNAPSHOT.jar
> >> >> >> > (org.osgi
> >> >> >> > .framework.BundleException: Unresolved constraint in bundle
> >> >> >> > org.apache.stanbol.e
> >> >> >> > nhancer.engine.topic.web [153]: Unable to resolve 153.0: missing
> >> >> >> > requirement [15
> >> >> >> > 3.0] package; (&(package=javax.ws.rs
> >> >> >> )(version>=0.0.0)(!(version>=2.0.0))))
> >> >> >> > org.osgi.framework.BundleException: Unresolved constraint in
> >> >> >> > bundle
> >> >> >> > org.apache.s
> >> >> >> > tanbol.enhancer.engine.topic.web [153]: Unable to resolve 153.0:
> >> >> missing
> >> >> >> > require
> >> >> >> > ment [153.0] package; (&(package=javax.ws.rs
> >> >> >> > )(version>=0.0.0)(!(version>=2.0.0))
> >> >> >> > )
> >> >> >> > at
> >> >> >> org.apache.felix.framework.Felix.resolveBundle(Felix.java:3443)
> >> >> >> > at
> >> >> org.apache.felix.framework.Felix.startBundle(Felix.java:1727)
> >> >> >> > at
> >> >> >> >
> >> >> >> >
> org.apache.felix.framework.Felix.setActiveStartLevel(Felix.java:1156)
> >> >> >> >
> >> >> >> > at
> >> >> >> >
> >> >> >> >
> org.apache.felix.framework.StartLevelImpl.run(StartLevelImpl.java:264
> >> >> >> > )
> >> >> >> > at java.lang.Thread.run(Unknown Source)
> >> >> >> >
> >> >> >> > Despite of this the server starts fine and I can use the
> enhancer
> >> >> fine.
> >> >> >> Do
> >> >> >> > you guys see this as well?
> >> >> >> >
> >> >> >> >
> >> >> >> > 2. Whenever I restart the server the Weighted Chains get messed
> >> >> >> > up. I
> >> >> >> > usually use the 'default' chain and add my engine to it so there
> >> >> >> > are
> >> >> 11
> >> >> >> > engines in it. After the restart this chain now contains around
> 23
> >> >> >> engines
> >> >> >> > in total.
> >> >> >> >
> >> >> >> >
> >> >> >> >
> >> >> >> >
> >> >> >> > 2014-03-11 9:47 GMT+02:00 Rupert Westenthaler <
> >> >> >> rupert.westentha...@gmail.com
> >> >> >> >>:
> >> >> >> >
> >> >> >> >> Hi Cristian,
> >> >> >> >>
> >> >> >> >> NER Annotations are typically available as both
> >> >> >> >> NlpAnnotations.NER_ANNOTATION and fise:TextAnnotation [1] in
> the
> >> >> >> >> enhancement metadata. As you are already accessing the
> >> >> >> >> AnayzedText I
> >> >> >> >> would prefer using the NlpAnnotations.NER_ANNOTATION.
> >> >> >> >>
> >> >> >> >> best
> >> >> >> >> Rupert
> >> >> >> >>
> >> >> >> >> [1]
> >> >> >> >>
> >> >> >>
> >> >>
> >> >>
> http://stanbol.apache.org/docs/trunk/components/enhancer/enhancementstructure.html#fisetextannotation
> >> >> >> >>
> >> >> >> >> On Mon, Mar 10, 2014 at 10:07 PM, Cristian Petroaca
> >> >> >> >> <cristian.petro...@gmail.com> wrote:
> >> >> >> >> > Thanks.
> >> >> >> >> > I assume I should get the Named entities using the same but
> >> >> >> >> > with
> >> >> >> >> > NlpAnnotations.NER_ANNOTATION?
> >> >> >> >> >
> >> >> >> >> >
> >> >> >> >> >
> >> >> >> >> > 2014-03-10 13:29 GMT+02:00 Rupert Westenthaler <
> >> >> >> >> > rupert.westentha...@gmail.com>:
> >> >> >> >> >
> >> >> >> >> >> Hallo Cristian,
> >> >> >> >> >>
> >> >> >> >> >> NounPhrases are not added to the RDF enhancement results.
> You
> >> >> need to
> >> >> >> >> >> use the AnalyzedText ContentPart [1]
> >> >> >> >> >>
> >> >> >> >> >> here is some demo code you can use in the computeEnhancement
> >> >> method
> >> >> >> >> >>
> >> >> >> >> >> AnalysedText at =
> >> >> >> >> >> NlpEngineHelper.getAnalysedText(this,
> >> >> ci,
> >> >> >> >> true);
> >> >> >> >> >> Iterator<? extends Section> sections =
> >> >> >> >> >> at.getSentences();
> >> >> >> >> >> if(!sections.hasNext()){ //process as single
> sentence
> >> >> >> >> >> sections = Collections.singleton(at).iterator();
> >> >> >> >> >> }
> >> >> >> >> >>
> >> >> >> >> >> while(sections.hasNext()){
> >> >> >> >> >> Section section = sections.next();
> >> >> >> >> >> Iterator<Span> chunks =
> >> >> >> >> >> section.getEnclosed(EnumSet.of(SpanTypeEnum.Chunk));
> >> >> >> >> >> while(chunks.hasNext()){
> >> >> >> >> >> Span chunk = chunks.next();
> >> >> >> >> >> Value<PhraseTag> phrase =
> >> >> >> >> >> chunk.getAnnotation(NlpAnnotations.PHRASE_ANNOTATION);
> >> >> >> >> >> if(phrase.value().getCategory() ==
> >> >> >> >> LexicalCategory.Noun){
> >> >> >> >> >> log.info(" - NounPhrase [{},{}] {}",
> new
> >> >> >> Object[]{
> >> >> >> >> >>
> >> >> >> >> >> chunk.getStart(),chunk.getEnd(),chunk.getSpan()});
> >> >> >> >> >> }
> >> >> >> >> >> }
> >> >> >> >> >> }
> >> >> >> >> >>
> >> >> >> >> >> hope this helps
> >> >> >> >> >>
> >> >> >> >> >> best
> >> >> >> >> >> Rupert
> >> >> >> >> >>
> >> >> >> >> >> [1]
> >> >> >> >> >>
> >> >> >> >>
> >> >> >>
> >> >>
> >> >>
> http://stanbol.apache.org/docs/trunk/components/enhancer/nlp/analyzedtext
> >> >> >> >> >>
> >> >> >> >> >> On Sun, Mar 9, 2014 at 6:07 PM, Cristian Petroaca
> >> >> >> >> >> <cristian.petro...@gmail.com> wrote:
> >> >> >> >> >> > I started to implement the engine and I'm having problems
> >> >> >> >> >> > with
> >> >> >> getting
> >> >> >> >> >> > results for noun phrases. I modified the "default"
> weighted
> >> >> chain
> >> >> >> to
> >> >> >> >> also
> >> >> >> >> >> > include the PosChunkerEngine and ran a sample text :
> "Angela
> >> >> Merkel
> >> >> >> >> >> visted
> >> >> >> >> >> > China. The german chancellor met with various people". I
> >> >> expected
> >> >> >> that
> >> >> >> >> >> the
> >> >> >> >> >> > RDF XML output would contain some info about the noun
> >> >> >> >> >> > phrases
> >> >> but I
> >> >> >> >> >> cannot
> >> >> >> >> >> > see any.
> >> >> >> >> >> > Could you point me to the correct way to generate the noun
> >> >> phrases?
> >> >> >> >> >> >
> >> >> >> >> >> > Thanks,
> >> >> >> >> >> > Cristian
> >> >> >> >> >> >
> >> >> >> >> >> >
> >> >> >> >> >> > 2014-02-09 14:15 GMT+02:00 Cristian Petroaca <
> >> >> >> >> >> cristian.petro...@gmail.com>:
> >> >> >> >> >> >
> >> >> >> >> >> >> Opened
> https://issues.apache.org/jira/browse/STANBOL-1279
> >> >> >> >> >> >>
> >> >> >> >> >> >>
> >> >> >> >> >> >> 2014-02-07 10:53 GMT+02:00 Cristian Petroaca <
> >> >> >> >> >> cristian.petro...@gmail.com>
> >> >> >> >> >> >> :
> >> >> >> >> >> >>
> >> >> >> >> >> >> Hi Rupert,
> >> >> >> >> >> >>>
> >> >> >> >> >> >>> The "spatial" dimension is a good idea. I'll also take a
> >> >> >> >> >> >>> look
> >> >> at
> >> >> >> >> Yago.
> >> >> >> >> >> >>>
> >> >> >> >> >> >>> I will create a Jira with what we talked about here. It
> >> >> >> >> >> >>> will
> >> >> >> >> probably
> >> >> >> >> >> >>> have just a draft-like description for now and will be
> >> >> >> >> >> >>> updated
> >> >> >> as I
> >> >> >> >> go
> >> >> >> >> >> >>> along.
> >> >> >> >> >> >>>
> >> >> >> >> >> >>> Thanks,
> >> >> >> >> >> >>> Cristian
> >> >> >> >> >> >>>
> >> >> >> >> >> >>>
> >> >> >> >> >> >>> 2014-02-06 15:39 GMT+02:00 Rupert Westenthaler <
> >> >> >> >> >> >>> rupert.westentha...@gmail.com>:
> >> >> >> >> >> >>>
> >> >> >> >> >> >>> Hi Cristian,
> >> >> >> >> >> >>>>
> >> >> >> >> >> >>>> definitely an interesting approach. You should have a
> >> >> >> >> >> >>>> look at
> >> >> >> Yago2
> >> >> >> >> >> >>>> [1]. As far as I can remember the Yago taxonomy is much
> >> >> better
> >> >> >> >> >> >>>> structured as the one used by dbpedia. Mapping
> >> >> >> >> >> >>>> suggestions of
> >> >> >> >> dbpedia
> >> >> >> >> >> >>>> to concepts in Yago2 is easy as both dbpedia and yago2
> do
> >> >> >> provide
> >> >> >> >> >> >>>> mappings [2] and [3]
> >> >> >> >> >> >>>>
> >> >> >> >> >> >>>> > 2014-02-05 15:39 GMT+02:00 Rafa Haro
> >> >> >> >> >> >>>> > <rh...@apache.org>:
> >> >> >> >> >> >>>> >>
> >> >> >> >> >> >>>> >> "Microsoft posted its 2013 earnings. The Redmond's
> >> >> >> >> >> >>>> >> company
> >> >> >> made
> >> >> >> >> a
> >> >> >> >> >> >>>> >> huge profit".
> >> >> >> >> >> >>>>
> >> >> >> >> >> >>>> Thats actually a very good example. Spatial contexts
> are
> >> >> >> >> >> >>>> very
> >> >> >> >> >> >>>> important as they tend to be often used for
> referencing.
> >> >> >> >> >> >>>> So I
> >> >> >> would
> >> >> >> >> >> >>>> suggest to specially treat the spatial context. For
> >> >> >> >> >> >>>> spatial
> >> >> >> >> Entities
> >> >> >> >> >> >>>> (like a City) this is easy, but even for other (like a
> >> >> Person,
> >> >> >> >> >> >>>> Company) you could use relations to spatial entities
> >> >> >> >> >> >>>> define
> >> >> >> their
> >> >> >> >> >> >>>> spatial context. This context could than be used to
> >> >> >> >> >> >>>> correctly
> >> >> >> link
> >> >> >> >> >> >>>> "The Redmond's company" to "Microsoft".
> >> >> >> >> >> >>>>
> >> >> >> >> >> >>>> In addition I would suggest to use the "spatial"
> context
> >> >> >> >> >> >>>> of
> >> >> each
> >> >> >> >> >> >>>> entity (basically relation to entities that are cities,
> >> >> regions,
> >> >> >> >> >> >>>> countries) as a separate dimension, because those are
> >> >> >> >> >> >>>> very
> >> >> often
> >> >> >> >> used
> >> >> >> >> >> >>>> for coreferences.
> >> >> >> >> >> >>>>
> >> >> >> >> >> >>>> [1] http://www.mpi-inf.mpg.de/yago-naga/yago/
> >> >> >> >> >> >>>> [2]
> >> >> >> >> >> >>>>
> http://downloads.dbpedia.org/3.9/links/yago_links.nt.bz2
> >> >> >> >> >> >>>> [3]
> >> >> >> >> >> >>>>
> >> >> >> >> >>
> >> >> >> >>
> >> >> >>
> >> >>
> >> >>
> http://www.mpi-inf.mpg.de/yago-naga/yago/download/yago/yagoDBpediaInstances.ttl.7z
> >> >> >> >> >> >>>>
> >> >> >> >> >> >>>>
> >> >> >> >> >> >>>> On Thu, Feb 6, 2014 at 10:33 AM, Cristian Petroaca
> >> >> >> >> >> >>>> <cristian.petro...@gmail.com> wrote:
> >> >> >> >> >> >>>> > There are several dbpedia categories for each entity,
> >> >> >> >> >> >>>> > in
> >> >> this
> >> >> >> >> case
> >> >> >> >> >> for
> >> >> >> >> >> >>>> > Microsoft we have :
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> > category:Companies_in_the_NASDAQ-100_Index
> >> >> >> >> >> >>>> > category:Microsoft
> >> >> >> >> >> >>>> > category:Software_companies_of_the_United_States
> >> >> >> >> >> >>>> >
> category:Software_companies_based_in_Washington_(state)
> >> >> >> >> >> >>>> > category:Companies_established_in_1975
> >> >> >> >> >> >>>> > category:1975_establishments_in_the_United_States
> >> >> >> >> >> >>>> > category:Companies_based_in_Redmond,_Washington
> >> >> >> >> >> >>>> >
> >> >> >> >>
> >> >> >> >>
> category:Multinational_companies_headquartered_in_the_United_States
> >> >> >> >> >> >>>> > category:Cloud_computing_providers
> >> >> >> >> >> >>>> >
> category:Companies_in_the_Dow_Jones_Industrial_Average
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> > So we also have "Companies based in
> Redmont,Washington"
> >> >> which
> >> >> >> >> could
> >> >> >> >> >> be
> >> >> >> >> >> >>>> > matched.
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> > There is still other contextual information from
> >> >> >> >> >> >>>> > dbpedia
> >> >> which
> >> >> >> >> can
> >> >> >> >> >> be
> >> >> >> >> >> >>>> used.
> >> >> >> >> >> >>>> > For example for an Organization we could also
> include :
> >> >> >> >> >> >>>> > dbpprop:industry = Software
> >> >> >> >> >> >>>> > dbpprop:service = Online Service Providers
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> > and for a Person (that's for Barack Obama) :
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> > dbpedia-owl:profession:
> >> >> >> >> >> >>>> > dbpedia:Author
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> > dbpedia:Constitutional_law
> >> >> >> >> >> >>>> > dbpedia:Lawyer
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> > dbpedia:Community_organizing
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> > I'd like to continue investigating this as I think
> that
> >> >> >> >> >> >>>> > it
> >> >> may
> >> >> >> >> have
> >> >> >> >> >> >>>> some
> >> >> >> >> >> >>>> > value in increasing the number of coreference
> >> >> >> >> >> >>>> > resolutions
> >> >> and
> >> >> >> I'd
> >> >> >> >> >> like
> >> >> >> >> >> >>>> to
> >> >> >> >> >> >>>> > concentrate more on precision rather than recall
> since
> >> >> >> >> >> >>>> > we
> >> >> >> already
> >> >> >> >> >> have
> >> >> >> >> >> >>>> a
> >> >> >> >> >> >>>> > set of coreferences detected by the stanford nlp tool
> >> >> >> >> >> >>>> > and
> >> >> this
> >> >> >> >> would
> >> >> >> >> >> >>>> be as
> >> >> >> >> >> >>>> > an addition to that (at least this is how I would
> like
> >> >> >> >> >> >>>> > to
> >> >> use
> >> >> >> >> it).
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> > Is it ok if I track this by opening a jira? I could
> >> >> >> >> >> >>>> > update
> >> >> it
> >> >> >> to
> >> >> >> >> >> show
> >> >> >> >> >> >>>> my
> >> >> >> >> >> >>>> > progress and also my conclusions and if it turns out
> >> >> >> >> >> >>>> > that
> >> >> it
> >> >> >> was
> >> >> >> >> a
> >> >> >> >> >> bad
> >> >> >> >> >> >>>> idea
> >> >> >> >> >> >>>> > then that's the situation at least I'll end up with
> >> >> >> >> >> >>>> > more
> >> >> >> >> knowledge
> >> >> >> >> >> >>>> about
> >> >> >> >> >> >>>> > Stanbol in the end :).
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> > 2014-02-05 15:39 GMT+02:00 Rafa Haro
> >> >> >> >> >> >>>> > <rh...@apache.org>:
> >> >> >> >> >> >>>> >
> >> >> >> >> >> >>>> >> Hi Cristian,
> >> >> >> >> >> >>>> >>
> >> >> >> >> >> >>>> >> The approach sounds nice. I don't want to be the
> >> >> >> >> >> >>>> >> devil's
> >> >> >> >> advocate
> >> >> >> >> >> but
> >> >> >> >> >> >>>> I'm
> >> >> >> >> >> >>>> >> just not sure about the recall using the dbpedia
> >> >> categories
> >> >> >> >> >> feature.
> >> >> >> >> >> >>>> For
> >> >> >> >> >> >>>> >> example, your sentence could be also "Microsoft
> posted
> >> >> >> >> >> >>>> >> its
> >> >> >> 2013
> >> >> >> >> >> >>>> earnings.
> >> >> >> >> >> >>>> >> The Redmond's company made a huge profit". So, maybe
> >> >> >> including
> >> >> >> >> more
> >> >> >> >> >> >>>> >> contextual information from dbpedia could increase
> the
> >> >> recall
> >> >> >> >> but
> >> >> >> >> >> of
> >> >> >> >> >> >>>> course
> >> >> >> >> >> >>>> >> will reduce the precision.
> >> >> >> >> >> >>>> >>
> >> >> >> >> >> >>>> >> Cheers,
> >> >> >> >> >> >>>> >> Rafa
> >> >> >> >> >> >>>> >>
> >> >> >> >> >> >>>> >> El 04/02/14 09:50, Cristian Petroaca escribió:
> >> >> >> >> >> >>>> >>
> >> >> >> >> >> >>>> >> Back with a more detailed description of the steps
> >> >> >> >> >> >>>> >> for
> >> >> >> making
> >> >> >> >> this
> >> >> >> >> >> >>>> kind of
> >> >> >> >> >> >>>> >>> coreference work.
> >> >> >> >> >> >>>> >>>
> >> >> >> >> >> >>>> >>> I will be using references to the following text in
> >> >> >> >> >> >>>> >>> the
> >> >> >> steps
> >> >> >> >> >> below
> >> >> >> >> >> >>>> in
> >> >> >> >> >> >>>> >>> order to make things clearer : "Microsoft posted
> its
> >> >> >> >> >> >>>> >>> 2013
> >> >> >> >> >> earnings.
> >> >> >> >> >> >>>> The
> >> >> >> >> >> >>>> >>> software company made a huge profit."
> >> >> >> >> >> >>>> >>>
> >> >> >> >> >> >>>> >>> 1. For every noun phrase in the text which has :
> >> >> >> >> >> >>>> >>> a. a determinate pos which implies reference
> to
> >> >> >> >> >> >>>> >>> an
> >> >> >> entity
> >> >> >> >> >> local
> >> >> >> >> >> >>>> to
> >> >> >> >> >> >>>> >>> the
> >> >> >> >> >> >>>> >>> text, such as "the, this, these") but not "another,
> >> >> every",
> >> >> >> etc
> >> >> >> >> >> which
> >> >> >> >> >> >>>> >>> implies a reference to an entity outside of the
> text.
> >> >> >> >> >> >>>> >>> b. having at least another noun aside from the
> >> >> >> >> >> >>>> >>> main
> >> >> >> >> required
> >> >> >> >> >> >>>> noun
> >> >> >> >> >> >>>> >>> which
> >> >> >> >> >> >>>> >>> further describes it. For example I will not count
> >> >> >> >> >> >>>> >>> "The
> >> >> >> >> company"
> >> >> >> >> >> as
> >> >> >> >> >> >>>> being
> >> >> >> >> >> >>>> >>> a
> >> >> >> >> >> >>>> >>> legitimate candidate since this could create a lot
> of
> >> >> false
> >> >> >> >> >> >>>> positives by
> >> >> >> >> >> >>>> >>> considering the double meaning of some words such
> as
> >> >> >> >> >> >>>> >>> "in
> >> >> the
> >> >> >> >> >> company
> >> >> >> >> >> >>>> of
> >> >> >> >> >> >>>> >>> good people".
> >> >> >> >> >> >>>> >>> "The software company" is a good candidate since we
> >> >> >> >> >> >>>> >>> also
> >> >> >> have
> >> >> >> >> >> >>>> "software".
> >> >> >> >> >> >>>> >>>
> >> >> >> >> >> >>>> >>> 2. match the nouns in the noun phrase to the
> contents
> >> >> >> >> >> >>>> >>> of
> >> >> the
> >> >> >> >> >> dbpedia
> >> >> >> >> >> >>>> >>> categories of each named entity found prior to the
> >> >> location
> >> >> >> of
> >> >> >> >> the
> >> >> >> >> >> >>>> noun
> >> >> >> >> >> >>>> >>> phrase in the text.
> >> >> >> >> >> >>>> >>> The dbpedia categories are in the following format
> >> >> >> >> >> >>>> >>> (for
> >> >> >> >> Microsoft
> >> >> >> >> >> for
> >> >> >> >> >> >>>> >>> example) : "Software companies of the United
> States".
> >> >> >> >> >> >>>> >>> So we try to match "software company" with that.
> >> >> >> >> >> >>>> >>> First, as you can see, the main noun in the dbpedia
> >> >> category
> >> >> >> >> has a
> >> >> >> >> >> >>>> plural
> >> >> >> >> >> >>>> >>> form and it's the same for all categories which I
> >> >> >> >> >> >>>> >>> saw. I
> >> >> >> don't
> >> >> >> >> >> know
> >> >> >> >> >> >>>> if
> >> >> >> >> >> >>>> >>> there's an easier way to do this but I thought of
> >> >> applying a
> >> >> >> >> >> >>>> lemmatizer on
> >> >> >> >> >> >>>> >>> the category and the noun phrase in order for them
> to
> >> >> have a
> >> >> >> >> >> common
> >> >> >> >> >> >>>> >>> denominator.This also works if the noun phrase
> itself
> >> >> has a
> >> >> >> >> plural
> >> >> >> >> >> >>>> form.
> >> >> >> >> >> >>>> >>>
> >> >> >> >> >> >>>> >>> Second, I'll need to use for comparison only the
> >> >> >> >> >> >>>> >>> words in
> >> >> >> the
> >> >> >> >> >> >>>> category
> >> >> >> >> >> >>>> >>> which are themselves nouns and not prepositions or
> >> >> >> determiners
> >> >> >> >> >> such
> >> >> >> >> >> >>>> as "of
> >> >> >> >> >> >>>> >>> the".This means that I need to pos tag the
> categories
> >> >> >> contents
> >> >> >> >> as
> >> >> >> >> >> >>>> well.
> >> >> >> >> >> >>>> >>> I was thinking of running the pos and lemma on the
> >> >> dbpedia
> >> >> >> >> >> >>>> categories when
> >> >> >> >> >> >>>> >>> building the dbpedia backed entity hub and storing
> >> >> >> >> >> >>>> >>> them
> >> >> for
> >> >> >> >> later
> >> >> >> >> >> >>>> use - I
> >> >> >> >> >> >>>> >>> don't know how feasible this is at the moment.
> >> >> >> >> >> >>>> >>>
> >> >> >> >> >> >>>> >>> After this I can compare each noun in the noun
> phrase
> >> >> with
> >> >> >> the
> >> >> >> >> >> >>>> equivalent
> >> >> >> >> >> >>>> >>> nouns in the categories and based on the number of
> >> >> matches I
> >> >> >> >> can
> >> >> >> >> >> >>>> create a
> >> >> >> >> >> >>>> >>> confidence level.
> >> >> >> >> >> >>>> >>>
> >> >> >> >> >> >>>> >>> 3. match the noun of the noun phrase with the
> >> >> >> >> >> >>>> >>> rdf:type
> >> >> from
> >> >> >> >> >> dbpedia
> >> >> >> >> >> >>>> of the
> >> >> >> >> >> >>>> >>> named entity. If this matches increase the
> confidence
> >> >> level.
> >> >> >> >> >> >>>> >>>
> >> >> >> >> >> >>>> >>> 4. If there are multiple named entities which can
> >> >> >> >> >> >>>> >>> match a
> >> >> >> >> certain
> >> >> >> >> >> >>>> noun
> >> >> >> >> >> >>>> >>> phrase then link the noun phrase with the closest
> >> >> >> >> >> >>>> >>> named
> >> >> >> entity
> >> >> >> >> >> prior
> >> >> >> >> >> >>>> to it
> >> >> >> >> >> >>>> >>> in the text.
> >> >> >> >> >> >>>> >>>
> >> >> >> >> >> >>>> >>> What do you think?
> >> >> >> >> >> >>>> >>>
> >> >> >> >> >> >>>> >>> Cristian
> >> >> >> >> >> >>>> >>>
> >> >> >> >> >> >>>> >>> 2014-01-31 Cristian Petroaca <
> >> >> cristian.petro...@gmail.com>:
> >> >> >> >> >> >>>> >>>
> >> >> >> >> >> >>>> >>> Hi Rafa,
> >> >> >> >> >> >>>> >>>>
> >> >> >> >> >> >>>> >>>> I don't yet have a concrete heursitic but I'm
> >> >> >> >> >> >>>> >>>> working on
> >> >> >> it.
> >> >> >> >> I'll
> >> >> >> >> >> >>>> provide
> >> >> >> >> >> >>>> >>>> it here so that you guys can give me a feedback on
> >> >> >> >> >> >>>> >>>> it.
> >> >> >> >> >> >>>> >>>>
> >> >> >> >> >> >>>> >>>> What are "locality" features?
> >> >> >> >> >> >>>> >>>>
> >> >> >> >> >> >>>> >>>> I looked at Bart and other coref tools such as
> >> >> >> >> >> >>>> >>>> ArkRef
> >> >> and
> >> >> >> >> >> >>>> CherryPicker
> >> >> >> >> >> >>>> >>>> and
> >> >> >> >> >> >>>> >>>> they don't provide such a coreference.
> >> >> >> >> >> >>>> >>>>
> >> >> >> >> >> >>>> >>>> Cristian
> >> >> >> >> >> >>>> >>>>
> >> >> >> >> >> >>>> >>>>
> >> >> >> >> >> >>>> >>>> 2014-01-30 Rafa Haro <rh...@apache.org>:
> >> >> >> >> >> >>>> >>>>
> >> >> >> >> >> >>>> >>>> Hi Cristian,
> >> >> >> >> >> >>>> >>>>
> >> >> >> >> >> >>>> >>>>> Without having more details about your concrete
> >> >> heuristic,
> >> >> >> >> in my
> >> >> >> >> >> >>>> honest
> >> >> >> >> >> >>>> >>>>> opinion, such approach could produce a lot of
> false
> >> >> >> >> positives. I
> >> >> >> >> >> >>>> don't
> >> >> >> >> >> >>>> >>>>> know
> >> >> >> >> >> >>>> >>>>> if you are planning to use some "locality"
> features
> >> >> >> >> >> >>>> >>>>> to
> >> >> >> detect
> >> >> >> >> >> such
> >> >> >> >> >> >>>> >>>>> coreferences but you need to take into account
> that
> >> >> >> >> >> >>>> >>>>> it
> >> >> is
> >> >> >> >> quite
> >> >> >> >> >> >>>> usual
> >> >> >> >> >> >>>> >>>>> that
> >> >> >> >> >> >>>> >>>>> coreferenced mentions can occurs even in
> different
> >> >> >> >> paragraphs.
> >> >> >> >> >> >>>> Although
> >> >> >> >> >> >>>> >>>>> I'm
> >> >> >> >> >> >>>> >>>>> not an expert in Natural Language Understanding,
> I
> >> >> would
> >> >> >> say
> >> >> >> >> it
> >> >> >> >> >> is
> >> >> >> >> >> >>>> quite
> >> >> >> >> >> >>>> >>>>> difficult to get decent precision/recall rates
> for
> >> >> >> >> coreferencing
> >> >> >> >> >> >>>> using
> >> >> >> >> >> >>>> >>>>> fixed rules. Maybe you can give a try to others
> >> >> >> >> >> >>>> >>>>> tools
> >> >> like
> >> >> >> >> BART
> >> >> >> >> >> (
> >> >> >> >> >> >>>> >>>>> http://www.bart-coref.org/).
> >> >> >> >> >> >>>> >>>>>
> >> >> >> >> >> >>>> >>>>> Cheers,
> >> >> >> >> >> >>>> >>>>> Rafa Haro
> >> >> >> >> >> >>>> >>>>>
> >> >> >> >> >> >>>> >>>>> El 30/01/14 10:33, Cristian Petroaca escribió:
> >> >> >> >> >> >>>> >>>>>
> >> >> >> >> >> >>>> >>>>> Hi,
> >> >> >> >> >> >>>> >>>>>
> >> >> >> >> >> >>>> >>>>>> One of the necessary steps for implementing the
> >> >> >> >> >> >>>> >>>>>> Event
> >> >> >> >> >> extraction
> >> >> >> >> >> >>>> Engine
> >> >> >> >> >> >>>> >>>>>> feature :
> >> >> >> >> https://issues.apache.org/jira/browse/STANBOL-1121is
> >> >> >> >> >> >>>> to
> >> >> >> >> >> >>>> >>>>>> have
> >> >> >> >> >> >>>> >>>>>> coreference resolution in the given text. This
> is
> >> >> >> provided
> >> >> >> >> now
> >> >> >> >> >> >>>> via the
> >> >> >> >> >> >>>> >>>>>> stanford-nlp project but as far as I saw this
> >> >> >> >> >> >>>> >>>>>> module
> >> >> is
> >> >> >> >> >> performing
> >> >> >> >> >> >>>> >>>>>> mostly
> >> >> >> >> >> >>>> >>>>>> pronomial (He, She) or nominal (Barack Obama and
> >> >> >> >> >> >>>> >>>>>> Mr.
> >> >> >> Obama)
> >> >> >> >> >> >>>> coreference
> >> >> >> >> >> >>>> >>>>>> resolution.
> >> >> >> >> >> >>>> >>>>>>
> >> >> >> >> >> >>>> >>>>>> In order to get more coreferences from the text
> I
> >> >> though
> >> >> >> of
> >> >> >> >> >> >>>> creating
> >> >> >> >> >> >>>> >>>>>> some
> >> >> >> >> >> >>>> >>>>>> logic that would detect this kind of
> coreference :
> >> >> >> >> >> >>>> >>>>>> "Apple reaches new profit heights. The software
> >> >> company
> >> >> >> just
> >> >> >> >> >> >>>> announced
> >> >> >> >> >> >>>> >>>>>> its
> >> >> >> >> >> >>>> >>>>>> 2013 earnings."
> >> >> >> >> >> >>>> >>>>>> Here "The software company" obviously refers to
> >> >> "Apple".
> >> >> >> >> >> >>>> >>>>>> So I'd like to detect coreferences of Named
> >> >> >> >> >> >>>> >>>>>> Entities
> >> >> >> which
> >> >> >> >> are
> >> >> >> >> >> of
> >> >> >> >> >> >>>> the
> >> >> >> >> >> >>>> >>>>>> rdf:type of the Named Entity , in this case
> >> >> >> >> >> >>>> >>>>>> "company"
> >> >> and
> >> >> >> >> also
> >> >> >> >> >> >>>> have
> >> >> >> >> >> >>>> >>>>>> attributes which can be found in the dbpedia
> >> >> categories
> >> >> >> of
> >> >> >> >> the
> >> >> >> >> >> >>>> named
> >> >> >> >> >> >>>> >>>>>> entity, in this case "software".
> >> >> >> >> >> >>>> >>>>>>
> >> >> >> >> >> >>>> >>>>>> The detection of coreferences such as "The
> >> >> >> >> >> >>>> >>>>>> software
> >> >> >> >> company" in
> >> >> >> >> >> >>>> the
> >> >> >> >> >> >>>> >>>>>> text
> >> >> >> >> >> >>>> >>>>>> would also be done by either using the new Pos
> Tag
> >> >> Based
> >> >> >> >> Phrase
> >> >> >> >> >> >>>> >>>>>> extraction
> >> >> >> >> >> >>>> >>>>>> Engine (noun phrases) or by using a dependency
> >> >> >> >> >> >>>> >>>>>> tree of
> >> >> >> the
> >> >> >> >> >> >>>> sentence and
> >> >> >> >> >> >>>> >>>>>> picking up only subjects or objects.
> >> >> >> >> >> >>>> >>>>>>
> >> >> >> >> >> >>>> >>>>>> At this point I'd like to know if this kind of
> >> >> >> >> >> >>>> >>>>>> logic
> >> >> >> would
> >> >> >> >> be
> >> >> >> >> >> >>>> useful
> >> >> >> >> >> >>>> >>>>>> as a
> >> >> >> >> >> >>>> >>>>>> separate Enhancement Engine (in case the
> precision
> >> >> >> >> >> >>>> >>>>>> and
> >> >> >> >> recall
> >> >> >> >> >> are
> >> >> >> >> >> >>>> good
> >> >> >> >> >> >>>> >>>>>> enough) in Stanbol?
> >> >> >> >> >> >>>> >>>>>>
> >> >> >> >> >> >>>> >>>>>> Thanks,
> >> >> >> >> >> >>>> >>>>>> Cristian
> >> >> >> >> >> >>>> >>>>>>
> >> >> >> >> >> >>>> >>>>>>
> >> >> >> >> >> >>>> >>>>>>
> >> >> >> >> >> >>>> >>
> >> >> >> >> >> >>>>
> >> >> >> >> >> >>>>
> >> >> >> >> >> >>>>
> >> >> >> >> >> >>>> --
> >> >> >> >> >> >>>> | Rupert Westenthaler
> >> >> rupert.westentha...@gmail.com
> >> >> >> >> >> >>>> | Bodenlehenstraße 11
> >> >> >> >> ++43-699-11108907
> >> >> >> >> >> >>>> | A-5500 Bischofshofen
> >> >> >> >> >> >>>>
> >> >> >> >> >> >>>
> >> >> >> >> >> >>>
> >> >> >> >> >> >>
> >> >> >> >> >>
> >> >> >> >> >>
> >> >> >> >> >>
> >> >> >> >> >> --
> >> >> >> >> >> | Rupert Westenthaler
> >> >> >> >> >> rupert.westentha...@gmail.com
> >> >> >> >> >> | Bodenlehenstraße 11
> >> >> ++43-699-11108907
> >> >> >> >> >> | A-5500 Bischofshofen
> >> >> >> >> >>
> >> >> >> >>
> >> >> >> >>
> >> >> >> >>
> >> >> >> >> --
> >> >> >> >> | Rupert Westenthaler
> rupert.westentha...@gmail.com
> >> >> >> >> | Bodenlehenstraße 11
> >> >> >> >> ++43-699-11108907
> >> >> >> >> | A-5500 Bischofshofen
> >> >> >> >>
> >> >> >>
> >> >> >>
> >> >> >>
> >> >> >> --
> >> >> >> | Rupert Westenthaler rupert.westentha...@gmail.com
> >> >> >> | Bodenlehenstraße 11
> ++43-699-11108907
> >> >> >> | A-5500 Bischofshofen
> >> >> >>
> >> >>
> >> >>
> >> >>
> >> >> --
> >> >> | Rupert Westenthaler rupert.westentha...@gmail.com
> >> >> | Bodenlehenstraße 11 ++43-699-11108907
> >> >> | A-5500 Bischofshofen
> >> >>
> >>
> >>
> >>
> >> --
> >> | Rupert Westenthaler rupert.westentha...@gmail.com
> >> | Bodenlehenstraße 11 ++43-699-11108907
> >> | A-5500 Bischofshofen
> >
> >
>
>
>
> --
> | Rupert Westenthaler rupert.westentha...@gmail.com
> | Bodenlehenstraße 11 ++43-699-11108907
> | A-5500 Bischofshofen
>
