The most common usecase for DIH is RDBMS- Solr . If we can have a simple
way to achieve this using Morphlines, there is no reason why we cant move
to that completely. Ideally DIH is an ETL tool and having that as a part of
Solr is not a viable long term solution
On Thu, Jun 12, 2014 at 5:51 PM,
We’ve been using Apache Camel. It doesn’t scale like Flume would, but it does
have lots of nice orchestration. It’s kind of between DIH and Flume, and while
not focused on Solr like some of the other pipelines out there, has a lot of
general purpose features that can be useful.
On Jun 12,
Rafalovitch [mailto:arafa...@gmail.com]
Sent: Tuesday, June 10, 2014 9:55 PM
To: dev@lucene.apache.org
Subject: Re: Adding Morphline support to DIH - worth the effort?
Ripples in the pond again. Spreading and dying. Understandable, but
still somewhat annoying.
So, what would be the minimal
(besides
rivers)? Are they headed in the Morphlines direction as well?
-- Jack Krupansky
-Original Message- From: Alexandre Rafalovitch
Sent: Sunday, June 8, 2014 10:16 AM
To: dev@lucene.apache.org
Subject: Re: Adding Morphline support to DIH - worth the effort?
I see
On Mon, Jun 9, 2014 at 1:51 AM, Mikhail Khludnev mkhlud...@griddynamics.com
wrote:
- joins/caching - seem possible with Morphlines but still there is no such
command
- delta import - scenario we don't need to forget to handle it
- threads (it's completely out Morphline's concerns)
-
of the functionality to generalize DIH.
James Dyer
Ingram Content Group
(615) 213-4311
From: Mikhail Khludnev [mailto:mkhlud...@griddynamics.com]
Sent: Wednesday, June 11, 2014 11:56 AM
To: dev@lucene.apache.org
Subject: Re: Adding Morphline support to DIH - worth the effort?
James,
Don't you
On Thu, Jun 12, 2014 at 7:43 AM, Wolfgang Hoschek whosc...@cloudera.com wrote:
On Hadoop, even the JDBC/SQL portion of DIH now seems mostly covered by a
combination of Sqoop and MapReduceIndexerTool, and perhaps a bit of Hive.
I appreciate that if you are in the Big Data space, you already
LOL I had the very same reaction Alexandre. Most of us don’t have all this
big data software sitting around, even if it is free. Complexity.
~ David Smiley
Freelance Apache Lucene/Solr Search Consultant/Developer
http://www.linkedin.com/in/davidwsmiley
On Thu, Jun 12, 2014 at 12:44 AM,
Rafalovitch
Sent: Sunday, June 8, 2014 10:16 AM
To: dev@lucene.apache.org
Subject: Re: Adding Morphline support to DIH - worth the effort?
I see DIH as something that offers a quick way to get things done, as
long as they fit into DIH's couple of basic scenarios. Going even a
little beyond hits
Rafalovitch
Sent: Sunday, June 8, 2014 1:40 AM
To: dev@lucene.apache.org
Subject: Re: Adding Morphline support to DIH - worth the effort?
Well, it's the same core scenario as DIH supports (apart from actual
data sources), but actively supported and developed by a company with
a lot more investment
consider DIH a solid foundation or a
weak link in Solr that desperately needs firming up.
-- Jack Krupansky
-Original Message- From: Alexandre Rafalovitch
Sent: Sunday, June 8, 2014 1:40 AM
To: dev@lucene.apache.org
Subject: Re: Adding Morphline support to DIH - worth the effort
direction as well?
-- Jack Krupansky
-Original Message-
From: Alexandre Rafalovitch
Sent: Sunday, June 8, 2014 10:16 AM
To: dev@lucene.apache.org
Subject: Re: Adding Morphline support to DIH - worth the effort?
I see DIH as something that offers a quick way to get things done, as
long
: Sunday, June 8, 2014 10:16 AM
To: dev@lucene.apache.org
Subject: Re: Adding Morphline support to DIH - worth the effort?
I see DIH as something that offers a quick way to get things done, as
long as they fit into DIH's couple of basic scenarios. Going even a
little beyond hits bugs, bad
Message- From: Alexandre Rafalovitch
Sent: Sunday, June 8, 2014 10:16 AM
To: dev@lucene.apache.org
Subject: Re: Adding Morphline support to DIH - worth the effort?
I see DIH as something that offers a quick way to get things done, as
long as they fit into DIH's couple of basic scenarios
: Alexandre Rafalovitch
Sent: Sunday, June 8, 2014 10:16 AM
To: dev@lucene.apache.org
Subject: Re: Adding Morphline support to DIH - worth the effort?
I see DIH as something that offers a quick way to get things done, as
long as they fit into DIH's couple of basic scenarios. Going even
Hello,
I had a preliminary look around and it might be possible to plug
Morphline (already shipped with Solr) into DIH by creating a bridging
EntityProcessor.
Two questions:
1) Do people see value in it?
2) DIH is not very supported, so any addition seems to be a bit stuck
in rickety bridge,
I do not know much about morphlines but I'd like to know what use-cases
would be possible/easier/faster with such an integration?
On Sun, Jun 8, 2014 at 10:32 AM, Alexandre Rafalovitch arafa...@gmail.com
wrote:
Hello,
I had a preliminary look around and it might be possible to plug
Well, it's the same core scenario as DIH supports (apart from actual
data sources), but actively supported and developed by a company with
a lot more investment in it. For the primitives supported, see
http://cloudera.github.io/cdk/docs/current/cdk-morphlines/morphlinesReferenceGuide.html
We
18 matches
Mail list logo
