[
https://issues.apache.org/jira/browse/NUTCH-808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12856349#action_12856349
]
Julien Nioche commented on NUTCH-808:
-------------------------------------
Hi Enis,
{quote}
On the other hand, current implementation is ...
{quote}
What do you mean by current implementation? NutchBase?
My gut feeling would be to write a custom framework instead of relying on
DataNucleus and use AVRO if possible. I really think that HBase support is
urgently needed but am less convinced that we need MySQL in the very short
term.
I know that Cascading have various Tape/Sink implementations including JDBC,
HBase but also SimpleDB. Maybe it would be worth having a look at how they do
it?
> Evaluate ORM Frameworks which support non-relational column-oriented
> datastores and RDBMs
> ------------------------------------------------------------------------------------------
>
> Key: NUTCH-808
> URL: https://issues.apache.org/jira/browse/NUTCH-808
> Project: Nutch
> Issue Type: Task
> Reporter: Enis Soztutar
> Assignee: Enis Soztutar
> Fix For: 2.0
>
>
> We have an ORM layer in the NutchBase branch, which uses Avro Specific
> Compiler to compile class definitions given in JSON. Before moving on with
> this, we might benefit from evaluating other frameworks, whether they suit
> our needs.
> We want at least the following capabilities:
> - Using POJOs
> - Able to persist objects to at least HBase, Cassandra, and RDBMs
> - Able to efficiently serialize objects as task outputs from Hadoop jobs
> - Allow native queries, along with standard queries
> Any comments, suggestions for other frameworks are welcome.
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators:
https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
