[
https://issues.apache.org/jira/browse/FALCON-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16123157#comment-16123157
]
Johannes Mayer edited comment on FALCON-2302 at 8/11/17 10:40 AM:
------------------------------------------------------------------
I attached the feed definition and coord/wf config.
I think the problem is in coordinator.xml
{code:java}
<property>
<name>sqoopCommand</name>
<value>export --connect jdbc:oracle:thin:@192.168.145.210:1521:dmine
--table HADOOP_TEST --username XYZ --password xxx --num-mappers 1 --update-mode
allowinsert --skip-dist-cache --hcatalog-database
${coord:databaseIn('export-input')} --hcatalog-table
${coord:tableIn('export-input')} --hcatalog-partition-keys
ds_year,ds_month,ds_day --hcatalog-partition-values
${coord:dataInPartitionMin('export-input','ds_year')},${coord:dataInPartitionMin('export-input','ds_month')},${coord:dataInPartitionMin('export-input','ds_day')}
</value>
</property>
{code}
The values
${coord:dataInPartitionMin('export-input','ds_year')},${coord:dataInPartitionMin('export-input','ds_month')},${coord:dataInPartitionMin('export-input','ds_day')}
are always 2017,05,17
Thank you for your help!
was (Author: joha0123):
I attached the feed definition and coord/wf config.
I think the problem is in coordinator.xml
{code:java}
<property>
<name>sqoopCommand</name>
<value>export --connect jdbc:oracle:thin:@192.168.145.210:1521:dmine
--table HADOOP_TEST --username GFPROGNOSE --password Join2day --num-mappers 1
--update-mode allowinsert --skip-dist-cache --hcatalog-database
${coord:databaseIn('export-input')} --hcatalog-table
${coord:tableIn('export-input')} --hcatalog-partition-keys
ds_year,ds_month,ds_day --hcatalog-partition-values
${coord:dataInPartitionMin('export-input','ds_year')},${coord:dataInPartitionMin('export-input','ds_month')},${coord:dataInPartitionMin('export-input','ds_day')}
</value>
</property>
{code}
The values
${coord:dataInPartitionMin('export-input','ds_year')},${coord:dataInPartitionMin('export-input','ds_month')},${coord:dataInPartitionMin('export-input','ds_day')}
are always 2017,05,17
Thank you for your help!
> Same partition gets exported over and over
> ------------------------------------------
>
> Key: FALCON-2302
> URL: https://issues.apache.org/jira/browse/FALCON-2302
> Project: Falcon
> Issue Type: Bug
> Affects Versions: 0.10
> Environment: Hortonworks Data Platform 2.6.1
> Reporter: Johannes Mayer
> Priority: Critical
> Attachments: coordinator.xml, OracleFeed.xml, workflow.xml
>
>
> I want to export a HCat/Hive table to Oracle. The table is partitioned by
> year month and day. As exprected, for everyday a oozie workflow is generated.
> but when I look at the
> {code:java}
> sqoopCommand
> {code}
> I can see *it always exports the same partition* (partition of feed start).
> The expected behaviour is, that for every day partition a workflow should be
> generated that exports that given partition.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
