[jira] [Resolved] (NIFI-2200) QueryDatabaseTable subquery

2018-01-23 Thread Koji Kawamura (JIRA)

 [ 
https://issues.apache.org/jira/browse/NIFI-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Koji Kawamura resolved NIFI-2200.
-
Resolution: Duplicate

There are situations that users operate NiFi can not create VIEWs in the target 
database engine. In such case, the capability to specify custom select 
including JOIN ... etc from QueryDatabaseTable would be helpful. Since 
NIFI-1706 is trying to solve the same thing. I close this as Duplicate.

> QueryDatabaseTable subquery
> ---
>
> Key: NIFI-2200
> URL: https://issues.apache.org/jira/browse/NIFI-2200
> Project: Apache NiFi
>  Issue Type: Bug
>Reporter: Nabegh
>Priority: Major
>
> QueryDatabaseTable throws an exception if given a subquery as the table name 
> with a where condition.
> For example, Table Name =
> (select * from table_name where condition = value) t 
> will throw the following error
> 2016-07-07 16:23:22,668 ERROR [Timer-Driven Process Thread-7] 
> o.a.n.p.standard.QueryDatabaseTable 
> QueryDatabaseTable[id=354261e7-cfa5-4809-a60c-a9c5136faa70] Failed to process 
> session due to org.apache.nifi.processor.exception.FlowFileHandlingException: 
> StandardFlowFileRecord[uuid=5b7fca67-9fd6-4dd3-9cc4-f2a0bfcf7095,claim=,offset=0,name=196391993568910,size=0]
>  transfer relationship not specified: 
> org.apache.nifi.processor.exception.FlowFileHandlingException: 
> StandardFlowFileRecord[uuid=5b7fca67-9fd6-4dd3-9cc4-f2a0bfcf7095,claim=,offset=0,name=196391993568910,size=0]
>  transfer relationship not specified
> 2016-07-07 16:23:22,671 ERROR [Timer-Driven Process Thread-7] 
> o.a.n.p.standard.QueryDatabaseTable 
> org.apache.nifi.processor.exception.FlowFileHandlingException: 
> StandardFlowFileRecord[uuid=5b7fca67-9fd6-4dd3-9cc4-f2a0bfcf7095,claim=,offset=0,name=196391993568910,size=0]
>  transfer relationship not specified
>   at 
> org.apache.nifi.controller.repository.StandardProcessSession.checkpoint(StandardProcessSession.java:212)
>  ~[nifi-framework-core-0.6.1.jar:0.6.1]
>   at 
> org.apache.nifi.controller.repository.StandardProcessSession.commit(StandardProcessSession.java:282)
>  ~[nifi-framework-core-0.6.1.jar:0.6.1]
>   at 
> org.apache.nifi.processors.standard.QueryDatabaseTable.onTrigger(QueryDatabaseTable.java:348)
>  ~[na:na]
>   at 
> org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1059)
>  ~[nifi-framework-core-0.6.1.jar:0.6.1]
>   at 
> org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136)
>  [nifi-framework-core-0.6.1.jar:0.6.1]
>   at 
> org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
>  [nifi-framework-core-0.6.1.jar:0.6.1]
>   at 
> org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:123)
>  [nifi-framework-core-0.6.1.jar:0.6.1]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> [na:1.8.0_91]
>   at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) 
> [na:1.8.0_91]
>   at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
>  [na:1.8.0_91]
>   at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
>  [na:1.8.0_91]
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>  [na:1.8.0_91]
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>  [na:1.8.0_91]
>   at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Resolved] (NIFI-2200) QueryDatabaseTable subquery

2018-01-21 Thread Koji Kawamura (JIRA)

 [ 
https://issues.apache.org/jira/browse/NIFI-2200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Koji Kawamura resolved NIFI-2200.
-
Resolution: Won't Fix

I agree with what [~charlesbc] described. QueryDatabaseTable is designed to 
capture inserted/updated records from a table. "Additional WHERE clauses" might 
be useful to filter out records those are out of interest. Or if sub-query is 
needed for other reason (JOIN?), then creating a VIEW using the sub-query part, 
then use the VIEW from QueryDatabaseTable will be a work-around.

Closing this as "Won't Fix". Please feel free to reopen it if more discussion 
is needed.

> QueryDatabaseTable subquery
> ---
>
> Key: NIFI-2200
> URL: https://issues.apache.org/jira/browse/NIFI-2200
> Project: Apache NiFi
>  Issue Type: Bug
>Reporter: Nabegh
>Priority: Major
>
> QueryDatabaseTable throws an exception if given a subquery as the table name 
> with a where condition.
> For example, Table Name =
> (select * from table_name where condition = value) t 
> will throw the following error
> 2016-07-07 16:23:22,668 ERROR [Timer-Driven Process Thread-7] 
> o.a.n.p.standard.QueryDatabaseTable 
> QueryDatabaseTable[id=354261e7-cfa5-4809-a60c-a9c5136faa70] Failed to process 
> session due to org.apache.nifi.processor.exception.FlowFileHandlingException: 
> StandardFlowFileRecord[uuid=5b7fca67-9fd6-4dd3-9cc4-f2a0bfcf7095,claim=,offset=0,name=196391993568910,size=0]
>  transfer relationship not specified: 
> org.apache.nifi.processor.exception.FlowFileHandlingException: 
> StandardFlowFileRecord[uuid=5b7fca67-9fd6-4dd3-9cc4-f2a0bfcf7095,claim=,offset=0,name=196391993568910,size=0]
>  transfer relationship not specified
> 2016-07-07 16:23:22,671 ERROR [Timer-Driven Process Thread-7] 
> o.a.n.p.standard.QueryDatabaseTable 
> org.apache.nifi.processor.exception.FlowFileHandlingException: 
> StandardFlowFileRecord[uuid=5b7fca67-9fd6-4dd3-9cc4-f2a0bfcf7095,claim=,offset=0,name=196391993568910,size=0]
>  transfer relationship not specified
>   at 
> org.apache.nifi.controller.repository.StandardProcessSession.checkpoint(StandardProcessSession.java:212)
>  ~[nifi-framework-core-0.6.1.jar:0.6.1]
>   at 
> org.apache.nifi.controller.repository.StandardProcessSession.commit(StandardProcessSession.java:282)
>  ~[nifi-framework-core-0.6.1.jar:0.6.1]
>   at 
> org.apache.nifi.processors.standard.QueryDatabaseTable.onTrigger(QueryDatabaseTable.java:348)
>  ~[na:na]
>   at 
> org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1059)
>  ~[nifi-framework-core-0.6.1.jar:0.6.1]
>   at 
> org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:136)
>  [nifi-framework-core-0.6.1.jar:0.6.1]
>   at 
> org.apache.nifi.controller.tasks.ContinuallyRunProcessorTask.call(ContinuallyRunProcessorTask.java:47)
>  [nifi-framework-core-0.6.1.jar:0.6.1]
>   at 
> org.apache.nifi.controller.scheduling.TimerDrivenSchedulingAgent$1.run(TimerDrivenSchedulingAgent.java:123)
>  [nifi-framework-core-0.6.1.jar:0.6.1]
>   at 
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) 
> [na:1.8.0_91]
>   at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) 
> [na:1.8.0_91]
>   at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
>  [na:1.8.0_91]
>   at 
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
>  [na:1.8.0_91]
>   at 
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>  [na:1.8.0_91]
>   at 
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>  [na:1.8.0_91]
>   at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)