[
https://issues.apache.org/jira/browse/NIFI-3268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15865214#comment-15865214
]
ASF GitHub Bot commented on NIFI-3268:
--------------------------------------
Github user ijokarumawak commented on a diff in the pull request:
https://github.com/apache/nifi/pull/1376#discussion_r100967405
--- Diff:
nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/GenerateTableFetch.java
---
@@ -87,6 +87,18 @@
.addValidator(StandardValidators.NON_NEGATIVE_INTEGER_VALIDATOR)
.build();
+ public static final PropertyDescriptor AUTO_INCREMENT_KEY = new
PropertyDescriptor.Builder()
+ .name("gen-table-fetch-partition-index")
+ .displayName("AUTO_INCREMENT(index) column name")
+ .description("The column has AUTO_INCREMENT attribute and
index."
+ + "If there is a column with AUTO_INCREMENT property
and index in the database, we can use index instead of using OFFSET."
+ + "The value must start by 1")
+ .defaultValue("null")
+ .addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
+ .required(true)
--- End diff --
I think this property should be optional, `required(true)` and
`defaultValue("null")` can be removed.
> Add AUTO_INCREMENT column in GenerateTableFetch to benefit index
> ----------------------------------------------------------------
>
> Key: NIFI-3268
> URL: https://issues.apache.org/jira/browse/NIFI-3268
> Project: Apache NiFi
> Issue Type: Improvement
> Components: Core Framework
> Affects Versions: 1.1.1
> Environment: - ubuntu 16.04
> - java version "1.8.0_111"
> - Java(TM) SE Runtime Environment (build 1.8.0_111-b14)
> - Java HotSpot(TM) 64-Bit Server VM (build 25.111-b14, mixed mode)
> Reporter: qfdk
> Labels: easyfix
> Fix For: 1.2.0
>
>
> I added AUTO_INCREMENT column in GenerateTableFetch to benefit index column
> By default this processor uses OFFSET, i have problems with large data.
> somme column has index so we could use index to speed up query time.
> I posted question here :
> https://community.hortonworks.com/questions/72586/how-can-i-use-an-array-with-putelasticsearch.html
> If you indexed un column (id), you could use this sql
> ```
> select xxx
> From xxxxx
> where 200000=>id
> order by id
> limit 200000
> ```
> “OFFSET is bad for skipping previous rows.” [Online]. Available:
> http://Use-The-Index-Luke.com/sql/partial-results/fetch-next-page. [Accessed:
> 27-Dec-2016].
> Thank you in advance
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
