[ https://issues.apache.org/jira/browse/FALCON-2234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15813741#comment-15813741 ]
Ajay Yadava edited comment on FALCON-2234 at 1/10/17 3:39 AM: -------------------------------------------------------------- Yes, I think until the backend also supports it, we should disable that option from UI and update the documentation to reflect the same. Otherwise, it is a source of great confusion. Copying Venkat and Venky for a second pair of eyes on this. CC [~venkatnrangan] [~venky] was (Author: ajayyadava): Yes, I think until the backend also supports it, we should disable that option from UI and update the documentation to reflect the same. Otherwise, it is a source of great confusion. CC [~venkatnrangan] [~venky] > Falcon feed fails for RDBMS import if extract type is incremental > ----------------------------------------------------------------- > > Key: FALCON-2234 > URL: https://issues.apache.org/jira/browse/FALCON-2234 > Project: Falcon > Issue Type: Bug > Components: falcon-ui > Affects Versions: 0.10 > Reporter: Prashant > Priority: Critical > Labels: documentaion, newbie > > Falcon feed is failing with > org.apache.falcon.entity.parser.ValidationException > when extract type is incremental. > As per the Apache doc Falcon supports > Import policy > The valid combinations are: > [full,snapshot] - data is extracted in full and dumped into the feed instance > location. > [incremental, append] - data is extracted incrementally using the key > specified in the deltacolumn > As per the below code , it appears we only check [full,snapshot] and > [incremental, append] goes to exception > https://github.com/apache/falcon/blob/0.10/common/src/main/java/org/apache/falcon/entity/parser/FeedEntityParser.java > Snippet > {code} > /** > * Validate extraction and merge type combination. Currently supported > combo: > * > * ExtractionType = FULL and MergeType = SNAPSHOT. > * ExtractionType = INCREMENTAL and MergeType = APPEND. > * > * @param feed Feed entity > * @param cluster Cluster referenced in the Feed definition > * @throws FalconException > */ > private void validateFeedExtractionType(Feed feed, Cluster cluster) > throws FalconException { > Extract extract = cluster.getImport().getSource().getExtract(); > if (ExtractMethod.FULL == extract.getType()) { > if ((MergeType.SNAPSHOT != extract.getMergepolicy()) > || (extract.getDeltacolumn() != null)) { > throw new ValidationException(String.format("Feed %s is using > FULL " > + "extract method but specifies either a superfluous " > + "deltacolumn or a mergepolicy other than > snapshot", feed.getName())); > } > } else { > throw new ValidationException(String.format("Feed %s is using > unsupported " > + "extraction mechanism %s", feed.getName(), > extract.getType().value())); > } > } > {code} > It must have a clause to also check [incremental, append] . -- This message was sent by Atlassian JIRA (v6.3.4#6332)