[ 
https://issues.apache.org/jira/browse/TAJO-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14958529#comment-14958529
 ] 

ASF GitHub Bot commented on TAJO-1926:
--------------------------------------

Github user jihoonson commented on a diff in the pull request:

    https://github.com/apache/tajo/pull/824#discussion_r42097553
  
    --- Diff: 
tajo-core-tests/src/test/java/org/apache/tajo/engine/planner/TestPartitionedTableRewriter.java
 ---
    @@ -0,0 +1,108 @@
    +/**
    + * Licensed to the Apache Software Foundation (ASF) under one
    + * or more contributor license agreements.  See the NOTICE file
    + * distributed with this work for additional information
    + * regarding copyright ownership.  The ASF licenses this file
    + * to you under the Apache License, Version 2.0 (the
    + * "License"); you may not use this file except in compliance
    + * with the License.  You may obtain a copy of the License at
    + *
    + *     http://www.apache.org/licenses/LICENSE-2.0
    + *
    + * Unless required by applicable law or agreed to in writing, software
    + * distributed under the License is distributed on an "AS IS" BASIS,
    + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    + * See the License for the specific language governing permissions and
    + * limitations under the License.
    + */
    +
    +package org.apache.tajo.engine.planner;
    +
    +import org.apache.hadoop.fs.Path;
    +import org.apache.tajo.LocalTajoTestingUtility;
    +import org.apache.tajo.OverridableConf;
    +import org.apache.tajo.QueryTestCaseBase;
    +import org.apache.tajo.algebra.Expr;
    +import org.apache.tajo.catalog.CatalogUtil;
    +import org.apache.tajo.catalog.TableDesc;
    +import org.apache.tajo.engine.query.QueryContext;
    +import org.apache.tajo.plan.LogicalPlan;
    +import org.apache.tajo.plan.logical.*;
    +import org.apache.tajo.plan.rewrite.rules.PartitionedTableRewriter;
    +import org.apache.tajo.util.CommonTestingUtil;
    +import org.junit.Test;
    +
    +import static org.junit.Assert.assertEquals;
    +import static org.junit.Assert.assertNotNull;
    +import static org.junit.Assert.assertTrue;
    +
    +public class TestPartitionedTableRewriter extends QueryTestCaseBase {
    --- End diff --
    
    You must add a test to check that findFilteredPartitionPaths() works well 
after a manual partition directory creation. This test is related to the 
following bug.
    
    ```
    # I manually added a directory 'n_comment=this is a directory to test 
partition' under nation_part directory.
    default> \dfs -ls /tajo/warehouse/default/nation_part
    Found 26 items
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment= haggle. carefully final deposits 
detect slyly agai
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment= pending excuses haggle furiously 
deposits. pending, express pinto beans wake fluffily past t
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment= requests against the platelets 
use never according to the quickly regular pint
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment= slyly express asymptotes. 
regular deposits haggle slyly. carefully ironic hockey players sleep blithely. 
carefull
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=al foxes promise slyly according 
to the regular accounts. bold requests alon
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=c dependencies. furiously express 
notornis sleep slyly regular accounts. ideas sleep. depos
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=eans boost carefully special 
requests. accounts are. carefull
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=eas hang ironic, silent packages. 
slyly regular packages are furiously over the tithes. fluffily bold
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=efully alongside of the slyly 
final dependencies. 
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=hely enticingly express accounts. 
even, final 
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=ic deposits are blithely about 
the carefully regular pa
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=l platelets. regular accounts 
x-ray%3A unusual, regular acco
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=nic deposits boost atop the 
quickly final requests%3F quickly regula
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=ously. final, express gifts 
cajole a
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=platelets. blithely pending 
dependencies use fluffily across the even pinto beans. carefully silent accoun
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=refully final requests. regular, 
ironi
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=rns. blithely bold courts among 
the closely regular packages use furiously bold platelets%3F
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=s. ironic, unusual asymptotes 
wake blithely r
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=ss excuses cajole slyly across 
the packages. deposits print aroun
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 17:45 
/tajo/warehouse/default/nation_part/n_comment=this is a directory to test 
partition.
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=ts. silent requests haggle. 
closely express packages sleep across the blithely
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=ular asymptotes are about the 
furious multipliers. express dependencies nag above the ironically ironic 
account
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=ven packages wake quickly. regu
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=y above the carefully unusual 
theodolites. final dugouts are quickly across the furiously regular d
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=y alongside of the pending 
deposits. carefully special packages are about the ironic forges. slyly special 
    drwxr-xr-x   - jihoon supergroup          0 2015-10-15 13:03 
/tajo/warehouse/default/nation_part/n_comment=y final packages. slow foxes 
cajole quickly. quickly silent platelets breach ironic accounts. unusual pinto 
be
    default> select n_comment from nation_part where substr(n_comment, 0, 8) = 
'this is';
    Progress: 100%, response time: 2.031 sec
    n_comment
    -------------------------------
    (0 rows, 2.031 sec, 0 B selected)
    ```


> Disable partition pruning using catalog temporarily.
> ----------------------------------------------------
>
>                 Key: TAJO-1926
>                 URL: https://issues.apache.org/jira/browse/TAJO-1926
>             Project: Tajo
>          Issue Type: Sub-task
>          Components: Catalog, Physical Operator, Planner/Optimizer
>    Affects Versions: 0.11.0, 0.12.0
>            Reporter: Jaehwa Jung
>            Assignee: Jaehwa Jung
>            Priority: Critical
>             Fix For: 0.11.0
>
>
> We disabled alter table add partition temporarily at TAJO-1887. But when 
> adding partitions with dfs command for external partitioned table, there is 
> no way to add partition to catalog. As a result, users can't scan their 
> partitions which are added manually to file system. So, we need to disable 
> partition pruning using catalog until implement TAJO-1891.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to