[
https://issues.apache.org/jira/browse/TAJO-1346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14647310#comment-14647310
]
ASF GitHub Bot commented on TAJO-1346:
--------------------------------------
Github user blrunner commented on the pull request:
https://github.com/apache/tajo/pull/630#issuecomment-126214851
I added some columns and index to ``PARTITION_KEYS`` table for getting
partitions efficiently and tested on macbook successfully. The batch response
time results are listed below.
* 3,000 records: 1 ~ 2 sec
* 30,000 records: 6 ~ 8 sec
* 300,000 records: 60 ~ 70 sec
Honestly, I was worried about removing foreign key of ``PARTITION_KEYS``
table because it affected to batch insert performance. But it would be good to
leave it on the table because of data integrity.
> Create dynamic partitions to CatalogStore by running insert query or CTAS
> query.
> --------------------------------------------------------------------------------
>
> Key: TAJO-1346
> URL: https://issues.apache.org/jira/browse/TAJO-1346
> Project: Tajo
> Issue Type: Sub-task
> Components: Physical Operator
> Reporter: Jaehwa Jung
> Assignee: Jaehwa Jung
>
> Currently, If new partitions are added to HDFS by ColPartitionStoreExec,
> CatalogStore will not be aware of these partitions. So, Tajo need to load
> newly added partitions automatically to CatalogStore by running insert query
> or CTAS query.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
