[
https://issues.apache.org/jira/browse/TAJO-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075902#comment-14075902
]
Hyunsik Choi commented on TAJO-947:
-----------------------------------
Hi Mai,
Thank you for your contribution! Column partition is designed for a partition
type compatible to Apache Hive partition. So, we should follow their rule. I've
just investigated the solution. It would be useful for your work.
They had the same issues to us, but it is too old one.
https://issues.apache.org/jira/browse/HIVE-883
Their current code is as follows:
https://github.com/apache/hive/blob/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/Warehouse.java#L301
I hope that it would be helpful to your work.
> ColPartitionStoreExec can cause URISyntaxException due to special characters
> ----------------------------------------------------------------------------
>
> Key: TAJO-947
> URL: https://issues.apache.org/jira/browse/TAJO-947
> Project: Tajo
> Issue Type: Bug
> Components: physical operator
> Reporter: Hyunsik Choi
> Assignee: Mai Hai Thanh
> Fix For: 0.9.0
>
> Attachments: TAJO-947.Mai.140728.patch.txt
>
>
> When partition keys includes some special characters which cannot be
> represented in URI, ColPartitionStoreExec::getData can cause
> URISyntaxException. Please see the following stack trace:
> {noformat}
> Progress: 62%, response time: 106.344 sec
> Progress: 62%, response time: 107.345 sec
> Progress: 62%, response time: 108.347 sec
> ERROR: java.net.URISyntaxException: Relative path in absolute URI:
> l_returnflag=yly:%20furiously%20ev/part-02-000002-000
> java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative
> path in absolute URI: l_returnflag=yly:%20furiously%20ev/part-02-000002-000
> at org.apache.hadoop.fs.Path.initialize(Path.java:206)
> at org.apache.hadoop.fs.Path.<init>(Path.java:172)
> at org.apache.hadoop.fs.Path.<init>(Path.java:94)
> at org.apache.tajo.storage.StorageUtil.concatPath(StorageUtil.java:104)
> at
> org.apache.tajo.engine.planner.physical.ColPartitionStoreExec.getDataFile(ColPartitionStoreExec.java:112)
> at
> org.apache.tajo.engine.planner.physical.SortBasedColPartitionStoreExec.getAppenderForNewPartition(SortBasedColPartitionStoreExec.java:86)
> at
> org.apache.tajo.engine.planner.physical.SortBasedColPartitionStoreExec.next(SortBasedColPartitionStoreExec.java:156)
> at org.apache.tajo.worker.Task.run(Task.java:425)
> at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:406)
> at java.lang.Thread.run(Thread.java:744)
> Caused by: java.net.URISyntaxException: Relative path in absolute URI:
> l_returnflag=yly:%20furiously%20ev/part-02-000002-000
> at java.net.URI.checkPath(URI.java:1804)
> at java.net.URI.<init>(URI.java:752)
> at org.apache.hadoop.fs.Path.initialize(Path.java:203)
> ... 9 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
