Yida Wu created IMPALA-10429:
--------------------------------
Summary: Add Support for Spilling to HDFS Path Parsing
Key: IMPALA-10429
URL: https://issues.apache.org/jira/browse/IMPALA-10429
Project: IMPALA
Issue Type: Improvement
Reporter: Yida Wu
Assignee: Yida Wu
We support HDFS scratch space as a test-only feature, but we only support a
fixed HDFS default path, no matter what input HDFS path is. The reason is the
format of the port number in the HDFS path contradicts the way we are using for
analyzing priority and size limit, like hdfs://xxx:1:10000, it needs some extra
efforts to have a general parsing logic for the HDFS path.
The JIRA is to track this spill to HDFS limitation if we need to support a
flexible HDFS scratch space input.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]