Paul Rogers created DRILL-5062:
----------------------------------
Summary: External sort refers to the deprecated HDFS
fs.default.name param
Key: DRILL-5062
URL: https://issues.apache.org/jira/browse/DRILL-5062
Project: Apache Drill
Issue Type: Bug
Affects Versions: 1.8.0
Reporter: Paul Rogers
Assignee: Paul Rogers
Priority: Minor
Running a query that uses the external sort produces the following message in
the log file:
{code}
[org.apache.hadoop.conf.Configuration.deprecation] - fs.default.name is
deprecated. Instead, use fs.defaultFS
{code}
External sort has the following line in the {{ExternalSortBatch}} constructor:
{code}
conf.set("fs.default.name",
config.getString(ExecConstants.EXTERNAL_SORT_SPILL_FILESYSTEM));
{code}
The {{TestParquetScan}} class has the same deprecated parameter name.
Looking elsewhere in Drill, it appears that the proper way to configure HDFS is
as follows:
{code}
fsConf.set(FileSystem.FS_DEFAULT_NAME_KEY, ...
{code}
That is, use the constant provided by HDFS.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
