Maxim Gekk created SPARK-24805:
----------------------------------
Summary: Don't ignore files without .avro extension by default
Key: SPARK-24805
URL: https://issues.apache.org/jira/browse/SPARK-24805
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 2.3.1
Reporter: Maxim Gekk
Currently to read files without .avro extension, users have to set the flag
*avro.mapred.ignore.inputs.without.extension* to *false* (by default it is
*true*). The ticket aims to change the default value to *false*. The reasons to
do that are:
- Other systems can create avro files without extensions. When users try to
read such files, they get just partitial results silently. The behaviour may
confuse users.
- Current behavior is different behavior from another supported datasource CSV
and JSON.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
