This was a change that was made to match a wrong answer coming from older
versions of Hive. Unfortunately I think its too late to fix this in the
1.4 branch (as I'd like to avoid changing answers at all in point
releases), but in Spark 1.5 we revert to the correct behavior.
FYI there are some problems with ASF's git or ldap infra. As a result, we
cannot merge anything into Spark right now.
An infra ticket has been created:
https://issues.apache.org/jira/browse/INFRA-9932
Please watch/vote on that ticket for progress. Thanks.