Maxim Gekk created SPARK-32815:
----------------------------------
Summary: Fix LibSVM data source loading error on file paths with
glob metacharacters
Key: SPARK-32815
URL: https://issues.apache.org/jira/browse/SPARK-32815
Project: Spark
Issue Type: Bug
Components: MLlib
Affects Versions: 3.1.0
Reporter: Maxim Gekk
SPARK-32810 fixed a long standing bug in a few Spark built-in data sources that
fails to read files whose names contain glob metacharacters, such as [, ], \{,
}, etc.
CSV and JSON data source on the Spark side were affected. We've also noticed
that the LibSVM data source had the same code pattern that leads to the bug, so
the fix https://github.com/apache/spark/pull/29659 included a fix for that data
source as well, but it did not include a test for the LibSVM data source.
This ticket tracks adding a test case for LibSVM, similar to the ones for
CSV/JSON, to verify whether or not the fix works as intended.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]