Yang Jie created SPARK-37876:
--------------------------------

             Summary: Move SpecificParquetRecordReaderBase.listDirectory to 
TestUtils
                 Key: SPARK-37876
                 URL: https://issues.apache.org/jira/browse/SPARK-37876
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.3.0
            Reporter: Yang Jie


The `SpecificParquetRecordReaderBase.listDirectory` method is used to return 
the list of files at `path` recursively and the result will skips files that 
are ignored normally by MapReduce.

This method is only used by tests in Spark now and it also includes non parquet 
related test cases, such as `OrcColumnarBatchReaderSuite`.

 

 

 

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to