This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch fixing_spark_path_validation
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from 31a5438 Fix the issue in Pinot Spark ingestion job to handle listing
input files with correct scheme in URI
add d16c790 Moving libs
No new revisions were added by this update.
Summary of changes:
.../generation}/SegmentGenerationUtils.java | 27 ++++++++++++--
.../generation}/SegmentGenerationUtilsTest.java | 7 ++--
.../SegmentGenerationAndPushTaskGenerator.java | 41 ++++------------------
.../SegmentGenerationAndPushTaskExecutor.java | 2 +-
.../batch/hadoop/HadoopSegmentCreationMapper.java | 8 ++---
.../hadoop/HadoopSegmentGenerationJobRunner.java | 2 +-
.../spark/SparkSegmentGenerationJobRunner.java | 8 ++---
.../standalone/SegmentGenerationJobRunner.java | 18 ++--------
8 files changed, 48 insertions(+), 65 deletions(-)
rename
{pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common
=>
pinot-common/src/main/java/org/apache/pinot/common/segment/generation}/SegmentGenerationUtils.java
(91%)
rename
{pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/test/java/org/apache/pinot/plugin/ingestion/batch/common
=>
pinot-common/src/test/java/org/apache/pinot/common/segment/generation}/SegmentGenerationUtilsTest.java
(98%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
