abhiy13 commented on a change in pull request #12645:
URL: https://github.com/apache/beam/pull/12645#discussion_r474445761
##########
File path:
sdks/java/io/contextual-text-io/src/main/java/org/apache/beam/sdk/io/contextualtextio/ContextualTextIO.java
##########
@@ -296,6 +290,19 @@ public Read withHintMatchesManyFiles() {
return toBuilder().setHintMatchesManyFiles(true).build();
}
+ /**
+ * Allows the user the opt out of getting recordNums associated with each
record.
Review comment:
Ack.
##########
File path:
sdks/java/io/contextual-text-io/src/main/java/org/apache/beam/sdk/io/contextualtextio/ContextualTextIO.java
##########
@@ -296,6 +290,19 @@ public Read withHintMatchesManyFiles() {
return toBuilder().setHintMatchesManyFiles(true).build();
}
+ /**
+ * Allows the user the opt out of getting recordNums associated with each
record.
+ *
+ * <p>ContextualTextIO uses a shuffle step to assemble the recordNums for
each record which may
+ * result in some performance loss.
+ *
+ * <p>Use this when metadata like fileNames are required and their
position/order can be
+ * ignored.
+ */
+ public Read withoutLineNumMetadata() {
Review comment:
Ack.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
