I have a StreamingFileSink that writes to S3:
final StreamingFileSink<Tuple2<String, Long>> sink =
StreamingFileSink.forRowFormat(
new Path("s3://argo-artifacts/files"),
new SimpleStringEncoder<Tuple2<String, Long>>("UTF-8"))
.withBucketAssigner(new KeyBucketAssigner())
.withRollingPolicy(OnCheckpointRollingPolicy.build())
.withOutputFileConfig(config)
.build();
I’d like to get the output into CSV format so that mc or aws client can use
sql to query the data. The current output adds open/closed parentheses
around the row. Is there a way to format this without the parens?
(00136627-8e1e-4c84-9d8d-b6cfe9d092aa,1)
(00136627-8e1e-4c84-9d8d-b6cfe9d092aa,2)
--
Robert Cullen
240-475-4490