Stephen Sisk created BEAM-2388:
----------------------------------
Summary: Built-In I/Os page - "discoverability"/"supported with
adapters" section
Key: BEAM-2388
URL: https://issues.apache.org/jira/browse/BEAM-2388
Project: Beam
Issue Type: Improvement
Components: website
Reporter: Stephen Sisk
>From email discussion: [1]
The recent inclusion of HadoopInputFormatIO (HiFiIO) gave Beam users
the option to ‘easily’ include data stores that support the
Hadoop-based partitioning scheme. ... there are visibility issues since end
users would need to repackage and discover the supported (and tested)
HiFi-based IOs that won’t be explicit in the code base.
...
We might add a section to the Built-in IO Transforms page that covers
"non-native but readable" IOs (better name suggestions appreciated :) - that
could include a list of data stores that jdbc/jms/hifio support and link to
HIFIO's info on how to use them. (That might also be a good place to document
the performance tradeoffs of using HIFIO)
[1]https://lists.apache.org/thread.html/063b1dee9df43a0ba195c3921dd022b812a4e382be8173e32f84bf66@%3Cdev.beam.apache.org%3E
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
