[
https://issues.apache.org/jira/browse/IGNITE-10996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anton Dmitriev updated IGNITE-10996:
------------------------------------
Description:
Currently
[IgniteDataset|https://github.com/tensorflow/io/tree/master/tensorflow_io/ignite#distributed-in-memory-datasource]
provides ability to specify only a single host/port for data schema extraction
and for data loading. This limitation doesn't allow to use
[Dataset.interleave(...)|https://www.tensorflow.org/api_docs/python/tf/data/Dataset#interleave]
and
[tf.data.experimental.parallel_interleave|https://www.tensorflow.org/api_docs/python/tf/data/experimental/parallel_interleave]
function for parallel data loading.
We need to add ability to specify host/port separately for schema extraction
and to data loading.
was:
Currently
[IgniteDataset](https://github.com/tensorflow/io/tree/master/tensorflow_io/ignite#distributed-in-memory-datasource)
provides ability to specify only a single host/port for data schema extraction
and for data loading. This limitation doesn't allow to use
[Dataset.interleave(...)](https://www.tensorflow.org/api_docs/python/tf/data/Dataset#interleave)
and [
tf.data.experimental.parallel_interleave](https://www.tensorflow.org/api_docs/python/tf/data/experimental/parallel_interleave)
function for parallel data loading.
We need to add ability to specify host/port separately for schema extraction
and to data loading.
> [ML] Add additional host and port into IgniteDataset to retrieve schema
> -----------------------------------------------------------------------
>
> Key: IGNITE-10996
> URL: https://issues.apache.org/jira/browse/IGNITE-10996
> Project: Ignite
> Issue Type: Improvement
> Components: ml
> Affects Versions: 2.8
> Reporter: Anton Dmitriev
> Assignee: Anton Dmitriev
> Priority: Major
> Fix For: 2.8
>
>
> Currently
> [IgniteDataset|https://github.com/tensorflow/io/tree/master/tensorflow_io/ignite#distributed-in-memory-datasource]
> provides ability to specify only a single host/port for data schema
> extraction and for data loading. This limitation doesn't allow to use
> [Dataset.interleave(...)|https://www.tensorflow.org/api_docs/python/tf/data/Dataset#interleave]
> and
> [tf.data.experimental.parallel_interleave|https://www.tensorflow.org/api_docs/python/tf/data/experimental/parallel_interleave]
> function for parallel data loading.
> We need to add ability to specify host/port separately for schema extraction
> and to data loading.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
