(The suggestion here is to use Tensorflow with Spark - definitely doable
for a long time with things like Horovod. Spark handles the image
processing just fine)
On Thu, Oct 14, 2021 at 10:17 AM Artemis User
wrote:
> Spark is good with SQL type of structured data, not image data. Unless
> you al
Spark is good with SQL type of structured data, not image data. Unless
you algorithms don' t require dealing with image data directly. I guess
your best option would be to go with Tensorflow since it has image
classification models built-in and can integrate with NVidia GPUs out of
the box. Th
You could distribute the computation across a cluster with Spark and
Horovod (and Petastorm) for example:
https://github.com/horovod/horovod
https://github.com/uber/petastorm
If you're at a few hours, it may not be worth it - it's not hard to set up
but is more involved. You may do better with a l
Hi,
My name is Peiwen. I'm working with Dr. Brain, an AI company focused on medical
imaging processing and deep learning. Our website
is http://drbrain.net/index_en.aspx
We basically do 2 major things. 1. image process, like lesion drawing 2. deep
learning for neural disease prediction, like str