orhankislal commented on a change in pull request #16: MADlib image loader:
load dataset from disk
URL: https://github.com/apache/madlib-site/pull/16#discussion_r304553237
##########
File path: community-artifacts/Deep-learning/madlib_image_loader.py
##########
@@ -383,36 +495,180 @@ def load_np_array_to_table(self, data_x, data_y,
table_name=None,
# ( inside x can also be a numpy tensor with several dimensions, but y
# should just be a single scalar )
#
- # multiprocessing library will call _call_worker() in some worker for
+ # multiprocessing library will call _call_np_worker() in some worker
for
# each file, splitting the list of files up into roughly equal chunks
# for each worker to handle. For example, if there are 500 files and
- # 5 workers, each will handle about 100 files, and _call_worker()
will
- # be called 100 times, each time with a different file full of
images.
- #
+ # 5 workers, each will handle about 100 files, and _call_np_worker()
+ # will # be called 100 times, each time with a different file full
Review comment:
will # be -> will be
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
