I have another question: what information does the clientTransferer field of ProductCrawler hold? and what is it used for?
I found that it is being set in the configureCrawler method of BeginIngestionTaskServlet, but didn't understand what information it holds and what it is used for. Thanks, Niloofar