: I have an issue that is only coming on live environment. The DIH : with URLDataSource is not working when the file size imported is large : (i.e. 100kb above - which is not so large). If its large, it returns : nothing (as seen in the Debug section of DataImport at Solr Admin).
are you sure the problem is the *size* of the file you are trying to load, and not something related to network topology? if a remote URL fetch works in dev, but not in production my first guess would be that the URL you are trying to fetch is not reachable by your production server due to some sort of firewall ... can you actaully confirm that a smaller file -- fetched from the same server -- works in production? -Hoss
