From: lukas <[email protected]>
I'm using the hadoop-swiftfs from the sahara-extra project to read input from Swift during my MapReduce jobs. The hadoop version I am using is 2.6.0 and this already came with the hadoop-openstack additions.
I set fs.swift.service.sahara.location-aware to true in my core-site.xml and the location of input splits is correctly identified. However, it still seems that reads from MapReduce go through the Swift proxy as the proxy's network is always fully utilised.
Is there a way of directly reading from the object servers and avoid sending everything to the proxy first?
__________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: [email protected]?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
