[openstack-dev] [openstack-swift] JOSS package to access Swift - any experience?
Hello, Java OpenStack Storage aka JOSS is a dedicated Java binding for accessing the Swift REST API. Reference to this package appears on https://wiki.openstack.org/wiki/SDKs#Java I personally find this package very nice, lightweight and easy to use. However the last time someone contributed to this project was in November 2014. I know that Swift API didn't changed much from 2014, but still recent Swift and Keystone additions are missed in JOSS. I wonder if someone from Swift community uses this package. Thanks, Gil Vernik. __ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [sahara] Notes on developing Sahara Spark EDP to work with swift:// paths
Hi Michael, I have an update to this patch with temp auth authentication also, but it's not yet submitted. I am not aware of v3 support. All the best, Gil. From: Michael McCune To: "OpenStack Development Mailing List (not for usage questions)" Date: 28/08/2014 08:14 PM Subject:Re: [openstack-dev] [sahara] Notes on developing Sahara Spark EDP to work with swift:// paths hi Gil, that's cool about the patch to Spark, has there been any talk about upgrading that patch to include Keystone v3 operations? - Original Message - > Hi, > > In case this is helpful for you, this is the patch i submitted to Spark > about Swift and Spark integration ( about to be merged ) > https://github.com/apache/spark/pull/1010 > > I sent information about this patch to this mailing list about two months > ago. > > All the best, > Gil. > > > > > > From: Trevor McKay > To: OpenStack Development Mailing List > > Date: 28/08/2014 06:22 PM > Subject:[openstack-dev] [sahara] Notes on developing Sahara Spark > EDP to work with swift:// paths > > > > Hi folks, > > I've updated this etherpad with notes from an investigation of > Spark/Swift and the hadoop-openstack plugin carried in the sahara-extra > repo. > > Following the notes there, I was able to access swift:// paths from > Spark jobs on a Spark standalone cluster launched from Sahara and then > fixed up by hand. > > Comments welcome. This is a POC at this point imho, we have work to > do to fully integrate this into Sahara. > > https://etherpad.openstack.org/p/sahara_spark_edp > > Best, > > Trevor > > > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > > > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [sahara] Notes on developing Sahara Spark EDP to work with swift:// paths
Hi, In case this is helpful for you, this is the patch i submitted to Spark about Swift and Spark integration ( about to be merged ) https://github.com/apache/spark/pull/1010 I sent information about this patch to this mailing list about two months ago. All the best, Gil. From: Trevor McKay To: OpenStack Development Mailing List Date: 28/08/2014 06:22 PM Subject:[openstack-dev] [sahara] Notes on developing Sahara Spark EDP to work with swift:// paths Hi folks, I've updated this etherpad with notes from an investigation of Spark/Swift and the hadoop-openstack plugin carried in the sahara-extra repo. Following the notes there, I was able to access swift:// paths from Spark jobs on a Spark standalone cluster launched from Sahara and then fixed up by hand. Comments welcome. This is a POC at this point imho, we have work to do to fully integrate this into Sahara. https://etherpad.openstack.org/p/sahara_spark_edp Best, Trevor ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [Sahara][Swift] Swift integration with Apache Spark
Hi All, I would like to share with you about my recent efforts on the integration between Swift and Apache Spark. Spark claims to have x100 faster map reduce analytics than conventional Apache Hadoop. (http://spark.apache.org/ for more information about Spark) Spark can read data from various sources, HDFS, S3, local file system, various streaming sources. Spark then used to perform analytics on this data. I started to work on the integration between Spark and Swift, allowing Spark to integrate with Swift and perform data analytics on the objects stored in Swift. In my local tests this works very well. There are no modification needed for Swift. I submitted patches to the Spark community with information how to integrate it with Swift. This work is still in progress. https://github.com/apache/spark/pull/1010 All the best, Gil Vernik.___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [SWIFT] Delete Object imediately after PUT
What failures you saw? Can you please provide logs? Thanks, Gil. From: Sumit Gaur To: "OpenStack Development Mailing List (not for usage questions)" , Date: 24/04/2014 11:34 AM Subject:[openstack-dev] [SWIFT] Delete Object imediately after PUT Hi All, Is it not a correct use case to Delete a object just after Putting it. I saw failures from SWIFT in such scenerio. if it is not a valid scenerio please let me know Why ? Thank sumit___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] New stackforge project: Openstackdroid
Hi Ricardo, The title of 'Android application to access Openstack clouds' certainly sounds nice to me, but since i am not a Spanish speaker I find it hard to understand what this project is about. Do you have also information about functional specifications and architecture in English? All the best, Gil Vernik. From: Ricardo Carrillo Cruz To: openstack-dev@lists.openstack.org, Date: 30/03/2014 07:03 PM Subject:[openstack-dev] New stackforge project: Openstackdroid Hello guys I'd like to let you know about my humble code contribution to Openstack, an Android application to access Openstack clouds: http://git.openstack.org/cgit/stackforge/openstackdroid/ https://launchpad.net/openstackdroid It's currently quite alpha, it can login to Openstack clouds and access data with your user/pass/tenant ID, no write operations yet. I encourage developers to grab the code, hack it and send out suggestions, patches or whatever you may think of :-) . Kind regards___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
