Re: [openstack-dev] [cinder] Anyone Using the Open Solaris ZFS Driver?
The question about upgrade was purely to see if it had been thought about - I agree that the code is sufficiently broken that it is certainly not necessary, and quite possibly impossible - I just wondered if I was right in that analysis. On 26 November 2014 at 06:43, John Griffith john.griffi...@gmail.com wrote: On Mon, Nov 24, 2014 at 10:53 AM, Monty Taylor mord...@inaugust.com wrote: On 11/24/2014 10:14 AM, Drew Fisher wrote: On 11/17/14 10:27 PM, Duncan Thomas wrote: Is the new driver drop-in compatible with the old one? IF not, can existing systems be upgraded to the new driver via some manual steps, or is it basically a completely new driver with similar functionality? Possibly none of my business- but if the current driver is actually just flat broken, then upgrading from it to the new solaris ZFS driver seems unlikely to be possibly, simply because the from case is broken. Most certainly is your business as much as anybody elses, and complete valid point. IMO upgrade is a complete non-issue, drivers that are no longer maintained and obviously don't work should be marked as such in Kilo and probably removed as well. Removal question etc is up to PTL and Core but my two cents is they're useless anyway for the most part. The driver in san/solaris.py focuses entirely on iSCSI. I don't think existing systems can be upgraded manually but I've never really tried. We started with a clean slate for Solaris 11 and Cinder and added local ZFS support for single-system and demo rigs along with a fibre channel and iSCSI drivers. The driver is publically viewable here: https://java.net/projects/solaris-userland/sources/gate/content/components/openstack/cinder/files/solaris/zfs.py Please note that this driver is based on Havana. We know it's old and we're working to get it updated to Juno right now. I can try to work with my team to get a blueprint filed and start working on getting it integrated into trunk. -Drew ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Duncan Thomas ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [cinder] Anyone Using the Open Solaris ZFS Driver?
On 11/25/14, 12:56 PM, Jay S. Bryant wrote: Monty, I agree that upgrade is not a significant concern right now if the existing driver is not working. Drew, I am having trouble following where you guys are currently at with this work. I would like to help get you guys up and going during Kilo. I am concerned that maybe there is confusion about the blueprints/patches that we are all talking about here. I see this Blueprint that was accepted for Juno and appears to have an associated patch merged: [1] I also see this Blueprint that doesn't appear to be started yet: [2] So, can you help me understand what it is you are hoping to get in for Kilo? OK, so we have two drivers here at Oracle in Solaris. 1: A driver for the ZFS storage appliance (zfssa). That driver was integrated into the Icehouse branch and still there in Juno. That team, separate from mine, is working along side of us with the CI requirements to keep the driver in Kilo 2: The second driver is one for generic ZFS on Solaris. We have three different sub-drivers in one: - An iSCSI driver (COMSTAR on top of ZFS) - A FC driver (on top of ZFS) - A simple local ZFS driver useful for single-system / devstack / demo rigs. The local driver simply creates ZVOLs for Zones to use on the local system. It's not designed with any kind of migration abilities unlike iSCSI or FC. I know that you have been concerned about CI. For new drivers we are allowing some grace period to get things working. Once we get the confusion over blueprints worked out and have some code to start reviewing we can continue to discuss that issue. My plan is to discuss this plan with my team next week after the holiday. Once we get something in place on our side, we'll try to get a blueprint submitted ASAP for review. Sound good? -Drew Look forward to hearing back from you! Jay [1] https://blueprints.launchpad.net/cinder/+spec/oracle-zfssa-cinder-driver [2] https://blueprints.launchpad.net/cinder/+spec/oracle-zfssa-nfs-cinder-driver On 11/24/2014 11:53 AM, Monty Taylor wrote: On 11/24/2014 10:14 AM, Drew Fisher wrote: On 11/17/14 10:27 PM, Duncan Thomas wrote: Is the new driver drop-in compatible with the old one? IF not, can existing systems be upgraded to the new driver via some manual steps, or is it basically a completely new driver with similar functionality? Possibly none of my business- but if the current driver is actually just flat broken, then upgrading from it to the new solaris ZFS driver seems unlikely to be possibly, simply because the from case is broken. The driver in san/solaris.py focuses entirely on iSCSI. I don't think existing systems can be upgraded manually but I've never really tried. We started with a clean slate for Solaris 11 and Cinder and added local ZFS support for single-system and demo rigs along with a fibre channel and iSCSI drivers. The driver is publically viewable here: https://java.net/projects/solaris-userland/sources/gate/content/components/openstack/cinder/files/solaris/zfs.py Please note that this driver is based on Havana. We know it's old and we're working to get it updated to Juno right now. I can try to work with my team to get a blueprint filed and start working on getting it integrated into trunk. -Drew ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [cinder] Anyone Using the Open Solaris ZFS Driver?
On 14:37 Tue 25 Nov , Drew Fisher wrote: On 11/25/14, 12:56 PM, Jay S. Bryant wrote: Monty, I agree that upgrade is not a significant concern right now if the existing driver is not working. Drew, I am having trouble following where you guys are currently at with this work. I would like to help get you guys up and going during Kilo. I am concerned that maybe there is confusion about the blueprints/patches that we are all talking about here. I see this Blueprint that was accepted for Juno and appears to have an associated patch merged: [1] I also see this Blueprint that doesn't appear to be started yet: [2] So, can you help me understand what it is you are hoping to get in for Kilo? OK, so we have two drivers here at Oracle in Solaris. 1: A driver for the ZFS storage appliance (zfssa). That driver was integrated into the Icehouse branch and still there in Juno. That team, separate from mine, is working along side of us with the CI requirements to keep the driver in Kilo 2: The second driver is one for generic ZFS on Solaris. We have three different sub-drivers in one: - An iSCSI driver (COMSTAR on top of ZFS) - A FC driver (on top of ZFS) - A simple local ZFS driver useful for single-system / devstack / demo rigs. The local driver simply creates ZVOLs for Zones to use on the local system. It's not designed with any kind of migration abilities unlike iSCSI or FC. I know that you have been concerned about CI. For new drivers we are allowing some grace period to get things working. Once we get the confusion over blueprints worked out and have some code to start reviewing we can continue to discuss that issue. My plan is to discuss this plan with my team next week after the holiday. Once we get something in place on our side, we'll try to get a blueprint submitted ASAP for review. Sound good? Hi Drew, We're not accepting anymore drivers for the Kilo release. This was from a discussion that started back in September and mentioned on the mailing list a couple of times [1][2], multiple Cinder meetings [3][4], and the last design summit. The one driver we have from Oracle is a ZFS NFS [5] driver that was registered before the deadline. If you could verify with your team if they plan to fix the existing Solaris ISCSI driver [5], or can we remove it? [1] - http://lists.openstack.org/pipermail/openstack-dev/2014-September/044990.html [2] - http://lists.openstack.org/pipermail/openstack-dev/2014-October/049512.html [3] - http://eavesdrop.openstack.org/meetings/cinder/2014/cinder.2014-09-03-16.01.log.html [4] - http://eavesdrop.openstack.org/meetings/cinder/2014/cinder.2014-10-29-16.00.log.html [5] - https://blueprints.launchpad.net/cinder/+spec/oracle-zfssa-nfs-cinder-driver [5] - https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/san/solaris.py -- Mike Perez ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [cinder] Anyone Using the Open Solaris ZFS Driver?
On Mon, Nov 24, 2014 at 10:53 AM, Monty Taylor mord...@inaugust.com wrote: On 11/24/2014 10:14 AM, Drew Fisher wrote: On 11/17/14 10:27 PM, Duncan Thomas wrote: Is the new driver drop-in compatible with the old one? IF not, can existing systems be upgraded to the new driver via some manual steps, or is it basically a completely new driver with similar functionality? Possibly none of my business- but if the current driver is actually just flat broken, then upgrading from it to the new solaris ZFS driver seems unlikely to be possibly, simply because the from case is broken. Most certainly is your business as much as anybody elses, and complete valid point. IMO upgrade is a complete non-issue, drivers that are no longer maintained and obviously don't work should be marked as such in Kilo and probably removed as well. Removal question etc is up to PTL and Core but my two cents is they're useless anyway for the most part. The driver in san/solaris.py focuses entirely on iSCSI. I don't think existing systems can be upgraded manually but I've never really tried. We started with a clean slate for Solaris 11 and Cinder and added local ZFS support for single-system and demo rigs along with a fibre channel and iSCSI drivers. The driver is publically viewable here: https://java.net/projects/solaris-userland/sources/gate/content/components/openstack/cinder/files/solaris/zfs.py Please note that this driver is based on Havana. We know it's old and we're working to get it updated to Juno right now. I can try to work with my team to get a blueprint filed and start working on getting it integrated into trunk. -Drew ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [cinder] Anyone Using the Open Solaris ZFS Driver?
On 11/17/14 10:27 PM, Duncan Thomas wrote: Is the new driver drop-in compatible with the old one? IF not, can existing systems be upgraded to the new driver via some manual steps, or is it basically a completely new driver with similar functionality? The driver in san/solaris.py focuses entirely on iSCSI. I don't think existing systems can be upgraded manually but I've never really tried. We started with a clean slate for Solaris 11 and Cinder and added local ZFS support for single-system and demo rigs along with a fibre channel and iSCSI drivers. The driver is publically viewable here: https://java.net/projects/solaris-userland/sources/gate/content/components/openstack/cinder/files/solaris/zfs.py Please note that this driver is based on Havana. We know it's old and we're working to get it updated to Juno right now. I can try to work with my team to get a blueprint filed and start working on getting it integrated into trunk. -Drew ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [cinder] Anyone Using the Open Solaris ZFS Driver?
On 11/24/2014 10:14 AM, Drew Fisher wrote: On 11/17/14 10:27 PM, Duncan Thomas wrote: Is the new driver drop-in compatible with the old one? IF not, can existing systems be upgraded to the new driver via some manual steps, or is it basically a completely new driver with similar functionality? Possibly none of my business- but if the current driver is actually just flat broken, then upgrading from it to the new solaris ZFS driver seems unlikely to be possibly, simply because the from case is broken. The driver in san/solaris.py focuses entirely on iSCSI. I don't think existing systems can be upgraded manually but I've never really tried. We started with a clean slate for Solaris 11 and Cinder and added local ZFS support for single-system and demo rigs along with a fibre channel and iSCSI drivers. The driver is publically viewable here: https://java.net/projects/solaris-userland/sources/gate/content/components/openstack/cinder/files/solaris/zfs.py Please note that this driver is based on Havana. We know it's old and we're working to get it updated to Juno right now. I can try to work with my team to get a blueprint filed and start working on getting it integrated into trunk. -Drew ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [cinder] Anyone Using the Open Solaris ZFS Driver?
On 07:27 Tue 18 Nov , Duncan Thomas wrote: Is the new driver drop-in compatible with the old one? IF not, can existing systems be upgraded to the new driver via some manual steps, or is it basically a completely new driver with similar functionality? On 17 November 2014 07:08, Drew Fisher drew.fis...@oracle.com wrote: We (here at Oracle) have a replacement for this driver which includes local ZFS, iSCSI and FC drivers all with ZFS as the underlying driver. We're in the process of getting CI set up so we can contribute the driver upstream along with our ZFSSA driver (which is already in the tree). If anybody has more questions about this, please let me know. The driver is in the open for folks to look at and if anybody wants us to start upstream integration for it, we'll be happy to do so. -Drew On 11/16/14, 8:45 PM, Mike Perez wrote: The Open Solaris ZFS driver [1] is currently missing a lot of the minimum features [2] that the Cinder team requires with all drivers. As a result, it's really broken. I wanted to gauge who is using it, and if anyone was interested in fixing the driver. If there is not any activity with this driver, I would like to propose it to be deprecated for removal. [1] - https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/san/solaris.py [2] - http://docs.openstack.org/developer/cinder/devref/drivers.html#minimum-features ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Duncan Thomas Drew can you answer Duncan's question? I would like to get a head start on deprecating the driver, or expect your replacement this release to be compatible with the existing one. -- Mike Perez ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [cinder] Anyone Using the Open Solaris ZFS Driver?
Drew, I would say that it would be good to open a Blueprint for this and push the code up for review. Even if you don't have CI ready yet you can post results of a driver cert test [1] and we can start reviewing the code while you work on finishing up the process of getting your CI running. Look forward to seeing you code. Jay [1] https://wiki.openstack.org/wiki/Cinder/tested-3rdParty-drivers On 11/16/2014 11:08 PM, Drew Fisher wrote: We (here at Oracle) have a replacement for this driver which includes local ZFS, iSCSI and FC drivers all with ZFS as the underlying driver. We're in the process of getting CI set up so we can contribute the driver upstream along with our ZFSSA driver (which is already in the tree). If anybody has more questions about this, please let me know. The driver is in the open for folks to look at and if anybody wants us to start upstream integration for it, we'll be happy to do so. -Drew On 11/16/14, 8:45 PM, Mike Perez wrote: The Open Solaris ZFS driver [1] is currently missing a lot of the minimum features [2] that the Cinder team requires with all drivers. As a result, it's really broken. I wanted to gauge who is using it, and if anyone was interested in fixing the driver. If there is not any activity with this driver, I would like to propose it to be deprecated for removal. [1] - https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/san/solaris.py [2] - http://docs.openstack.org/developer/cinder/devref/drivers.html#minimum-features ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [cinder] Anyone Using the Open Solaris ZFS Driver?
Is the new driver drop-in compatible with the old one? IF not, can existing systems be upgraded to the new driver via some manual steps, or is it basically a completely new driver with similar functionality? On 17 November 2014 07:08, Drew Fisher drew.fis...@oracle.com wrote: We (here at Oracle) have a replacement for this driver which includes local ZFS, iSCSI and FC drivers all with ZFS as the underlying driver. We're in the process of getting CI set up so we can contribute the driver upstream along with our ZFSSA driver (which is already in the tree). If anybody has more questions about this, please let me know. The driver is in the open for folks to look at and if anybody wants us to start upstream integration for it, we'll be happy to do so. -Drew On 11/16/14, 8:45 PM, Mike Perez wrote: The Open Solaris ZFS driver [1] is currently missing a lot of the minimum features [2] that the Cinder team requires with all drivers. As a result, it's really broken. I wanted to gauge who is using it, and if anyone was interested in fixing the driver. If there is not any activity with this driver, I would like to propose it to be deprecated for removal. [1] - https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/san/solaris.py [2] - http://docs.openstack.org/developer/cinder/devref/drivers.html#minimum-features ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev -- Duncan Thomas ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] [cinder] Anyone Using the Open Solaris ZFS Driver?
The Open Solaris ZFS driver [1] is currently missing a lot of the minimum features [2] that the Cinder team requires with all drivers. As a result, it's really broken. I wanted to gauge who is using it, and if anyone was interested in fixing the driver. If there is not any activity with this driver, I would like to propose it to be deprecated for removal. [1] - https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/san/solaris.py [2] - http://docs.openstack.org/developer/cinder/devref/drivers.html#minimum-features -- Mike Perez ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] [cinder] Anyone Using the Open Solaris ZFS Driver?
We (here at Oracle) have a replacement for this driver which includes local ZFS, iSCSI and FC drivers all with ZFS as the underlying driver. We're in the process of getting CI set up so we can contribute the driver upstream along with our ZFSSA driver (which is already in the tree). If anybody has more questions about this, please let me know. The driver is in the open for folks to look at and if anybody wants us to start upstream integration for it, we'll be happy to do so. -Drew On 11/16/14, 8:45 PM, Mike Perez wrote: The Open Solaris ZFS driver [1] is currently missing a lot of the minimum features [2] that the Cinder team requires with all drivers. As a result, it's really broken. I wanted to gauge who is using it, and if anyone was interested in fixing the driver. If there is not any activity with this driver, I would like to propose it to be deprecated for removal. [1] - https://github.com/openstack/cinder/blob/master/cinder/volume/drivers/san/solaris.py [2] - http://docs.openstack.org/developer/cinder/devref/drivers.html#minimum-features ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
