Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-20 Thread Phil Payne

 Yes, BDAM can use the key portion, however faster access was achived if the
 lookup value for finding a record was mapped by some calculation into
 CCHHR; otherwise BDAM's performance was not much better than ISAM's

There was an article in Datamation (back when it was a good magazine) called The 
Hidden Speed
of ISAM.

Anyone still have a copy?

There's a rhyme in German:

ISAM ist langsam,
VSAM is grausam.

ISAM is slow,
VSAM is horrible.

And yes - in German it both scans and rhymes.

--
  Phil Payne
  http://www.isham-research.com
  +44 7785 302 803
  +49 173 6242039



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-20 Thread Ward, Garry

For VSE with FBA devices, the VTOC wasn't keyed as it was on a CKD device;
it's been years since I used a 3310 or a 3370; so I'm stretching here; but
the if I remember correctly, the vtoc was built on a VSAM KSDS model.

Yes, BDAM can use the key portion, however faster access was achived if the
lookup value for finding a record was mapped by some calculation into
CCHHR; otherwise BDAM's performance was not much better than ISAM's

It is my understanding that most of the PDS/PDSE support in MVS nowadays is
based on VSAM ESDS structures; with the changes for Systems Managed Storage
support, DASD is actually viewed as VSAM space.

A release or two back in OS/390 the ability to share packs between VSE  MVS
went away; the OS/390 VTOCs weren't structured the same way as they use to
be, and VSE would no longer be able to access them.


Garry E. Ward
Senior Software Specialist
Maritz Research
Automotive Research Group
419-725-4123



-Original Message-
From: John Summerfield [mailto:[EMAIL PROTECTED]]
Sent: Friday, April 19, 2002 1:27 PM
To: [EMAIL PROTECTED]
Subject: Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]



 The only folks that would really be in trouble are those who wrote code to
 mathmaticaly map some data value into a CCHHRR value, which is what Direct
 Access Method originally did. These people would have to come up with a
way
 to convert their key value to a relative record number instead of a
CCHHR


VTOCs use keyed records, and AFAIK it's possible to share disks between
DOS and OS families (heard of the DOS contamination bit?). The file I
had in mind in the example below is the VTOC.

BDAM can use keyed records.

Partitioned dataset directories are keyed files.

Or have these things changed over the years?


  For VSAM it isn't that bad; and Relative Byte Address is a Relative Byte
  Address, on FBA it's a little easier becasue you just map from the first
  byte on the pack. VTOC's used the relative record approach instead of an
  CCHHRR.
 
 

 I was think more of the CKD disks' ability to store and recognise keys
 as distinct from data.

 Mapping CCHR address is just a matter of simple arithmetic and bothers
 me not at all. However, if my program logic is to search the file for
 the record with the key accounts.sourcelib and read the data, then I
 don't see how this maps to the FBA architecture.

 Unless the drives have that capability.



 --
 Cheers
 John Summerfield

 Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

 Note: mail delivered to me is deemed to be intended for me, for my
 disposition.

 ==
 If you don't like being told you're wrong,
 be right!


 font size=1Confidentiality Warning:  This e-mail contains information
int
 ended only for the use of the individual or entity named above.  If the
reade
 r of this e-mail is not the intended recipient or the employee or agent
respo
 nsible for delivering it to the intended recipient, any dissemination,
public
 ation or copying of this e-mail is strictly prohibited. The sender does
not a
 ccept any responsibility for any loss, disruption or damage to your data
or c
 omputer system that may occur while using data contained in, or
transmitted w
 ith, this e-mail.   If you have received this e-mail in error, please
immedia
 tely notify us by return e-mail.  Thank you.


--
Cheers
John Summerfield

Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

Note: mail delivered to me is deemed to be intended for me, for my
disposition.

==
If you don't like being told you're wrong,
be right!


font size=1Confidentiality Warning:  This e-mail contains information intended 
only for the use of the individual or entity named above.  If the reader of this 
e-mail is not the intended recipient or the employee or agent responsible for 
delivering it to the intended recipient, any dissemination, publication or copying of 
this e-mail is strictly prohibited. The sender does not accept any responsibility for 
any loss, disruption or damage to your data or computer system that may occur while 
using data contained in, or transmitted with, this e-mail.   If you have received this 
e-mail in error, please immediately notify us by return e-mail.  Thank you.



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-19 Thread Ward, Garry

The CKD's ability to handle separate keys from the data was born in the days
of ISAM, when an indexed file was literally written with the index on the
track. If the ISAM file was unblocked, then each record had the key for that
record written first, then the data; an index search was data at the
channel program level.
If it was blocked, then the highest key in the block became the key written
on the track. In this case, the channel program looked for a higher than key
and the ISAM routines read that block and pulled it apart looking for the
correct record.

The separate index in ISAM was simply used to store the highest key in each
cylinder, so that the channel program could be tailored to scan the keys in
only one cylinder at a time, rather than trying to hunt across multiple
cylinders. Also why ISAM files were preferred to be placed on cylinder
boundaries

A great technique for the 1960s; but in today's environment, not such a good
idea. A VSAM Key Sequence file does not use the key part of the CKD;
everything is in relative CI format, with the index part being nothing more
than a collection of CIs with keys  RBAs to where the record is located.
Maps to FBA like a charm.

The only folks that would really be in trouble are those who wrote code to
mathmaticaly map some data value into a CCHHRR value, which is what Direct
Access Method originally did. These people would have to come up with a way
to convert their key value to a relative record number instead of a CCHHR

Garry E. Ward
Senior Software Specialist
Maritz Research
Automotive Research Group
419-725-4123



-Original Message-
From: John Summerfield [mailto:[EMAIL PROTECTED]]
Sent: Thursday, April 18, 2002 10:13 PM
To: [EMAIL PROTECTED]
Subject: Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]


 For VSAM it isn't that bad; and Relative Byte Address is a Relative Byte
 Address, on FBA it's a little easier becasue you just map from the first
 byte on the pack. VTOC's used the relative record approach instead of an
 CCHHRR.



I was think more of the CKD disks' ability to store and recognise keys
as distinct from data.

Mapping CCHR address is just a matter of simple arithmetic and bothers
me not at all. However, if my program logic is to search the file for
the record with the key accounts.sourcelib and read the data, then I
don't see how this maps to the FBA architecture.

Unless the drives have that capability.



--
Cheers
John Summerfield

Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

Note: mail delivered to me is deemed to be intended for me, for my
disposition.

==
If you don't like being told you're wrong,
be right!


font size=1Confidentiality Warning:  This e-mail contains information intended 
only for the use of the individual or entity named above.  If the reader of this 
e-mail is not the intended recipient or the employee or agent responsible for 
delivering it to the intended recipient, any dissemination, publication or copying of 
this e-mail is strictly prohibited. The sender does not accept any responsibility for 
any loss, disruption or damage to your data or computer system that may occur while 
using data contained in, or transmitted with, this e-mail.   If you have received this 
e-mail in error, please immediately notify us by return e-mail.  Thank you.



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-19 Thread David Boyes


 Has anyone tried iSCSI with S/390 ?

Yes. The limiting factor is currently network adapter performance, but it
does work for everything except IPL (duh).  We're doing a bit more stress
testing internally before letting it loose on the world.

-- db



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-19 Thread David Boyes

 Really? As in talking to existing Fiber Channel[1] disk
 arrays that speak
 FC-SCSI? and/or via FC-SCSI bridges to random SCSI devices?
 Where can I find
 out more? I used to work on FC-attached storage array systems
 at Compaq...

Yup. They were demonstrating it at LinuxWorld in NYC in January. Burning CDs
from the z800.

-- db



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-19 Thread John Summerfield


 The only folks that would really be in trouble are those who wrote code to
 mathmaticaly map some data value into a CCHHRR value, which is what Direct
 Access Method originally did. These people would have to come up with a way
 to convert their key value to a relative record number instead of a CCHHR


VTOCs use keyed records, and AFAIK it's possible to share disks between
DOS and OS families (heard of the DOS contamination bit?). The file I
had in mind in the example below is the VTOC.

BDAM can use keyed records.

Partitioned dataset directories are keyed files.

Or have these things changed over the years?


  For VSAM it isn't that bad; and Relative Byte Address is a Relative Byte
  Address, on FBA it's a little easier becasue you just map from the first
  byte on the pack. VTOC's used the relative record approach instead of an
  CCHHRR.
 
 

 I was think more of the CKD disks' ability to store and recognise keys
 as distinct from data.

 Mapping CCHR address is just a matter of simple arithmetic and bothers
 me not at all. However, if my program logic is to search the file for
 the record with the key accounts.sourcelib and read the data, then I
 don't see how this maps to the FBA architecture.

 Unless the drives have that capability.



 --
 Cheers
 John Summerfield

 Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

 Note: mail delivered to me is deemed to be intended for me, for my
 disposition.

 ==
 If you don't like being told you're wrong,
 be right!


 font size=1Confidentiality Warning:  This e-mail contains information int
 ended only for the use of the individual or entity named above.  If the reade
 r of this e-mail is not the intended recipient or the employee or agent respo
 nsible for delivering it to the intended recipient, any dissemination, public
 ation or copying of this e-mail is strictly prohibited. The sender does not a
 ccept any responsibility for any loss, disruption or damage to your data or c
 omputer system that may occur while using data contained in, or transmitted w
 ith, this e-mail.   If you have received this e-mail in error, please immedia
 tely notify us by return e-mail.  Thank you.


--
Cheers
John Summerfield

Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

Note: mail delivered to me is deemed to be intended for me, for my
disposition.

==
If you don't like being told you're wrong,
be right!



Re: How to pre-allocate a 4GB File?

2002-04-19 Thread A. Harry Williams

On Thu, 18 Apr 2002 12:58:41 -0400 Don Stubbs said:

Has anyone heard of any IBM plans to provide non-ECKD DASD support for zOS?
We can't go on emulating 33X0 volumes much longer.

Why not?  I can't think of a technical reason we can't.  There are
support reasons to maintain it.  Sure it would be nice to remove
some restrictions, but the basic emulation has no reason to
disappear.


Don Stubbs
/ahw



Re: How to pre-allocate a 4GB File?

2002-04-19 Thread Rengasamy, Samy

I believe I would at least need 2 free dasdpacks to get 4+ GB with LVM.
What are the steps to activate this 2 packs as LVM pack?
I have to add these 2 at /etc/lvmtab. Should I have to specify any parameter
in /etc/fstab at all?

Thanks,

Samy Rengasamy.

-Original Message-
From: Post, Mark K [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, April 17, 2002 12:39 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Samy,

SuSE 7.0 has LVM support built into it.  Red Hat 7.2 does not.  For RAID
support, take a look at http://www.marist.edu/htbin/wlvtype?LINUX-VM.22398
and http://www.linuxdoc.org/HOWTO/Software-RAID-HOWTO.html

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, April 17, 2002 1:28 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Do I have to upgrade to 2.4 kernel to run LVM?

How can I build software RAID-O?

Thanks,

Samy Rengasamy.

-Original Message-
From: Post, Mark K [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 16, 2002 10:20 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Samy,

You'll need to be running a 2.4 kernel, and either LVM, or RAID to aggregate
multiple 3390 volumes, or have some 3390-9 volumes available.

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 16, 2002 6:16 PM
To: [EMAIL PROTECTED]
Subject: How to pre-allocate a 4GB File?


How to pre-allocate a 4GB File in a system with several 2.3 GB dasds?

We're looking for a way to be able to create a single file slightly
larger than 4Gbytes (to test some logic in the code which has been
known to break on ports where seek offsets go over 32-bits).

Or is the largest file we can ever make around 2.3Gbytes ?

Thanks,

Samy Rengasamy.



Re: How to pre-allocate a 4GB File?

2002-04-19 Thread Post, Mark K

Samy,

The Distributions Redbook covers what you need to do in a step-by-step
process in Chapter 17.

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Friday, April 19, 2002 3:46 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


I believe I would at least need 2 free dasdpacks to get 4+ GB with LVM.
What are the steps to activate this 2 packs as LVM pack?
I have to add these 2 at /etc/lvmtab. Should I have to specify any parameter
in /etc/fstab at all?

Thanks,

Samy Rengasamy.

-Original Message-
From: Post, Mark K [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, April 17, 2002 12:39 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Samy,

SuSE 7.0 has LVM support built into it.  Red Hat 7.2 does not.  For RAID
support, take a look at http://www.marist.edu/htbin/wlvtype?LINUX-VM.22398
and http://www.linuxdoc.org/HOWTO/Software-RAID-HOWTO.html

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, April 17, 2002 1:28 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Do I have to upgrade to 2.4 kernel to run LVM?

How can I build software RAID-O?

Thanks,

Samy Rengasamy.

-Original Message-
From: Post, Mark K [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 16, 2002 10:20 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Samy,

You'll need to be running a 2.4 kernel, and either LVM, or RAID to aggregate
multiple 3390 volumes, or have some 3390-9 volumes available.

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 16, 2002 6:16 PM
To: [EMAIL PROTECTED]
Subject: How to pre-allocate a 4GB File?


How to pre-allocate a 4GB File in a system with several 2.3 GB dasds?

We're looking for a way to be able to create a single file slightly
larger than 4Gbytes (to test some logic in the code which has been
known to break on ports where seek offsets go over 32-bits).

Or is the largest file we can ever make around 2.3Gbytes ?

Thanks,

Samy Rengasamy.



Re: How to pre-allocate a 4GB File?

2002-04-19 Thread Rengasamy, Samy

Thanks for the info.
We run SuSe Linux 7.0 - Kernel 2.2.16 (2).
I believe the red book is with info for 2.2 kernels

Thanks again,

Samy Rengasamy.

-Original Message-
From: Post, Mark K [mailto:[EMAIL PROTECTED]]
Sent: Friday, April 19, 2002 3:00 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Samy,

The Distributions Redbook covers what you need to do in a step-by-step
process in Chapter 17.

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Friday, April 19, 2002 3:46 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


I believe I would at least need 2 free dasdpacks to get 4+ GB with LVM.
What are the steps to activate this 2 packs as LVM pack?
I have to add these 2 at /etc/lvmtab. Should I have to specify any parameter
in /etc/fstab at all?

Thanks,

Samy Rengasamy.

-Original Message-
From: Post, Mark K [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, April 17, 2002 12:39 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Samy,

SuSE 7.0 has LVM support built into it.  Red Hat 7.2 does not.  For RAID
support, take a look at http://www.marist.edu/htbin/wlvtype?LINUX-VM.22398
and http://www.linuxdoc.org/HOWTO/Software-RAID-HOWTO.html

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, April 17, 2002 1:28 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Do I have to upgrade to 2.4 kernel to run LVM?

How can I build software RAID-O?

Thanks,

Samy Rengasamy.

-Original Message-
From: Post, Mark K [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 16, 2002 10:20 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Samy,

You'll need to be running a 2.4 kernel, and either LVM, or RAID to aggregate
multiple 3390 volumes, or have some 3390-9 volumes available.

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 16, 2002 6:16 PM
To: [EMAIL PROTECTED]
Subject: How to pre-allocate a 4GB File?


How to pre-allocate a 4GB File in a system with several 2.3 GB dasds?

We're looking for a way to be able to create a single file slightly
larger than 4Gbytes (to test some logic in the code which has been
known to break on ports where seek offsets go over 32-bits).

Or is the largest file we can ever make around 2.3Gbytes ?

Thanks,

Samy Rengasamy.



Re: How to pre-allocate a 4GB File?

2002-04-19 Thread Rick Troth

 Has anyone heard of any IBM plans to provide non-ECKD DASD 
 support for zOS?
 We can't go on emulating 33X0 volumes much longer.
 
What Harry said. 
 
While I agree that MVS should grok FBA,  but 
the problem is not that we have and continue to have CKD. 
The problem is that FBA is so poorly valued in S/390 circles. 
There is the incorrect assumption that all S/390 DASD is CKD. 
 
One of the inelegant results is where the S/390 side of some 
storage subsystem continues to use CKD flavor while the SCSI side 
gives access to that same content.   IFF such dual-port access 
is enabled,  it should on the SCSI side retain all the key, 
track  record blocking, count, and whatever other non data 
content.   OR,  let the S/390 side of such a thing be FBA. 
 
I confess that I have limited experience with multi-protocol DASD, 
but at least one engineer has told me that the plan is to wrap 
distributed systems content (just blocks) in CKD style records. 
That bothers me.   I'm hoping he's wrong. 
 
The value of FBA is that it *only* supports data. 
There is no non data to be lost in the translation one way 
nor to be simulated in some cheezy glue microcode the other way. 
 
I guess I'm just looking for consistency. 
But we can't make others do  the right thing,  can we? 
 



Re: How to pre-allocate a 4GB File?

2002-04-19 Thread Post, Mark K

As a matter of fact, I was using a SuSE 2.2 system to write that chapter.  I
did a lot of cutting an pasting from my TeraTerm window to make sure I got
it all exactly right.  (Including the forgetting to run certain commands in
the right order!)

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Friday, April 19, 2002 4:11 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Thanks for the info.
We run SuSe Linux 7.0 - Kernel 2.2.16 (2).
I believe the red book is with info for 2.2 kernels

Thanks again,

Samy Rengasamy.

-Original Message-
From: Post, Mark K [mailto:[EMAIL PROTECTED]]
Sent: Friday, April 19, 2002 3:00 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Samy,

The Distributions Redbook covers what you need to do in a step-by-step
process in Chapter 17.

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Friday, April 19, 2002 3:46 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


I believe I would at least need 2 free dasdpacks to get 4+ GB with LVM.
What are the steps to activate this 2 packs as LVM pack?
I have to add these 2 at /etc/lvmtab. Should I have to specify any parameter
in /etc/fstab at all?

Thanks,

Samy Rengasamy.

-Original Message-
From: Post, Mark K [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, April 17, 2002 12:39 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Samy,

SuSE 7.0 has LVM support built into it.  Red Hat 7.2 does not.  For RAID
support, take a look at http://www.marist.edu/htbin/wlvtype?LINUX-VM.22398
and http://www.linuxdoc.org/HOWTO/Software-RAID-HOWTO.html

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, April 17, 2002 1:28 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Do I have to upgrade to 2.4 kernel to run LVM?

How can I build software RAID-O?

Thanks,

Samy Rengasamy.

-Original Message-
From: Post, Mark K [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 16, 2002 10:20 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Samy,

You'll need to be running a 2.4 kernel, and either LVM, or RAID to aggregate
multiple 3390 volumes, or have some 3390-9 volumes available.

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 16, 2002 6:16 PM
To: [EMAIL PROTECTED]
Subject: How to pre-allocate a 4GB File?


How to pre-allocate a 4GB File in a system with several 2.3 GB dasds?

We're looking for a way to be able to create a single file slightly
larger than 4Gbytes (to test some logic in the code which has been
known to break on ports where seek offsets go over 32-bits).

Or is the largest file we can ever make around 2.3Gbytes ?

Thanks,

Samy Rengasamy.



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread John Summerfield

 On Wed, 17 Apr 2002, John Summerfield wrote:
  Or can I do better on a PC than you can on a mainframe?

 John,  the reason why large filesystems are challenging on S/390 is
 because the disk hardware is still tuned mostly for MVS,  which does not
 use a fixed-block storage strategy.   As a result,  DASD tend to be of
 record/track/cylinder geometry and in standard sizes.   Now there
 *is* a 10G size,  but the common one these days is about 2.3G.

 S/390 does also have FBA (fixed block architecture) DASD devices.
 Sadly,  even in the Linux world these are not widely known or used.
 I maintain that they should be employed heavily and heartily!
 The benefits are numerous.

Back when I was a sysprog we used VS1, and that had no support for FBA
devices (I think the 3370 was supported on MVS back then).

We used 2314 (and 2319), and Memorex 3330-{1,11} equivalents.



I wasn't referring to the use of LVM. I was referring to the assertion
that ext2 and/oor glibc can't cope.

They can, and I've done it on my PC. However, I don't recall the
precise software requirements.

Of course, you need some disk-combining facility such as RAID or LVM if
your physical disks are not that big.

I'm sadly out of touch with mainframe hardware; it seems strange to me
I can get 120 Gbyte disks for my PC and you folk are using 2.3 Gbyte
drives on your mainframes. I know the theoretical limit is larger than
that, and was back when S/360 was announced.


--
Cheers
John Summerfield

Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

Note: mail delivered to me is deemed to be intended for me, for my
disposition.

==
If you don't like being told you're wrong,
be right!



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread John Summerfield

[EMAIL PROTECTED] said:
 Do I have to upgrade to 2.4 kernel to run LVM?

You need 2.4 for files larger then 2.1 Gbytes.


--
Cheers
John Summerfield

Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

Note: mail delivered to me is deemed to be intended for me, for my
disposition.

==
If you don't like being told you're wrong,
be right!



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread Peter Webb, Toronto Transit Commission

 I'm sadly out of touch with mainframe hardware; it seems strange to me
 I can get 120 Gbyte disks for my PC and you folk are using 2.3 Gbyte
 drives on your mainframes. I know the theoretical limit is larger than
 that, and was back when S/360 was announced.


One advantage to the limited disk size is that since you can only
have one I/O active to a disk volume at one time, spreading data over many
smaller volumes allows more I/Os to be active at the same time. This can
dramatically improve system I/O throughput. IBM even warns that using
3390-9s can degrade performance, think what using a 3390-120Gigabyte would
do! In the PC world, I believe you can see the same sort of effect by using
RAID0 across multiple volumes, versus one large volume.



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread Jay Maynard

On Thu, Apr 18, 2002 at 07:23:55AM +0800, John Summerfield wrote:
  S/390 does also have FBA (fixed block architecture) DASD devices.
  Sadly,  even in the Linux world these are not widely known or used.
  I maintain that they should be employed heavily and heartily!
  The benefits are numerous.

Oh? Like what? Remember that, these days, most DASD is made up of huge RAID
arrays emulating either classic FBA or CKD devices, and the emulation
overhead of either is pretty small.

 Back when I was a sysprog we used VS1, and that had no support for FBA
 devices (I think the 3370 was supported on MVS back then).

MVS never has supported any FBA devices. The problem is that the CKD
architecture is heavily embedded deep in two critical pieces of the MVS
core: program fetch and VTOC processing. I'm not familiar with the details
of PDSEs for program fetch, but if load libraries are PDSes, they're still
searched by SEARCH KEY CCWs.

 I'm sadly out of touch with mainframe hardware; it seems strange to me
 I can get 120 Gbyte disks for my PC and you folk are using 2.3 Gbyte
 drives on your mainframes. I know the theoretical limit is larger than
 that, and was back when S/360 was announced.

The limit is that the cylinder number is a halfword, and exceeding that
breaks a LOT of things. There are even today things you can't put on a
3390-9 beyond cylinder 65535 (the JES2 spool dataset springs immediately to
mind).

OTOH, MVS shops ran into the need to span volumes a long time before others
did, and so they understand how to manage multivolume datasets very well.



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread Phil Payne

  I'm sadly out of touch with mainframe hardware; it seems strange to me
  I can get 120 Gbyte disks for my PC and you folk are using 2.3 Gbyte
  drives on your mainframes. I know the theoretical limit is larger than
  that, and was back when S/360 was announced.

 One advantage to the limited disk size is that since you can only
 have one I/O active to a disk volume at one time, spreading data over many
 smaller volumes allows more I/Os to be active at the same time. This can
 dramatically improve system I/O throughput. IBM even warns that using
 3390-9s can degrade performance, think what using a 3390-120Gigabyte would
 do! In the PC world, I believe you can see the same sort of effect by using
 RAID0 across multiple volumes, versus one large volume.

Locality of reference applies to files, too - 3 3390-3s are not three times better 
than one
3390-9.

PAV is the proper approach.

--
  Phil Payne
  http://www.isham-research.com
  +44 7785 302 803
  +49 173 6242039



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread Dave Jones

 -Original Message-
 From: Linux on 390 Port [mailto:[EMAIL PROTECTED]]On Behalf Of
 John Summerfield
 Sent: Wednesday, April 17, 2002 4:24 PM
 To: [EMAIL PROTECTED]
 Subject: Re: How to pre-allocate a 4GB File?



 Of course, you need some disk-combining facility such as RAID or LVM if
 your physical disks are not that big.

 I'm sadly out of touch with mainframe hardware; it seems strange to me
 I can get 120 Gbyte disks for my PC and you folk are using 2.3 Gbyte
 drives on your mainframes. I know the theoretical limit is larger than
 that, and was back when S/360 was announced.


Until very recently, the length of the cylinder count field in a CCW was,
iirc, 12 bits; limiting the
cylinder range to max of 4096.  However, the new ESS (a.k.a SHARK) dasd
units now allow 3390 devices
to be configured with up to 32760 cylinders, yielding a DASD volume capacity
of about 26Gb. z/VM has already been
updated to recognize and support these new dasd sizes in both CMS and CP
environments.

Since the S/3XX architecture got its start when dasd devices where
considerably smaller than today's, both the MVS and VM system evolved other
ways of handling large files on small devices: MVS has had multi-volume file
support
for ages, and VM uses the SFS to allow the storage of files up to 17x10**12
bytes in size.

Dave

Dave



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread John Summerfield

[EMAIL PROTECTED] said:
  MVS never has supported any FBA devices. The problem is that the CKD
 architecture is heavily embedded deep in two critical pieces of the
 MVS core: program fetch and VTOC processing. I'm not familiar with the
 details of PDSEs for program fetch, but if load libraries are PDSes,
 they're still searched by SEARCH KEY CCWs.

Load library members have imbedded channel programs. Moving a load
library to an FBA disk might have been a challenge.

All partitioned datasets have keyed directory blocks.

VTOCs are keyed datasets (or were, I don't how the newer format
introduced with the DF products worked).

However, VSE has the same VTOC format.

--
Cheers
John Summerfield

Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

Note: mail delivered to me is deemed to be intended for me, for my
disposition.

==
If you don't like being told you're wrong,
be right!



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread Greg Smith

Jay Maynard wrote:


 The limit is that the cylinder number is a halfword, and exceeding that
 breaks a LOT of things. There are even today things you can't put on a
 3390-9 beyond cylinder 65535 (the JES2 spool dataset springs immediately to
 mind).


Minor nit.  On MVS a single extent cannot exceed 65535 *tracks* and
a 3390-9 has 10017 cylinders (150255 trks).

Theoretically, ckd architecture can support 65535 cyls, 65535 heads
(or trks/cyl), 255 blks/trk, each blk with a 255 byte key area and a
65535 byte data area (which adds up to a fairly large number).

Greg



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread John Summerfield

 Jay Maynard wrote:

 
  The limit is that the cylinder number is a halfword, and exceeding that
  breaks a LOT of things. There are even today things you can't put on a
  3390-9 beyond cylinder 65535 (the JES2 spool dataset springs immediately to
  mind).


 Minor nit.  On MVS a single extent cannot exceed 65535 *tracks* and
 a 3390-9 has 10017 cylinders (150255 trks).

 Theoretically, ckd architecture can support 65535 cyls, 65535 heads
 (or trks/cyl), 255 blks/trk, each blk with a 255 byte key area and a
 65535 byte data area (which adds up to a fairly large number).

 Greg


Not quite - the key for this purpose is included in the length of the
data block.

(65535 * 255 * 65535) is still fairly large. More than 2.3 Gbytes.

Back in my time the maximum data length supported on any device was
32k-8, but I did hear of someone reading an entire tape written (by
some metering device) as a single block.


--
Cheers
John Summerfield

Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

Note: mail delivered to me is deemed to be intended for me, for my
disposition.

==
If you don't like being told you're wrong,
be right!



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread Don Stubbs

Unfortunately we are emulating the geometry of the last generation of
ECDK devices (3390's) by creating virtual volumes within an array of
SCSI disks.

In its day the model 9 was a bulk data storage model with poor performance
characteristics.  The performance of virtual 3390 volume however is a
function of the real hardware used to build the SCSI array.  Some systems
programmers still persist in defining only 3390-3 volumes concerned over
the performance issues associated with real 3390-9's.  This results in a
larger number of volumes to manage than necessary.  Given today's
multi-terabyte
DASD farms, the number of logical volumes becomes staggering.

It is however true that I/O is queued at the device level and there may be
situations
where more emulated volumes are better.  However one can do no more
transfers than the
number of upper interfaces available (number of channel connections to the
subsystem).

In developing a capacity management system for a client last year, reporting
for DASD
services times only listed volumes whose services times exceeded 8
milliseconds.  We
have come a long way since the 1st cached controllers in the mid-80's.

3390's were state of the art disk drives 10 YEARS ago.  Even if you were
given the required 3990 controllers and some 3390 drives, it would still be
cheaper to purchase a new Shark, EMC, etc. storage subsystem due to the cost
of maintenance and the cost of power to spin them and to cool them.  That is
to
say that real 3390's are for all practical purposes no longer in use.  I
have not
been in a data center in the last 6 years that had any 3390's install.
Maybe I
have been lucky or oblivious to their presence.

Has anyone heard of any IBM plans to provide non-ECKD DASD support for zOS?
We can't go on emulating 33X0 volumes much longer.

Don Stubbs




-Original Message-
From: Linux on 390 Port [mailto:[EMAIL PROTECTED]]On Behalf Of
Peter Webb, Toronto Transit Commission
Sent: Thursday, April 18, 2002 11:07 AM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


 I'm sadly out of touch with mainframe hardware; it seems strange to me
 I can get 120 Gbyte disks for my PC and you folk are using 2.3 Gbyte
 drives on your mainframes. I know the theoretical limit is larger than
 that, and was back when S/360 was announced.


One advantage to the limited disk size is that since you can only
have one I/O active to a disk volume at one time, spreading data over many
smaller volumes allows more I/Os to be active at the same time. This can
dramatically improve system I/O throughput. IBM even warns that using
3390-9s can degrade performance, think what using a 3390-120Gigabyte would
do! In the PC world, I believe you can see the same sort of effect by using
RAID0 across multiple volumes, versus one large volume.



FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Rick Troth

I said (to John):
   S/390 does also have FBA (fixed block architecture) DASD devices.
   Sadly,  even in the Linux world these are not widely known or used.
   I maintain that they should be employed heavily and heartily!
   The benefits are numerous.

On Thu, 18 Apr 2002, Jay Maynard wrote:
 Oh? Like what?

Using FBA hardware alleviates the need for the DASD driver
to deal with C/H/S translation and work directly with blocks.
A UNIX filesystem is a structure placed into a string-of-bytes.
Where the hardware looks like a string-of-bytes,  it is (theoretically,
and I say in practice too) easier for the system to present a linear
space since the device is already linear.   Why does loop-back
mounting work?   Why is LBA preferred on PC hardware nowadays?

Note that CD can be presented as FBA *today* on some S/390.
Specifically,  for P/390 (and presumably for Multiprise) a CD image,
a .iso file,  can be configured to the S/390 as an FBA.   The support
system may (in my case does) complain about no IBM volser,  but it
works as expected.   I installed SuSE 7.0 directly from CD,  as far
as the S/390 knew.   (It was an ISO image,  but the S/390 did not know
that it was not a CD copied block-for-block onto a 3370.)
So CD could be attached to zSeries neatly if attached as FBA.

With FBA,  the effect of DDR approaches the effect of the
Linux (UNIX) command 'dd' for copying a volume.

And what will happen now with SCSI attachment to zSeries?
I can only hope that there will NOT be some CKD protocol.
It just doesn't seem worth it when FBA is what is really happening.

   Remember that, these days, most DASD is made up of huge RAID
 arrays emulating either classic FBA or CKD devices, and the emulation
 overhead of either is pretty small.

Right.
And since the actual backing store is fixed-block,
I say let that which is presented also be fixed-block and ditch the
track, record, count, and key info and the associated work.

With CKD,  Linux must play the C/H/S game.
With emulated CKD,  so must the DASD subsystem.
Why not let both ends stop faking it??

John said:
  Back when I was a sysprog we used VS1, and that had no support for FBA
  devices (I think the 3370 was supported on MVS back then).

then Jay said:
 MVS never has supported any FBA devices. The problem is that the CKD
 architecture is heavily embedded deep in two critical pieces of the MVS
 core: program fetch and VTOC processing. I'm not familiar with the details
 of PDSEs for program fetch, but if load libraries are PDSes, they're still
 searched by SEARCH KEY CCWs.

But VSE and VM both work with FBA DASD.
I'm not saying that we should endorse FBA to the demise of MVS.
I am only saying that we should endorse FBA to the benefit of
Linux, VM, and VSE.   And with modern DASD subsystems,
it should be no great pain to present either flavor as needed.
Let MVS have its CKD.   But let the rest have FBA when they want.



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread John Summerfield

[EMAIL PROTECTED] said:
 Right. And since the actual backing store is fixed-block, I say let
 that which is presented also be fixed-block and ditch the track,
 record, count, and key info and the associated work.

 With CKD,  Linux must play the C/H/S game. With emulated CKD,  so must
 the DASD subsystem. Why not let both ends stop faking it??


VSAM, Partitioned Datasets and VTOCs for starters all depend on keyed
records. How well do these perform on VSE on FBA devices?

With the emulation the stuffing around needed is done off the host CPU
- I don't care a lot whether it's the channel or controller or the
device itself. I presume that for the FBA devices to be supported
directly then it would be done by the host CPU and people tell me it's
not that strong.

Of course, Linux would get along just fine with FBA devices, so the
option to attach sharks etc natively would clearly be of use.


--
Cheers
John Summerfield

Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

Note: mail delivered to me is deemed to be intended for me, for my
disposition.

==
If you don't like being told you're wrong,
be right!



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Adam Thornton

 Note that CD can be presented as FBA *today* on some S/390.
 Specifically,  for P/390 (and presumably for Multiprise) a CD image,
 a .iso file,  can be configured to the S/390 as an FBA.

Yup.  Works on a Multiprise too, as Dave Jones can attest.

Adam



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Jay Maynard

On Thu, Apr 18, 2002 at 12:44:13PM -0500, Adam Thornton wrote:
  Note that CD can be presented as FBA *today* on some S/390.
  Specifically,  for P/390 (and presumably for Multiprise) a CD image,
  a .iso file,  can be configured to the S/390 as an FBA.
 Yup.  Works on a Multiprise too, as Dave Jones can attest.

And, for that matter, on Hercules.

(Which is one reason I want .iso files to install Linux/390 from...it can't
be any slower than an FTP install over a Hercules CTC.)



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Jay Maynard

On Thu, Apr 18, 2002 at 10:44:39AM -0500, Rick Troth wrote:
 And what will happen now with SCSI attachment to zSeries?
 I can only hope that there will NOT be some CKD protocol.
 It just doesn't seem worth it when FBA is what is really happening.

Probably so, at least for VM, VSE, and Linux.

 With CKD,  Linux must play the C/H/S game.
 With emulated CKD,  so must the DASD subsystem.
 Why not let both ends stop faking it??

Mainframers - at least MVS types - aren't used to thinking that way. A sile
as a stream of bytes is completely alien to them.

 But VSE and VM both work with FBA DASD.

VM has always used a fixed-block structured filesystem internally anyway, so
it was just a matter of changing block sizes. I can't speak to VSE, never
having dealt with it.

 I'm not saying that we should endorse FBA to the demise of MVS.
 I am only saying that we should endorse FBA to the benefit of
 Linux, VM, and VSE.   And with modern DASD subsystems,
 it should be no great pain to present either flavor as needed.
 Let MVS have its CKD.   But let the rest have FBA when they want.

I believe that's the case now.

There's one benefit for Hercules users of using CKD instead of FBA:
compressed DASD images. Compressed CKD is a big win. Unfortunately, there's
no compressed FBA support.



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread John Campbell

  There were gapless tapes generated by seismo trucks, used
  for recording data from the geophones, normally seen as data
  input for 3DFFTs.  I last dealt with these 20+ years ago working
  w/ oil exploration stuff.  At the time triple-buffering and
multiactivity
  (multithreading) was de rigeur.

  The tape density wasn't incredibly high but it was a continuous
  stream that you couldn't afford to drop since that'd require re-
  starting the process.


John R. Campbell, Speaker to Machines (GNUrd)  {813-356|697}-5322
Will Work for CLAIM Codes
IBM Certified: IBM AIX 4.3 System Administration, System Support



John Summerfield [EMAIL PROTECTED]@VM.MARIST.EDU on 04/18/2002
12:52:03 PM

Please respond to Linux on 390 Port [EMAIL PROTECTED]

Sent by:Linux on 390 Port [EMAIL PROTECTED]


To:[EMAIL PROTECTED]
cc:
Subject:Re: How to pre-allocate a 4GB File?



 Jay Maynard wrote:

 
  The limit is that the cylinder number is a halfword, and exceeding that
  breaks a LOT of things. There are even today things you can't put on a
  3390-9 beyond cylinder 65535 (the JES2 spool dataset springs
immediately to
  mind).


 Minor nit.  On MVS a single extent cannot exceed 65535 *tracks* and
 a 3390-9 has 10017 cylinders (150255 trks).

 Theoretically, ckd architecture can support 65535 cyls, 65535 heads
 (or trks/cyl), 255 blks/trk, each blk with a 255 byte key area and a
 65535 byte data area (which adds up to a fairly large number).

 Greg


Not quite - the key for this purpose is included in the length of the
data block.

(65535 * 255 * 65535) is still fairly large. More than 2.3 Gbytes.

Back in my time the maximum data length supported on any device was
32k-8, but I did hear of someone reading an entire tape written (by
some metering device) as a single block.


--
Cheers
John Summerfield

Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

Note: mail delivered to me is deemed to be intended for me, for my
disposition.

==
If you don't like being told you're wrong,
be right!



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Ward, Garry

VSE used the FBA devices, 3310  3370s, in the 80s.

As of VSE 2.4, 3310s are not listed as supported, and 3370s are listed as
data volumes only, not for systems or installation use.

There is a 9336 listed under FBA that appearently can still be used as a
system or installation device, but I'm not familliar with it.

Direct Access files are not support on any FBA device under VSE, which can
make life difficult for some database software, like ADABAS

Garry E. Ward
Senior Software Specialist
Maritz Research
Automotive Research Group
419-725-4123



-Original Message-
From: Jay Maynard [mailto:[EMAIL PROTECTED]]
Sent: Thursday, April 18, 2002 2:10 PM
To: [EMAIL PROTECTED]
Subject: Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]


On Thu, Apr 18, 2002 at 10:44:39AM -0500, Rick Troth wrote:
 And what will happen now with SCSI attachment to zSeries?
 I can only hope that there will NOT be some CKD protocol.
 It just doesn't seem worth it when FBA is what is really happening.

Probably so, at least for VM, VSE, and Linux.

 With CKD,  Linux must play the C/H/S game.
 With emulated CKD,  so must the DASD subsystem.
 Why not let both ends stop faking it??

Mainframers - at least MVS types - aren't used to thinking that way. A sile
as a stream of bytes is completely alien to them.

 But VSE and VM both work with FBA DASD.

VM has always used a fixed-block structured filesystem internally anyway, so
it was just a matter of changing block sizes. I can't speak to VSE, never
having dealt with it.

 I'm not saying that we should endorse FBA to the demise of MVS.
 I am only saying that we should endorse FBA to the benefit of
 Linux, VM, and VSE.   And with modern DASD subsystems,
 it should be no great pain to present either flavor as needed.
 Let MVS have its CKD.   But let the rest have FBA when they want.

I believe that's the case now.

There's one benefit for Hercules users of using CKD instead of FBA:
compressed DASD images. Compressed CKD is a big win. Unfortunately, there's
no compressed FBA support.



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread Greg Smith

John Summerfield wrote:


 Not quite - the key for this purpose is included in the length of the
 data block.

 (65535 * 255 * 65535) is still fairly large. More than 2.3 Gbytes.



Don't think so. CKD stands for count,key,data.  Each record on a track
has a count area, optional key area and optional data area.
The format of an 8-byte count area is CCHHRKDD
CC is a 16 bit cylinder number, HH is a 16 bit head number, R is a 8
bit record number, K is a 8 bit key length and DD is a 16 bit data
length.  The data length does not include the key length.

And 65535*65535*255*(255+65535) is a little larger than 2.3G.
In fact, a 3390-3, which has limits well below these theoretical
maximums, is about 2.3G in size.

Of course, the theoritical maximum does break down in a number of
areas. To do anything useful, record 0 must be `standard' (ie no
key and an 8 byte data area).  The device characteristics information
has only a three byte field for track capacity.  And I know for a
fact that Hercules would break if the max track size exceeds 64K ;-)

Greg



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Florian La Roche

On Thu, Apr 18, 2002 at 01:04:28PM -0500, Jay Maynard wrote:
 On Thu, Apr 18, 2002 at 12:44:13PM -0500, Adam Thornton wrote:
   Note that CD can be presented as FBA *today* on some S/390.
   Specifically,  for P/390 (and presumably for Multiprise) a CD image,
   a .iso file,  can be configured to the S/390 as an FBA.
  Yup.  Works on a Multiprise too, as Dave Jones can attest.

 And, for that matter, on Hercules.

 (Which is one reason I want .iso files to install Linux/390 from...it can't
 be any slower than an FTP install over a Hercules CTC.)

Jay Maynard,

if the author of hercules wants to have this, I'll reconsider this for
the next rawhide upload. :-)

At least our 64bit version already has iso images available, so you
might already test with those if you have enough RAM/CPU available.

cu,

Florian La Roche



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Jay Maynard

On Thu, Apr 18, 2002 at 08:27:35PM +0200, Florian La Roche wrote:
 if the author of hercules wants to have this, I'll reconsider this for
 the next rawhide upload. :-)

That would be nice. Thanks!

I must point out, though, that I'm not really the author of Hercules; I'm
just the guy who gets to build formal production releases and host the web
site and talk about it in public. A lot of other folks have done a lot of
work on the package, many of them contributors here.

 At least our 64bit version already has iso images available, so you
 might already test with those if you have enough RAM/CPU available.

Oh, okkay...didn't know that. I just started a download. Having 30 GB on my
laptop has its uses.



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Ward, Garry

For VSAM it isn't that bad; and Relative Byte Address is a Relative Byte
Address, on FBA it's a little easier becasue you just map from the first
byte on the pack. VTOC's used the relative record approach instead of an
CCHHRR.

Garry E. Ward
Senior Software Specialist
Maritz Research
Automotive Research Group
419-725-4123



-Original Message-
From: John Summerfield [mailto:[EMAIL PROTECTED]]
Sent: Thursday, April 18, 2002 1:36 PM
To: [EMAIL PROTECTED]
Subject: Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]


[EMAIL PROTECTED] said:
 Right. And since the actual backing store is fixed-block, I say let
 that which is presented also be fixed-block and ditch the track,
 record, count, and key info and the associated work.

 With CKD,  Linux must play the C/H/S game. With emulated CKD,  so must
 the DASD subsystem. Why not let both ends stop faking it??


VSAM, Partitioned Datasets and VTOCs for starters all depend on keyed
records. How well do these perform on VSE on FBA devices?

With the emulation the stuffing around needed is done off the host CPU
- I don't care a lot whether it's the channel or controller or the
device itself. I presume that for the FBA devices to be supported
directly then it would be done by the host CPU and people tell me it's
not that strong.

Of course, Linux would get along just fine with FBA devices, so the
option to attach sharks etc natively would clearly be of use.


--
Cheers
John Summerfield

Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

Note: mail delivered to me is deemed to be intended for me, for my
disposition.

==
If you don't like being told you're wrong,
be right!


font size=1Confidentiality Warning:  This e-mail contains information intended 
only for the use of the individual or entity named above.  If the reader of this 
e-mail is not the intended recipient or the employee or agent responsible for 
delivering it to the intended recipient, any dissemination, publication or copying of 
this e-mail is strictly prohibited. The sender does not accept any responsibility for 
any loss, disruption or damage to your data or computer system that may occur while 
using data contained in, or transmitted with, this e-mail.   If you have received this 
e-mail in error, please immediately notify us by return e-mail.  Thank you.



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Dave Jones

 -Original Message-
 From: Linux on 390 Port [mailto:[EMAIL PROTECTED]]On Behalf Of
 Adam Thornton
 Sent: Thursday, April 18, 2002 10:44 AM
 To: [EMAIL PROTECTED]
 Subject: Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]


  Note that CD can be presented as FBA *today* on some S/390.
  Specifically,  for P/390 (and presumably for Multiprise) a CD image,
  a .iso file,  can be configured to the S/390 as an FBA.

 Yup.  Works on a Multiprise too, as Dave Jones can attest.

Works very well, indeed. Hard part was figuring out how to make an .iso
image from the CD, but once that was
done, it was a piece of cake.

DJ
 Adam




Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Jay Maynard

On Thu, Apr 18, 2002 at 11:17:45PM +0200, Phil Payne wrote:
  Mainframers - at least MVS types - aren't used to thinking that way. A sile
  as a stream of bytes is completely alien to them.
 System types, or application types?  We've had RBA since VSAM I - lots of things 
like DB2 logs
 are RBA-governed.

Systems types that I know of, certainly. They tend to think of files in
terms of records, not as a stream of bytes. VSAM ESDSs and the like are
definitely in the minority.

I can't speak to applications (or, for that matter, IMS and DB2 DBA) folks.



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Phil Payne

 Mainframers - at least MVS types - aren't used to thinking that way. A sile
 as a stream of bytes is completely alien to them.

System types, or application types?  We've had RBA since VSAM I - lots of things like 
DB2 logs
are RBA-governed.

--
  Phil Payne
  http://www.isham-research.com
  +44 7785 302 803
  +49 173 6242039



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Alan Altmark

On Thursday, 04/18/2002 at 10:44 EST, Rick Troth [EMAIL PROTECTED] wrote:

 And what will happen now with SCSI attachment to zSeries?
 I can only hope that there will NOT be some CKD protocol.
 It just doesn't seem worth it when FBA is what is really happening.

As hard as it might be to believe, zSeries operating systems will talk
SCSI over Fibre Channel Protocol adapters to SCSI devices.

Alan Altmark
Sr. Software Engineer
IBM z/VM Development



Re: FBA for Jay [was: Re: How to pre-allocate a 4GB File?]

2002-04-18 Thread Alan Cox

 Really? As in talking to existing Fiber Channel[1] disk arrays that speak
 FC-SCSI? and/or via FC-SCSI bridges to random SCSI devices? Where can I find
 out more? I used to work on FC-attached storage array systems at Compaq...

Has anyone tried iSCSI with S/390 ?



Re: How to pre-allocate a 4GB File?

2002-04-18 Thread John Summerfield

 John Summerfield wrote:

 
  Not quite - the key for this purpose is included in the length of the
  data block.
 
  (65535 * 255 * 65535) is still fairly large. More than 2.3 Gbytes.
 


 Don't think so. CKD stands for count,key,data.  Each record on a track
 has a count area, optional key area and optional data area.
 The format of an 8-byte count area is CCHHRKDD
 CC is a 16 bit cylinder number, HH is a 16 bit head number, R is a 8
 bit record number, K is a 8 bit key length and DD is a 16 bit data
 length.  The data length does not include the key length.

The data length in the channel program is the total length of the data
transfer.

Back when, you could get round it in excp, but I don't think other
access methods such as BDAN and BSAM would hand it.




--
Cheers
John Summerfield

Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

Note: mail delivered to me is deemed to be intended for me, for my
disposition.

==
If you don't like being told you're wrong,
be right!



Re: How to pre-allocate a 4GB File?

2002-04-17 Thread Sergey Korzhevsky

17.04.2002 01:16:12 Rengasamy, Samy  wrote:

How to pre-allocate a 4GB File in a system with several 2.3 GB dasds?

We're looking for a way to be able to create a single file slightly
larger than 4Gbytes (to test some logic in the code which has been
known to break on ports where seek offsets go over 32-bits).

Or is the largest file we can ever make around 2.3Gbytes ?

You can create Software RAID-0.


WBR, Sergey



Re: How to pre-allocate a 4GB File?

2002-04-17 Thread John Summerfield

[EMAIL PROTECTED] said:
  The Linux LVM allows you to build a larger filesystem using several
 dasds - but if you use the ext2-filesystem the maximum filesize will -
 afaik - only be 2GB.

Twaddle.

[summer@numbat summer]$ ll /tmp/hdb5 -h
-rw-r-1 root 8.0G Feb  1 18:27 /tmp/hdb5
[summer@numbat summer]$


Or can I do better on a PC than you can on a mainframe?


You do need a 2.4 kernel. I'm running RHL 7.2.


--
Cheers
John Summerfield

Microsoft's most solid OS: http://www.geocities.com/rcwoolley/

Note: mail delivered to me is deemed to be intended for me, for my
disposition.

==
If you don't like being told you're wrong,
be right!



Re: How to pre-allocate a 4GB File?

2002-04-17 Thread Rengasamy, Samy

Do I have to upgrade to 2.4 kernel to run LVM?

How can I build software RAID-O?

Thanks,

Samy Rengasamy.

-Original Message-
From: Post, Mark K [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 16, 2002 10:20 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Samy,

You'll need to be running a 2.4 kernel, and either LVM, or RAID to aggregate
multiple 3390 volumes, or have some 3390-9 volumes available.

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 16, 2002 6:16 PM
To: [EMAIL PROTECTED]
Subject: How to pre-allocate a 4GB File?


How to pre-allocate a 4GB File in a system with several 2.3 GB dasds?

We're looking for a way to be able to create a single file slightly
larger than 4Gbytes (to test some logic in the code which has been
known to break on ports where seek offsets go over 32-bits).

Or is the largest file we can ever make around 2.3Gbytes ?

Thanks,

Samy Rengasamy.



Re: How to pre-allocate a 4GB File?

2002-04-17 Thread Post, Mark K

Samy,

SuSE 7.0 has LVM support built into it.  Red Hat 7.2 does not.  For RAID
support, take a look at http://www.marist.edu/htbin/wlvtype?LINUX-VM.22398
and http://www.linuxdoc.org/HOWTO/Software-RAID-HOWTO.html

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Wednesday, April 17, 2002 1:28 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Do I have to upgrade to 2.4 kernel to run LVM?

How can I build software RAID-O?

Thanks,

Samy Rengasamy.

-Original Message-
From: Post, Mark K [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 16, 2002 10:20 PM
To: [EMAIL PROTECTED]
Subject: Re: How to pre-allocate a 4GB File?


Samy,

You'll need to be running a 2.4 kernel, and either LVM, or RAID to aggregate
multiple 3390 volumes, or have some 3390-9 volumes available.

Mark Post

-Original Message-
From: Rengasamy, Samy [mailto:[EMAIL PROTECTED]]
Sent: Tuesday, April 16, 2002 6:16 PM
To: [EMAIL PROTECTED]
Subject: How to pre-allocate a 4GB File?


How to pre-allocate a 4GB File in a system with several 2.3 GB dasds?

We're looking for a way to be able to create a single file slightly
larger than 4Gbytes (to test some logic in the code which has been
known to break on ports where seek offsets go over 32-bits).

Or is the largest file we can ever make around 2.3Gbytes ?

Thanks,

Samy Rengasamy.



Re: How to pre-allocate a 4GB File?

2002-04-17 Thread Eddie Chen

Does anyone knows  the max size of  ORACLE database and table on the 32bits
Linux machine... INTEL or Z/VM running  on G5 machine.



Re: How to pre-allocate a 4GB File?

2002-04-17 Thread Michael MacIsaac

 How can I build software RAID-O?

# cd /dev
# mknod md0 b 9 0
...
# cat /etc/raidtab
raiddev   /dev/md0
raid-level  0
nr-raid-disks   4
persistent-superblock   1
chunk-size  128
device  /dev/dasdf1
raid-disk   0
device  /dev/dasdg1
raid-disk   1
device  /dev/dasdh1
raid-disk   2
device  /dev/dasdi1
raid-disk   3
# mkraid /dev/md0
# mkreiserfs /dev/md0  // or mke2fs
# mkdir /swRAID0
# mount /dev/md0 /swRAID0
# df -h | grep md0
/dev/md0  9.2G   53M  9.1G   1% /s

  -Mike MacIsaac,  IBM   [EMAIL PROTECTED]   (845) 433-7061



Re: How to pre-allocate a 4GB File?

2002-04-17 Thread Rich Smrcina

I am going to guess that Oracle has theoretical and practical database size
limitations.  I would not expect that those limitations would change.  All
tempered by the size limitations of your chosen filesystem.  As mentioned
here before, LVM can be used to cobble together many 3390-3 (2.3GB) or -9
(7GB) devices for the use on large filesystems.  I intend to do this for a
DB2 project (hopefully) later this spring/summer.

On Wednesday 17 April 2002 01:00 pm, you wrote:
 Does anyone knows  the max size of  ORACLE database and table on the 32bits
 Linux machine... INTEL or Z/VM running  on G5 machine.

--
Rich Smrcina
Sytek Services, Inc.
Milwaukee, WI
[EMAIL PROTECTED]
[EMAIL PROTECTED]

Catch the WAVV!  Stay for Requirements and the Free for All!
Update your S/390 skills in 4 days for a very reasonable price.
WAVV 2003 in Winston-Salem, NC.
April 25-29, 2003
For details see http://www.wavv.org



Re: How to pre-allocate a 4GB File?

2002-04-17 Thread Alan Cox

 Do I have to upgrade to 2.4 kernel to run LVM?
 How can I build software RAID-O?

Well you could always cheat. Unix/Linux are bright enough not to store
empty never written blocks, so you can open64/ftruncate a file up to 4Gb
long and it uses very little disk space, then just play with the points
you need to check



Re: How to pre-allocate a 4GB File?

2002-04-16 Thread Robert Werner

Hi Samy !


 How to pre-allocate a 4GB File in a system with several 2.3 GB dasds?

 We're looking for a way to be able to create a single file slightly
 larger than 4Gbytes (to test some logic in the code which has been
 known to break on ports where seek offsets go over 32-bits).

 Or is the largest file we can ever make around 2.3Gbytes ?


The Linux LVM allows you to build a larger filesystem using several dasds -
but if you use the ext2-filesystem the maximum filesize will - afaik - only
be 2GB.

robert.



Re: How to pre-allocate a 4GB File?

2002-04-16 Thread Alan Cox

  We're looking for a way to be able to create a single file slightly
  larger than 4Gbytes (to test some logic in the code which has been
  known to break on ports where seek offsets go over 32-bits).
 
  Or is the largest file we can ever make around 2.3Gbytes ?
 

 The Linux LVM allows you to build a larger filesystem using several dasds -
 but if you use the ext2-filesystem the maximum filesize will - afaik - only
 be 2GB.

The 2.4 kernel and glibc 2.2 support 64bit file sizes. The actual limit then
is about 1Tb.

Alan