MVSFORUMS.com Forum Index MVSFORUMS.com
A Community of and for MVS Professionals
 
 FAQFAQ   SearchSearch   Quick Manuals   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

Flat file size

 
Post new topic   Reply to topic   printer-friendly view    MVSFORUMS.com Forum Index -> Job Control Language(JCL)
View previous topic :: View next topic  
Author Message
maverick05
Beginner


Joined: 15 May 2005
Posts: 72
Topics: 24

PostPosted: Sun Jul 29, 2012 7:05 pm    Post subject: Flat file size Reply with quote

Hi,
I have unloaded a DB2 table with many variable columns into a flat file.
I believe the max size of the data in flat file can be found by multiplying total records and max logical record length.Any idea how to calculate the exact size of a flat file ?
Back to top
View user's profile Send private message
papadi
Advanced


Joined: 20 Oct 2009
Posts: 520
Topics: 1

PostPosted: Sun Jul 29, 2012 9:24 pm    Post subject: Reply with quote

There is no need to "calculate" the size. Once created it is fixed/known.

Using tso/ispf 3.4, look at the "info" for the file.

You might also look into using LISTDSI.

Once you get the "exact size" how will this be used?
_________________
All the best,

di
Back to top
View user's profile Send private message
Nic Clouston
Advanced


Joined: 01 Feb 2007
Posts: 916
Topics: 6
Location: Dublin 2

PostPosted: Mon Jul 30, 2012 12:19 am    Post subject: Reply with quote

I do not know about this but perhaps your unload job provide some statistics inclding bytes unloaded?
_________________
JCL is a means by which the programmer makes known to the computer the resources required by the program to be executed and certain characteristics of these resources.
Back to top
View user's profile Send private message
maverick05
Beginner


Joined: 15 May 2005
Posts: 72
Topics: 24

PostPosted: Mon Jul 30, 2012 7:14 am    Post subject: Reply with quote

papadi wrote:
There is no need to "calculate" the size. Once created it is fixed/known.

Using tso/ispf 3.4, look at the "info" for the file.

You might also look into using LISTDSI.

Once you get the "exact size" how will this be used?


I checked but the information is not accurate
Back to top
View user's profile Send private message
papadi
Advanced


Joined: 20 Oct 2009
Posts: 520
Topics: 1

PostPosted: Mon Jul 30, 2012 10:07 am    Post subject: Reply with quote

Quote:

I checked but the information is not accurate
This is like posting "it didn't work" - which is a complete waste of time. . .

You need to post what the system showed and what you believe should have been the size. And why you believe this.
_________________
All the best,

di
Back to top
View user's profile Send private message
kolusu
Site Admin
Site Admin


Joined: 26 Nov 2002
Posts: 11184
Topics: 70
Location: San Jose

PostPosted: Mon Jul 30, 2012 10:50 am    Post subject: Re: Flat file size Reply with quote

maverick05 wrote:
Hi,
I have unloaded a DB2 table with many variable columns into a flat file.
I believe the max size of the data in flat file can be found by multiplying total records and max logical record length.Any idea how to calculate the exact size of a flat file ?


Size as in GB/MB? Check this link which might help

http://www.mvsforums.com/helpboards/viewtopic.php?t=28
_________________
Kolusu - DFSORT Development Team (IBM)
DFSORT is on the Web at:
www.ibm.com/storage/dfsort
Back to top
View user's profile Send private message Send e-mail Visit poster's website
taltyman
JCL Forum Moderator
JCL Forum Moderator


Joined: 02 Dec 2002
Posts: 310
Topics: 8
Location: Texas

PostPosted: Thu Aug 02, 2012 7:53 am    Post subject: Reply with quote

I'm guessing here since you aren't posting enough information but...

this is a variable record length flat file format

you take the longest record length and multiply it by the number of records to come up with your max size statement

now you want to really know the exact size as determined by bytes or whatever actually used, not how much space it actually needed as reported by 3.4 and then line option I?

In over 30 years of mainframe experience I've never seen a need for this kind of information. Tell us what you are trying to accomplish
Back to top
View user's profile Send private message
maverick05
Beginner


Joined: 15 May 2005
Posts: 72
Topics: 24

PostPosted: Wed Aug 08, 2012 3:35 pm    Post subject: Re: Flat file size Reply with quote

kolusu wrote:
maverick05 wrote:
Hi,
I have unloaded a DB2 table with many variable columns into a flat file.
I believe the max size of the data in flat file can be found by multiplying total records and max logical record length.Any idea how to calculate the exact size of a flat file ?


Size as in GB/MB? Check this link which might help

http://www.mvsforums.com/helpboards/viewtopic.php?t=28


Yes.Size as in GB/MB. Thanks Kolusu for the link.

In the above link in your last posting, you said

"blocksize of 27,920 is efficient when compared to blocksize of 32720.

so to accomadate 600,634 records you would need (600634/6135) = 97.90 rounded to 98 cylinders

so to accomadate 600,634 records you would need
(600634/10470) = 57.367 rounded to 58 cylinders
"

So can I say that the file size for the file with the blocksize of 27,920 is (98*15*55996 bytes = 82.3 MB) and file size for the file with the blocksize of 32,720 is (58*15*55996 bytes = 48.7 MB) ?

So which means the file size varies from file to file for the same number of records with same data and logical record length.Please correct me if I'm wrong.

For our requirement, we have to FTP files from one mainframe to another mainframe,so we need to provide the file size of the flat files so that we can have a guess on how big the data is getting migrated. So I wanted to know the file size.
Back to top
View user's profile Send private message
William Collins
Beginner


Joined: 03 Jun 2012
Posts: 123
Topics: 0

PostPosted: Wed Aug 08, 2012 5:37 pm    Post subject: Reply with quote

With the 32K blocksize, you will have a lot of empty space on each track. So your file will occupy more tracks, more cylinders. Your file will be "bigger" in terms of cylinders, but will contain the same amount of data.

With the optimal blocksize, the file will be considerably smaller, in terms of using fewer cylinders.
Back to top
View user's profile Send private message
maverick05
Beginner


Joined: 15 May 2005
Posts: 72
Topics: 24

PostPosted: Thu Aug 09, 2012 10:12 pm    Post subject: Reply with quote

William Collins wrote:
With the 32K blocksize, you will have a lot of empty space on each track. So your file will occupy more tracks, more cylinders. Your file will be "bigger" in terms of cylinders, but will contain the same amount of data.

With the optimal blocksize, the file will be considerably smaller, in terms of using fewer cylinders.


I understand that.My question is in terms of total size in GB, does it vary between the two files?
Back to top
View user's profile Send private message
papadi
Advanced


Joined: 20 Oct 2009
Posts: 520
Topics: 1

PostPosted: Fri Aug 10, 2012 10:27 am    Post subject: Reply with quote

No. Space allocated will differ but the bytes of user data will remain the same.
_________________
All the best,

di
Back to top
View user's profile Send private message
maverick05
Beginner


Joined: 15 May 2005
Posts: 72
Topics: 24

PostPosted: Fri Aug 10, 2012 2:41 pm    Post subject: Reply with quote

papadi wrote:
No. Space allocated will differ but the bytes of user data will remain the same.


yes.You are confirmed.I confirmed this by FTPing both the files with different block sizes and both of these files have the same size on Windows.
Back to top
View user's profile Send private message
Nic Clouston
Advanced


Joined: 01 Feb 2007
Posts: 916
Topics: 6
Location: Dublin 2

PostPosted: Mon Aug 13, 2012 10:44 pm    Post subject: Reply with quote

I do not understand why you would think that you would have more data just because the data set size is different because of different block-sizes! Di you think that you would get some free data?
_________________
JCL is a means by which the programmer makes known to the computer the resources required by the program to be executed and certain characteristics of these resources.
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic   printer-friendly view    MVSFORUMS.com Forum Index -> Job Control Language(JCL) All times are GMT - 5 Hours
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


MVSFORUMS
Powered by phpBB © 2001, 2005 phpBB Group