MVSFORUMS.com :: View topic - Joinkeys to remove records from VSAM

MVSFORUMS.com
A Community of and for MVS Professionals

FAQ

Quick Manuals

Profile

Joinkeys to remove records from VSAM
Goto page Previous 1, 2

MVSFORUMS.com Forum Index -> Utilities

View previous topic :: View next topic

Author

Message

Magesh_J
Intermediate

Joined: 21 Jun 2014
Posts: 259
Topics: 54

Posted: Wed Nov 26, 2014 9:54 am Post subject:

Kolusu,

After adding DFSPARM, Job could complete it in 947 CPU seconds.
But still we have a Performance degraded message.

The reason for L(12) is because of duplicates records in File2,
handled with following condition.

Code:

OMIT COND=(7,5,ZD,EQ,0).

If we add avg record length and approximate file size, will the performance be improved ?

Code:

ICE253I 0 RECORDS SORTED - PROCESSED: 81548112, EXPECTED: 48476192
ICE258I 0 DFSORT COULD NOT DYNAMICALLY ALLOCATE THE OPTIMAL WORK DATA SET SPACE

Issue fixed.

Code:

1ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE
ICE000I 1 - CONTROL STATEMENTS FOR XXXX-A01, Z/OS DFSORT V1R10 - 02:27 ON WED NOV 26, 2014 -
0 OPTION RESET,MAINSIZE=6M
ICE140I 0 END OF PARAMETERS FROM DFSPARM - SYSIN OR SORTCNTL/PARAMETER LIST CONTROL STATEMENTS FOLLOW
OPTION DYNALLOC=(,16)
JOINKEYS FILE=F1,FIELDS=(6,11,A),TYPE=V
JOINKEYS FILE=F2,FIELDS=(1,11,A),TYPE=F
REFORMAT FIELDS=(F1:1,4,?,F1:5)
JOIN UNPAIRED,F1
SORT FIELDS=(6,27,CH,A)
OUTFIL BUILD(1,4,6),
OMIT(6,1,SS,EQ,C'E,F,G,H,I,J,0,3,5',AND,
5,1,CH,EQ,C'1')

OUTFIL FNAMES=OUT2,
BUILD(1,4,6),
INCLUDE((5,1,CH,EQ,C'1',AND,
35,5,CH,NE,C'TUMMY',AND,
6,1,CH,EQ,C'0'),
OR,
(6,1,SS,EQ,C'E,F,G,H,I,J,0,3,5',AND,
5,1,CH,EQ,C'1'))
OUTFIL INCLUDE((5,1,CH,EQ,C'1',AND,
35,5,CH,NE,C'TUMMY',AND,
6,1,CH,EQ,C'0'),
OR,
(6,1,SS,EQ,C'E,F,G,H,I,J,0,3,5',AND,
5,1,CH,EQ,C'1')),
FNAMES=TEMP1,HEADER1=('TEST FILE CLEANUP'),

SECTIONS=(6,1,
TRAILER3=(5:C'RECORD TYPE ',
6,1,
C' DELETED ',
COUNT=(EDIT=(III,III,III)))),
TRAILER1=(/,
03:'TOTAL NUMBER OF RECORDS DELETED : ',
COUNT=(EDIT=(III,III,III))),NODETAIL,
BUILD=(80X),VTOF
OUTFIL FNAMES=REST,SAVE,BUILD=(1,4,6)
ICE411I 0 THIS IS THE JOINKEYS MAIN TASK FOR JOINING F1 AND F2
ICE416I 0 JOINKEYS IS USING THE F1 SUBTASK FOR SORTJNF1 - SEE JNF1JMSG MESSAGES
ICE416I 1 JOINKEYS IS USING THE F2 SUBTASK FOR SORTJNF2 - SEE JNF2JMSG MESSAGES
ICE419I 0 JOINED RECORDS: TYPE=V, LENGTH=617
ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
ICE751I 0 C5-K90025 C6-K90025 C7-K54603 C8-K62201 E4-K51707 C9-BASE E5-K62201 E6-K51707 B0-K62201 C4-K62201 E7-K62201
ICE193I 0 ICEAM1 INVOCATION ENVIRONMENT IN EFFECT - ICEAM1 ENVIRONMENT SELECTED
ICE089I 0 JOINKEYS.S2 . , INPUT LRECL = 617, TYPE = V
ICE092I 0 MAIN STORAGE = (6291456,6291456,6291456)
ICE156I 0 MAIN STORAGE ABOVE 16MB = (6234096,6234096)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
ICE128I 0 OPTIONS: SIZE=6291456,MAXLIM=2097152,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 ,MSGDDN=SYSOUT
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,016),ABCODE=MSG
ICE130I 0 OPTIONS: RESALL=0,RESINV=0,SVC=109 ,CHECK=Y,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=65536,CINV=Y,CFW=Y,DSA=0
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=2097152,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=MAX
1ICE235I 0 OPTIONS: NULLOUT=RC0
ICE750I 0 DC 0 TC 0 CS DSVXX KSZ 31 VSZ 31
ICE752I 0 FSZ=50928402 RE IGN=0 C AVG=311 311 WSP=20571792 E DYN=371775 56664
ICE247I 0 INTERMEDIATE MERGE ENTERED - PERFORMANCE MAY BE DEGRADED
ICE231I 0 STORAGE USED FOR OUTFIL : BELOW 16M = 47104, ABOVE 16M = 2193408
ICE210I 0 SORTOUT : VSAM USED, LRECL = 616, BLKSIZE = 22528, TYPE = V
ICE210I 0 OUT2 : VSAM USED, LRECL = 616, BLKSIZE = 22528, TYPE = V
ICE210I 0 TEMP1 : BSAM USED, LRECL = 81, BLKSIZE = 81, TYPE = FBA
ICE210I 0 REST : EXCP USED, LRECL = 616, BLKSIZE = 27998, TYPE = VB (SDB)
ICE751I 1 D8-BASE D4-K59451 EA-K57947 E1-BASE DF-BASE C4-K62201 EA-K57947 CB-K64631 F1-K38900 E8-K61438
ICE421I 0 JOINED RECORDS: COUNT=81548112
ICE096I 0 SUCCESSFUL RECOVERY FROM B37 ABEND(S) FOR WORK DATA SET(S)
ICE055I 0 INSERT 81548112, DELETE 0
ICE054I 0 RECORDS - IN: 0, OUT: 81548112
ICE227I 0 SORTOUT : DELETED = 2699407, REPORT = 0, DATA = 78848705
ICE228I 0 SORTOUT : TOTAL IN = 81548112, TOTAL OUT = 78848705
ICE227I 0 OUT2 : DELETED = 78848705, REPORT = 0, DATA = 2699407
ICE228I 0 OUT2 : TOTAL IN = 81548112, TOTAL OUT = 2699407
ICE227I 0 TEMP1 : DELETED = 81548112, REPORT = 12, DATA = 0
ICE228I 0 TEMP1 : TOTAL IN = 81548112, TOTAL OUT = 12
ICE227I 0 REST : DELETED = 81548112, REPORT = 0, DATA = 0
ICE228I 0 REST : TOTAL IN = 81548112, TOTAL OUT = 0
ICE174I 0 NO DATA RECORDS FOR AN OUTFIL DATA SET - RC=0
ICE134I 0 NUMBER OF BYTES SORTED: 15338407996
ICE253I 0 RECORDS SORTED - PROCESSED: 81548112, EXPECTED: 50928402
ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 188, EXPECTED: 311
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 588825 , TRACKS USED: 588330
ICE199I 0 MEMORY OBJECT STORAGE USED = 0M BYTES
ICE180I 0 HIPERSPACE STORAGE USED = 0K BYTES
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
ICE052I 0 END OF DFSORT

Code:

1ICE417I 0 THIS IS THE JOINKEYS F1 SUBTASK FOR SORTJNF1
ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE
ICE000I 0 - CONTROL STATEMENTS FOR XXXX-A01, Z/OS DFSORT V1R10 - 02:27 ON WED NOV 26, 2014 -
0 OPTION DYNALLOC=(,16)
INREC OVERLAY=(12:12,5,ZD,EDIT=(TTTTT))
ICE146I 0 END OF STATEMENTS FROM JNF1CNTL - PARAMETER LIST STATEMENTS FOLLOW
SORT FORMAT=BI,FIELDS=(6,11,A)
RECORD TYPE=V
DEBUG NOABEND,ESTAE
OPTION EQUALS,MSGPRT=ALL,LIST,NOCHECK,RESINV=0,DYNALLOC,SORTDD=JNF1,MSG*
DDN=JNF1JMSG,SORTIN=SORTJNF1
ICE201I H RECORD TYPE IS V - DATA STARTS IN POSITION 5
ICE751I 0 C5-K90025 C6-K90025 C7-K54603 C8-K62201 EE-K51707 E9-K60823 C9-BASE E5-K62201 E6-K51707 C4-K62201 E7-K62201
ICE193I 0 ICEAM2 INVOCATION ENVIRONMENT IN EFFECT - ICEAM2 ENVIRONMENT SELECTED
ICE088I 0 JOINKEYS.S2 . , INPUT LRECL = 616, BLKSIZE = 22528, TYPE = V
ICE093I 0 MAIN STORAGE = (MAX,46538587,46538587)
ICE156I 0 MAIN STORAGE ABOVE 16MB = (46481227,46481227)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
ICE128I 0 OPTIONS: SIZE=46538587,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 ,MSGDDN=JNF1JMSG
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,016),ABCODE=MSG
ICE130I 0 OPTIONS: RESALL=8192,RESINV=0,SVC=109 ,CHECK=N,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=16384,CINV=Y,CFW=Y,DSA=64
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=MAX
ICE235I 0 OPTIONS: NULLOUT=RC0
ICE084I 1 VSAM ACCESS METHOD USED FOR SORTJNF1
ICE750I 0 DC 14930667436 TC 0 CS DSVNN KSZ 15 VSZ 15
ICE752I 0 FSZ=14930667436 BC IGN=0 E AVG=618 0 WSP=38910666 C DYN=509496 53216
ICE751I 1 D8-BASE D4-K59451 EA-K57947 F1-K38900 E8-K61438
ICE091I 0 OUTPUT LRECL = 616, TYPE = V
ICE096I 0 SUCCESSFUL RECOVERY FROM B37 ABEND(S) FOR WORK DATA SET(S)
ICE055I 0 INSERT 0, DELETE 81548112
ICE054I 0 RECORDS - IN: 81548112, OUT: 0
ICE134I 0 NUMBER OF BYTES SORTED: 15256859884
ICE253I 0 RECORDS SORTED - PROCESSED: 81548112, EXPECTED: 48476192
ICE258I 0 DFSORT COULD NOT DYNAMICALLY ALLOCATE THE OPTIMAL WORK DATA SET SPACE
ICE098I 0 AVERAGE RECORD LENGTH - PROCESSED: 187, EXPECTED: 308
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 219720 , TRACKS USED: 134325
ICE199I 0 MEMORY OBJECT STORAGE USED = 0M BYTES
ICE180I 0 HIPERSPACE STORAGE USED = 8302960K BYTES
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
ICE052I 0 END OF DFSORT

Code:

1ICE417I 0 THIS IS THE JOINKEYS F2 SUBTASK FOR SORTJNF2
ICE143I 0 BLOCKSET SORT TECHNIQUE SELECTED
ICE250I 0 VISIT http://www.ibm.com/storage/dfsort FOR DFSORT PAPERS, EXAMPLES AND MORE
ICE000I 0 - CONTROL STATEMENTS FOR XXXX-A01, Z/OS DFSORT V1R10 - 02:27 ON WED NOV 26, 2014 -
0 OPTION DYNALLOC=(,16)
INREC BUILD=(1,6,7,5,ZD,EDIT=(TTTTT))
OMIT COND=(7,5,ZD,EQ,0)
ICE146I 0 END OF STATEMENTS FROM JNF2CNTL - PARAMETER LIST STATEMENTS FOLLOW
SORT FORMAT=BI,FIELDS=(1,11,A)
RECORD TYPE=F
DEBUG NOABEND,ESTAE
OPTION EQUALS,MSGPRT=ALL,LIST,NOCHECK,RESINV=0,DYNALLOC,SORTDD=JNF2,MSG*
DDN=JNF2JMSG,SORTIN=SORTJNF2
ICE201I H RECORD TYPE IS F - DATA STARTS IN POSITION 1
ICE751I 0 C5-K90025 C6-K90025 C7-K54603 C8-K62201 EE-K51707 E9-K60823 C9-BASE E5-K62201 E6-K51707 E7-K62201
ICE193I 0 ICEAM2 INVOCATION ENVIRONMENT IN EFFECT - ICEAM2 ENVIRONMENT SELECTED
ICE088I 1 JOINKEYS.S2 . , INPUT LRECL = 3568, BLKSIZE = 12288, TYPE = F
ICE093I 0 MAIN STORAGE = (MAX,6291456,6291456)
ICE156I 0 MAIN STORAGE ABOVE 16MB = (6234096,6234096)
ICE127I 0 OPTIONS: OVFLO=RC0 ,PAD=RC0 ,TRUNC=RC0 ,SPANINC=RC16,VLSCMP=N,SZERO=Y,RESET=Y,VSAMEMT=Y,DYNSPC=256
ICE128I 0 OPTIONS: SIZE=6291456,MAXLIM=1048576,MINLIM=450560,EQUALS=Y,LIST=Y,ERET=RC16 ,MSGDDN=JNF2JMSG
ICE129I 0 OPTIONS: VIO=N,RESDNT=ALL ,SMF=NO ,WRKSEC=Y,OUTSEC=Y,VERIFY=N,CHALT=N,DYNALOC=(SYSDA ,016),ABCODE=MSG
ICE130I 0 OPTIONS: RESALL=8192,RESINV=0,SVC=109 ,CHECK=N,WRKREL=Y,OUTREL=Y,CKPT=N,COBEXIT=COB2
ICE131I 0 OPTIONS: TMAXLIM=6291456,ARESALL=0,ARESINV=0,OVERRGN=16384,CINV=Y,CFW=Y,DSA=0
ICE132I 0 OPTIONS: VLSHRT=N,ZDPRINT=Y,IEXIT=N,TEXIT=N,LISTX=N,EFS=NONE ,EXITCK=S,PARMDDN=DFSPARM ,FSZEST=N
ICE133I 0 OPTIONS: HIPRMAX=OPTIMAL,DSPSIZE=MAX ,ODMAXBF=0,SOLRF=Y,VLLONG=N,VSAMIO=N,MOSIZE=MAX
ICE235I 0 OPTIONS: NULLOUT=RC0
ICE084I 1 VSAM ACCESS METHOD USED FOR SORTJNF2
ICE750I 0 DC 8749485280 TC 0 CS DSVNN KSZ 15 VSZ 15
ICE752I 0 FSZ=2452210 RC IGN=0 E AVG=16 0 WSP=50960 C DYN=0 0
ICE751I 1 DE-K61785 D5-K62201 D3-BASE D7-BASE E8-K61438
ICE091I 0 OUTPUT LRECL = 11, TYPE = F
ICE055I 0 INSERT 0, DELETE 2452210
ICE054I 0 RECORDS - IN: 2452210, OUT: 0
ICE134I 0 NUMBER OF BYTES SORTED: 8749185568
ICE253I 0 RECORDS SORTED - PROCESSED: 2452126, EXPECTED: 2452210
ICE165I 0 TOTAL WORK DATA SET TRACKS ALLOCATED: 0 , TRACKS USED: 0
ICE199I 0 MEMORY OBJECT STORAGE USED = 0M BYTES
ICE180I 0 HIPERSPACE STORAGE USED = 38460K BYTES
ICE188I 0 DATA SPACE STORAGE USED = 0K BYTES
ICE052I 0 END OF DFSORT

Thanks
Magesh

kolusu
Site Admin

Joined: 26 Nov 2002
Posts: 12401
Topics: 75
Location: San Jose

Posted: Wed Nov 26, 2014 11:20 am Post subject:

Magesh_J wrote:

If we add avg record length and approximate file size, will the performance be improved ?

Code:

ICE253I 0 RECORDS SORTED - PROCESSED: 81548112, EXPECTED: 48476192
ICE258I 0 DFSORT COULD NOT DYNAMICALLY ALLOCATE THE OPTIMAL WORK DATA SET SPACE

Magesh_J,

Yes providing AVG lrecl and an estimated records will help you with better performance. Add the following to SYSIN and JNF1CNTL

Code:

OPTION AVGRLEN=187,FILSZ=E81600000,DYNALLOC=(,32)

_________________
Kolusu
www.linkedin.com/in/kolusu

Magesh_J
Intermediate

Joined: 21 Jun 2014
Posts: 259
Topics: 54

Posted: Wed Nov 26, 2014 5:03 pm Post subject:

Thanks kolusu. Please advice is there a way to avoid ice247i. Thanks Magesh

kolusu
Site Admin

Joined: 26 Nov 2002
Posts: 12401
Topics: 75
Location: San Jose

Posted: Fri Nov 28, 2014 11:18 pm Post subject:

Magesh_J wrote:

Thanks kolusu.

Please advice is there a way to avoid ice247i.

Thanks
Magesh

Magesh,

Since a JOINKEYS application uses three tasks, it can require more storage than a regular DFSORT application. You may need to use REGION=0M for some JOINKEYS applications.

Code:

//STEP0100 EXEC PGM=SORT,REGION=0M

Provide AVG lrecl and an estimated records will help you with better performance. Add the following to both SYSIN and JNF1CNTL

Code:

OPTION AVGRLEN=187,FILSZ=E81600000,DYNALLOC=(,32)

_________________
Kolusu
www.linkedin.com/in/kolusu

Magesh_J
Intermediate

Joined: 21 Jun 2014
Posts: 259
Topics: 54

Posted: Wed Dec 10, 2014 1:34 pm Post subject:

Thanks Kolusu, Its worked great.

Display posts from previous:

	MVSFORUMS.com Forum Index -> Utilities	All times are GMT - 5 Hours Goto page Previous 1, 2
Page 2 of 2

You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum