, 2002 7:34 PM
Subject: Flat file generation integrity ideas...
I have to create packages that will generate several flat files of
data from tables that will be sent to other systems to be processed.
I am looking for ideas on how to ensure data integrity in the flat
files
:
Sent by: Subject: Re: Flat file
generation integrity ideas...
[EMAIL PROTECTED]
om
25/10/2002
06:14
Please respond
to ORACLE-L
I do
]
net.il cc:
Sent by: Subject: Re: Flat file
generation integrity ideas...
[EMAIL PROTECTED]
om
25/10/2002
06:14
Please respond
PROTECTED]
Reply-To: [EMAIL PROTECTED]
To: Multiple recipients of list ORACLE-L [EMAIL PROTECTED]
Subject: Re: Flat file generation integrity ideas...
Date: Sat, 26 Oct 2002 20:38:30 -0800
And I don't have proof, but I am absolutely positive that using UTL_FILE
is
faster then Perl...I just know
.
If you're using C, well, you're just working too hard. ;)
Jared
On Thursday 24 October 2002 15:24, Tim Gorman wrote:
RE: Flat file generation integrity ideas...DBMS_OBFUSCATION_TOOLKIT has an
(undocumented) function called MD5 which uses that protocol (MD5) to
calculate checksums. Look at $OH
-Original Message-
From: Jared Still [mailto:jkstill;cybcon.com]
Sent: Sat 10/26/2002 10:45 PM
To: [EMAIL PROTECTED]; Tim Gorman; Grabowy, Chris
Cc:
Subject: Re: Flat file generation integrity ideas...
I was going to suggest MD5 as well. Though I
-Original Message-
From: Jared Still [mailto:jkstill;cybcon.com]
Sent: Sat 10/26/2002 10:45 PM
To: [EMAIL PROTECTED]; Tim Gorman; Grabowy, Chris
Cc:
Subject: Re: Flat file generation integrity ideas
Yes, which is the ideal solution, but the other systems aren't ready for
XML.
Anytime we have a really good solution it's defered to the next phase.
-Original Message-
Sent: Thursday, October 24, 2002 6:33 PM
To: Multiple recipients of list ORACLE-L
Chris - Your comment about the
recipients of list ORACLE-L
Sent: Thursday, October 24, 2002 12:46
PM
Subject: RE: Flat file generation
integrity ideas...
you could also use dbms_utility.get_hash_value ... to
compute hash value for the whole row and store that as an additional column.
Be syre
Title: Flat file generation integrity ideas...
I do not see how the file can get
"scrambled".
You write it out ok.
The ftp is guaranteed.
So what is the problem.
I will go along with the suggestion to zip it. It saves on
the ftp time and also gives you some protection.
Yechiel
Chris - If Tom's idea provides you the protection you require, with
convenience to boot, then it sounds like you have a winner. I think all the
suggestions provide some variety of checksum, a standard computer science
technique. What are your requirements? Mainly to make sure the file doesn't
get
[mailto:[EMAIL PROTECTED]]Sent: Thursday, October 24, 2002 1:49
PMTo: Multiple recipients of list ORACLE-LSubject: RE:
Flat file generation integrity ideas...
(slapping my forehead) Duh.
Nice. I like it. Simple but effective. Minimal impact
on performance. And easy for the other
I will have to keep those in mind, if I ever get back onto a UNIX
platform.
Right now, I'm sticking to Tom's suggestion because I religiously follow
KISS.
Thanks!!
-Original Message-
Sent: Thursday, October 24, 2002 2:19 PM
To: Multiple recipients of list ORACLE-L
Chris - I would
Title: Flat file generation integrity ideas...
Chris;
I
would suggest the following:
1. Generating Check Sums of the files before they are sent.
2.Send the files.
3. Generating an after Check Sum and compare.
Here
are the steps I go thru to make sure our Oracle Archive Logs
,
Thomas F [mailto:[EMAIL PROTECTED]] Sent: Thursday, October
24, 2002 2:14 PMTo: Multiple recipients of list
ORACLE-LSubject: RE: Flat file generation integrity
ideas...
Chris,
have
you thought aboutsumming a number column in the record and placing this
sum in a trailer record
Title: Flat file generation integrity ideas...
Chris,
have
you thought aboutsumming a number column in the record and placing this
sum in a trailer record? this way, you have a header and trailer record
which helps you be confident that the whole file made it to the target
system
Chris - I would consider checksums. Many systems have built-in checksum
functions. On Unix these are cksum and sum. You could probably write a
simple one that would work on your various systems. Search for checksum and
somewhere on the Internet is probably sample code for one in a language that
Title: Flat file generation integrity ideas...
I have to create packages that will generate several flat files of data from tables that will be sent to other systems to be processed.
I am looking for ideas on how to ensure data integrity in the flat files.
For example, the expected record
Message-From: Jamadagni,
Rajendra [mailto:[EMAIL PROTECTED]] Sent: Thursday,
October 24, 2002 2:46 PMTo: Multiple recipients of list
ORACLE-LSubject: RE: Flat file generation integrity
ideas...
you could also use dbms_utility.get_hash_value ... to compute
hash value for the whole row
Title: RE: Flat file generation integrity ideas...
you could also use dbms_utility.get_hash_value ... to compute hash value for the whole row and store that as an additional column. Be syre to use the same parameters on both sides to compute and test, else it will fail the check.
Raj
everyone!!!
-Original Message-From: Yechiel Adar
[mailto:[EMAIL PROTECTED]] Sent: Thursday, October 24, 2002 4:15
PMTo: Multiple recipients of list ORACLE-LSubject: Re:
Flat file generation integrity ideas...
I do not see how the file can get
"scrambled".
You write
Title: RE: Flat file generation integrity ideas...
DBMS_OBFUSCATION_TOOLKIT has an (undocumented)
function called MD5 which uses that protocol (MD5) to calculate checksums.
Look at $OH/rdbms/admin/dbmsobtk.sql...
- Original Message -
From:
Jamadagni, Rajendra
To: Multiple
Chris - Your comment about the other systems maybe sending you the wrong
file sparked an idea. XML! Yeah, it has been overhyped, but the basic idea
is that the file specifies the format. So you could get a file and ensure
the content conforms to your expectation. I am an XML novice, but I believe
:
Sent by: Subject: Re: Flat file generation
integrity ideas...
[EMAIL PROTECTED
]
cgrabowy@fcg. cc:
com Subject: RE: Flat file generation
integrity ideas...
Sent
25 matches
Mail list logo
