New discussion topic on DataCleaner's online discussion forum
(https://datacleaner.org/forum):
steen sjogaard posted the subject 'Q: How can I create a consistency check
across fields in a dataset...'
-------------------
Hi,
I like the approach to data profiling that DataCleaner provides very much, and
I find it very easy to quickly explore and attain new insights in our data!
I have however, a question regarding how to do some simple consistency check
across specific fields in a dataset. I have tried to figure out how to combine
the various “functions” in the profiling Library within Transform, Improve and
Analyze to achieve this, but I have not yet found a good and "simple" way to do
this, so I hope you can guide me in the right direction:
Example:
say I have a simple excel file with 4 rows (named A, B, C and D) that holds a
lot of records.
For the data in the file to be “valid” the data must full-fill a few very
simple business rules (defining which values that are allowed in the 4 fields)
plus a few rules that go across the 4 fields.
Value List for field A: {A1, A2, A3, A4}
Value List for field B: {B1, B2, B3}
Value List for field C: {C1, C2, C3}
Value List for field D: {D1, D2}
Rule1: IF (A1) THEN (B1) AND (C1) AND (D2)
Rule2: IF (A2) THEN (B2) AND ((C1) OR (C2)) AND (D2)
Rule3: IF (((A3) OR (A4)) AND (B3)) THEN ((C1) OR (C2) OR (C3)) AND (D1)
Checking data validity for each individual field is rather easy using the
Filters within Transform.
But what is the trick to do the consistency check that goes across the 4 fields
(Rule 1, 2 and 3)?
Could someone please help me and give me a hint here?
Thanks
/Steen Sjøgaard
-------------------
View the topic online to reply - go to
https://datacleaner.org/topic/1138/Q%3A-How-can-I-create-a-consistency-check-across-fields-in-a-dataset...
--
You received this message because you are subscribed to the Google Groups
"DataCleaner-notify" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/datacleaner-notify.
For more options, visit https://groups.google.com/d/optout.
