Start a new topic
Discussions xDM xDM - Integration
Answered

Data Quality in batch mode and real-time integration

Are Data Quality Rules Available in Batch Mode and In Real-Time Integration?

Best Answer

Yes, they are. Let me explain how it works.

  • When you submit data using SQL and REST integration, you specify an integration job name that is declared in your model. This job processes enrichers, validations, etc... according to the tasks checked for each entity. If the entity has an enricher or validation defined with a pre or post consolidation scope, it will be processed during the job certification if the corresponding task is checked.


Sample integration job with
Sample integration job with Enable Source Validation checked for the Family entity


Sample validation for the Family entity with a
Sample validation for the Family entity with a Pre-consolidation only scope

Generated job task for the Family entity, in the Validate Source Authoring Data tasks group
Generated job task for the Family entity, in the Validate Source Authoring Data tasks group
  • When you create or edit records using steppers or workflows directly in the UI, we recommend running validations during authoring, so that the user is warned or blocked and create only valid data. For that, you can first activate Form Validations in the step so that the user knows that the data does not comply with the rule, then you can also Warn or Block him if he insists and tries to continue with this validation error thanks to the Step Transitions Validations.
Are the data quality rules available in batch mode and in real-time integration?
Form Validations checked directly on Form Open and On Data Change
Validation message appears directly in the form
Validation message appears directly in the form
Are the data quality rules available in batch mode and in real-time integration?
Step Transition Validations set to Block On Step Exit


User is blocked when clicking Next or Finish
User is blocked when clicking Next or Finish
1 Comment
Answer

Yes, they are. Let me explain how it works.

  • When you submit data using SQL and REST integration, you specify an integration job name that is declared in your model. This job processes enrichers, validations, etc... according to the tasks checked for each entity. If the entity has an enricher or validation defined with a pre or post consolidation scope, it will be processed during the job certification if the corresponding task is checked.


Sample integration job with
Sample integration job with Enable Source Validation checked for the Family entity


Sample validation for the Family entity with a
Sample validation for the Family entity with a Pre-consolidation only scope

Generated job task for the Family entity, in the Validate Source Authoring Data tasks group
Generated job task for the Family entity, in the Validate Source Authoring Data tasks group
  • When you create or edit records using steppers or workflows directly in the UI, we recommend running validations during authoring, so that the user is warned or blocked and create only valid data. For that, you can first activate Form Validations in the step so that the user knows that the data does not comply with the rule, then you can also Warn or Block him if he insists and tries to continue with this validation error thanks to the Step Transitions Validations.
Are the data quality rules available in batch mode and in real-time integration?
Form Validations checked directly on Form Open and On Data Change
Validation message appears directly in the form
Validation message appears directly in the form
Are the data quality rules available in batch mode and in real-time integration?
Step Transition Validations set to Block On Step Exit


User is blocked when clicking Next or Finish
User is blocked when clicking Next or Finish
Login to post a comment
More topics in xDM - Integration
See all 73 topics
Help Desk Software by Freshdesk