Data Quality in batch mode and real-time integration
Cédric Blanc
started a topic
over 2 years ago
Are Data Quality Rules Available in Batch Mode and In Real-Time Integration?
Best Answer
C
Cédric Blanc
said
over 2 years ago
Yes, they are. Let me explain how it works.
When you submit data using SQL and REST integration, you specify an integration job name that is declared in your model. This job processes enrichers, validations, etc... according to the tasks checked for each entity. If the entity has an enricher or validation defined with a pre or post consolidation scope, it will be processed during the job certification if the corresponding task is checked.
Sample integration job with Enable Source Validation checked for the Family entity
Sample validation for the Family entity with a Pre-consolidation only scope Generated job task for the Family entity, in the Validate Source Authoring Data tasks group
When you create or edit records using steppers or workflows directly in the UI, we recommend running validations during authoring, so that the user is warned or blocked and create only valid data. For that, you can first activate Form Validations in the step so that the user knows that the data does not comply with the rule, then you can also Warn or Block him if he insists and tries to continue with this validation error thanks to the Step Transitions Validations.
Form Validations checked directly on Form Open and On Data ChangeValidation message appears directly in the formStep Transition Validations set to Block On Step Exit
User is blocked when clicking Next or Finish
1 Comment
Cédric Blanc
said
over 2 years ago
Answer
Yes, they are. Let me explain how it works.
When you submit data using SQL and REST integration, you specify an integration job name that is declared in your model. This job processes enrichers, validations, etc... according to the tasks checked for each entity. If the entity has an enricher or validation defined with a pre or post consolidation scope, it will be processed during the job certification if the corresponding task is checked.
Sample integration job with Enable Source Validation checked for the Family entity
Sample validation for the Family entity with a Pre-consolidation only scope Generated job task for the Family entity, in the Validate Source Authoring Data tasks group
When you create or edit records using steppers or workflows directly in the UI, we recommend running validations during authoring, so that the user is warned or blocked and create only valid data. For that, you can first activate Form Validations in the step so that the user knows that the data does not comply with the rule, then you can also Warn or Block him if he insists and tries to continue with this validation error thanks to the Step Transitions Validations.
Form Validations checked directly on Form Open and On Data ChangeValidation message appears directly in the formStep Transition Validations set to Block On Step Exit
Cédric Blanc
Are Data Quality Rules Available in Batch Mode and In Real-Time Integration?
Yes, they are. Let me explain how it works.
Cédric Blanc
Yes, they are. Let me explain how it works.
-
Import Data Into Entities via Azure Data Lake
-
Recover Deleted(soft Delete) Record and Configure in Application
-
Integration with analytics tools
-
Query/Load/Delete data with the REST API
-
Does the Done Tab in Inbox have a limit?
-
How Can I Trigger Enricher or Sql Procedure when deleting?
-
Matching Rules But Only The Latest Record Creates a Golden Record
-
Unstructured and Semi Structured Data in Semarchy?
-
Read CSV files from AWS S3
See all 70 topics