This section can be used to set rules to identify the 'Master Record' among a group of duplicates. The 'Master Record' will be detected on the basis of the rules defined within this section.
You can use the Master Records Rules for the ‘Auto-Promote’ process at group and session levels. You can navigate to these settings by clicking on the 'Settings' cog and navigating to the ‘Master Record Rules’:
Within this settings page, you can configure the below:
Select Entity (drop-down): You can select the Entity for which the Master Record Rules need to be applied. (All rules set are specific to each Entity).
Attribute Type (drop-down): Lists the type of rules. For each rule type selected, the available rule options are filtered.
The Currently Available Attribute Types are:
- Option Set:
- Boolean:
- String:
- Date:
- Number:
- Memo:
- Generic:
- Owner:
- Multi Select Option Set:
- Look Up:
Master Record Based On: You can choose which method will be used to define the Master record.
- Sequential - Rules will be evaluated from top to bottom until there is one record remaining.
- Scoring - Each rule you setup has a value, if the record matches this rule then the record score will be incremented by the value you set, the record with the highest score at the end will be deemed as the Master or Winning record.
Rule Options: After selecting the Entity, all the Rule Options are displayed by default. This means you can filter as per the Rule Type. The 'Rule Options' are displayed with following information:
- Icon: If you hover over the Attribute icon, it will display the type of rule/attribute.
- Rule: Attribute Name (Can be toggled to display 'Schema Name' if you prefer to work with the underlying data name).
Note: The 'Rule Options' will differ as per the Entity selected. If the same 'Rule Option' is present in multiple entities, the rule will be applied for all respective entities.
You can drag and drop the Rules from the “Rule Options” section on the left to the 'Rules Sequence' section where they will be presented in the Tree like structure.
NOTE: Users cannot apply the same rule for more than one rule sequence.
Rule Options
When dropping a rule into the 'Rules Sequence' sections, a pop-up will be displayed (shown below) to add the 'Rules Parameters'. The pop-up will vary as per the 'Rule Type' and 'Rule Options' as follows:
1) Option Set - (for all the 'Rule Options', a pop-up is displayed to show the respective Attribute Values.)
Once the 'Option Set' Rule is dragged across, another pop-up will appear:
This will allow you to pull option set values into your configuration screen and configure rules for best record selection. Next, select 'Option Set Values' and you will receive another pop-up where you can select distinct values and decide on their score/hierarchy.
.
Once selected and score, press 'Add' and the rule will display on the rules screen.
2) Boolean - (for all the 'Rule Options', a pop-up is displayed to show the parameters “Yes/No”)
Once this rule has been selected, another pop-up will appear to add the Boolean rule set.
3) String - (for all the 'Rule Options', a pop-up is displayed to show where the user should able to manually add values against each 'Rule Option')
Once the rule has been selected, another pop-up will appear. This will allow you to define how string values are scored.
The entity and field values will be pre-populated. However, once you have defined your base score, string values and then add values can be set into a hierarchy. Once you have defined your string values you can manipulate their order by using the 'First', 'Up', 'Down', and 'Last' buttons. Once the configuration is complete, select 'Add' to append the string rule set.
4) Date - (for all the 'Rule Options', a pop-up is displayed to show the Parameters “Oldest/Newest”)
Once the 'Date' rule has been selected, another pop-up will appear. This will allow you to configure your date rules for best record selection. Select from:
- Newest- Scores/selects the newest date in a set of records
- Oldest - Scores/selects the oldest date in a set of records
5) Number - (for all the 'Rule Options', a pop-up is displayed to show the Parameters “Lowest/Highest”)
Once the 'Number' rule has been selected, another pop-up will appear. This will allow you to configure your number rules for best record selection.
Select between 'highest' or 'lowest' and then score the field, which will then be used to score a set of records.
6) Memo (for all the 'Rules Options', a pop-up will appear to display which rules are dragged across to be configured).
Once the 'Memo' rule has been selected, another pop-up will appear. This will allow you to configure your memo rules for best record selection.
Select between 'Longest' or 'Shortest' and then score the field, which will then be used to score a set of records.
7) Generic - There is only one rule for this section: “Record Completeness”, where a pop-up displays to show the Parameters (Most/Least), where a score can then be applied.
8) Owner - (Pop-up is displayed to show the rules options that can be applied to the respective attributes)
Once the 'Owner' rule has been selected, another pop-up will appear. This will allow you to configure your 'Owner Rules' for best record selection.
This will allow you to pull Look Up Values into your configuration screen and configure rules for best record selection. Next, select 'Look Up Values' and you will receive another pop-up where you can select distinct values and decide on their score/hierarchy.
Once the lookup values have been selected and added to the best record selection criteria, they will be displayed in the previous configuration screen. Lookup values can be given a score, and their hierarchy altered by using the 'First', 'Up', 'Down', 'Last', 'Delete' and 'Add' functions.
9) Look Up - (Pop-up is displayed to show the rules options that can be applied to the respective attributes)
Once the 'Look Up' rule has been selected, another pop-up will appear. This will allow you to configure your Look Up rules for best record selection.
This will allow you to pull Look Up Values into your configuration screen and configure rules for best record selection. Next, select 'Look Up Values' and you will receive another pop up where you can select distinct values and decide on their score/hierarchy.
Once the Look Up values have been selected and added to the best record selection criteria, they will be displayed in the previous configuration screen. Lookup values can be given a score, and their hierarchy altered by using the 'First', 'Up', 'Down', 'Last', 'Delete' and 'Add' functions.
Rules
Now it is important to understand the two different types of methods when selecting the 'Master Record'. The two options are:
- Sequential
- Scoring
This can be selected by toggling the following buttons:
This section displays the list of rules added to select the Master Record. Select the rules which you want to apply from the 'Rule Options' on the left hand side and apply them to the 'Rules Sequence' on the right hand side.
You can individually delete rules from the rules sequence by 'right-clicking' on the rule and selecting ‘Delete Rule’, as well as selecting the ‘Delete Rule’ option. You can delete one or multiple rules by holding shift and selecting the rules for deletion. After clicking on delete option, the pop-up will be shown to confirm the delete operation.
You can drag and drop the rules in upward and downward direction to change the order. Associated attributes will also be moved with the rules.
Parameters: Displays the parameters set for the rules. You can edit the rule parameters by 'right-clicking' and selecting the option “Edit” OR by double clicking on the applied rule. The pop-up will appear where you can update the rule parameter and apply the changes.
Sequential
This Master Record selection method applies the rules in a sequential order so that if one record meets the requirements in the rules sequence and one does not, then the record which meets the rules sequence criteria will be promoted as the master record.
If a deadlock occurs where both records meet the rules sequence requirements, ONLY then is the next rule applied to determine the 'Master Record'.
NOTE: Scoring has no effect on the selection of the Master record in this instance.
Scoring
It is now possible to score the importance of your selected rules sequence. The higher the score, the higher the priority when selecting your Master record. Double click on the rules sequence you would like to score and the following pop-up will appear.
First select the parameters you wish to measure your record scoring on: Least/Most, Yes/No, Newest/Oldest followed by the score you wish to give this parameter. Scoring is between -100 to 100 and it is up to you to decide the importance of each attribute.
The record that scores the highest from the cumulative rules applied, will be the 'Winning' record. This is a more sophisticated scoring method and is recommended by DQ Global.
Related Entities Count
Functionality has been added to set Mastering Rules based off of Related Entities.
When dragging Related Entities Count into the Rules Sequence box, a pop-up will appear which will allow you to add a parameter for related entities count.
Related Entity: Select the related entity from the dropdown that you would like to consider when deciding your best record.
Parameter: Select between 'Most' (highest count of related entity) or 'Least' (lowest count of related entity).
Score: Decide how highly you wish to score this rule when deciding your best record (if not using sequential scoring).
Miscellaneous Functions
These functions will allow you to navigate the DQ for Dynamics/Workbooks application. They are as follows:
- Expand All - Expand all groups to see attributes, transforms, display attributes etc.
- Add Group - Add a Match Group, Transform Group, Display Group.
- Delete - Delete a rule set or multiple rule sets
- Refresh - Refresh the rules displayed on the screen displayed
Was this article helpful?
That’s Great!
Thank you for your feedback
Sorry! We couldn't be helpful
Thank you for your feedback
Feedback sent
We appreciate your effort and will try to fix the article