Use this task to create a discovery job for file-based or mainframe Copybook data. A discovery job analyzes your data and assigns appropriate data domains and masking algorithms to fields based on patterns and data characteristics.
Prerequisites
-
You have created a rule set for your file or mainframe data. See Create a rule set for flat files, Create a rule set for semi-structured files, or Create a rule set.
Steps
-
Go to Compliance > Compliance Jobs.
-
For a file-based discovery job, click + Compliance Job. For a mainframe Copybook discovery job, click Actions > + Discovery Job.
-
For a file-based discovery job, in the What would you like to do? dialog, select Discover data and click Continue.
-
Select your rule set and click Next.
-
In the Configuration step, select the Copybook rule set and a Discovery Policy. The policy determines which domains and algorithms are assigned to fields based on data patterns.
-
For a Copybook rule set, configure the discovery job settings. Set Number of Streams, Feedback Size, and the optional Min Memory (MB) and Max Memory (MB). You can also enable Multiple Profiler Expression Check or Clear previous auto Data Class assignments when required. When you use an ASDD discovery policy, set Max Memory to at least 1024 MB per stream.
-
Review the job summary and click Submit.
The discovery job is created and ready to run.
-
Click Run to execute the discovery job.
The system analyzes your file or mainframe data and assigns domains and algorithms to each field. You can monitor progress on the Execution page.
-
After the job completes, see View Discovery results to review the profiling results.
For mainframe Copybook rule sets, open the rule set and review the Domain and Algorithm assignments for each field. When multiple datasets use the same Copybook format, discovery scores are averaged across the datasets. You can review and adjust assignments in the rule set before creating a masking job.