Setting Up Data Extract Task

The Data Extract Task selects objects from the IIQ database, processes each object, and writes a message for each to a destination queue. The first time Data Extract runs, it completes a full extract for the defined objects. Subsequent task runs extract a delta based on what has changed since the last time it ran.

You can set up this task to run on your instance:

  1. Configure a Data Extraction YAMLConfig for the task provides what types of objects to extract. See Configuring Data Extraction.

  2. Set a message destination to dispatch messages to. See Provisioning a Data Extract Task Destination Queue.

  3. Configure a transformConfigurationName YAMLConfig to describe how to extract the types from the first YAMLConfig extractedObjects. See Configuring Data Transformation.

    1. Make sure the extractedObjects from the first YAMLConfig all have a corresponding imageConfigDescriptor and that each has a valid objectClassName

  4. Navigate to Setup > Tasks.

  5. Select the New Task dropdown in the upper right corner.

  6. From the dropdown list, select Data Extract.

    Note: When upgrading to version 8.4 from another version of IdentityIQ, if you do not see the Data Extract option, then make sure you followed the upgrade process by importing upgradeObjects. If it's a clean installation, then you need to reimport init.xml.

  7. On the New Task screen, enter a Name for your task and add any other optional field information you would like.

  8. Under Data Extract Options, select a Data Extract YAMLConfig.

  9. Select Save, Save & Execute, Cancel, or Refresh.

    1. Executing the task looks at what objects are configured to be exported, applies the filter criteria and any limits that you have set and translates all of those objects into JSON documents, and writes them to a JMS queue.

    2. If executed, review the Task Results, which display all the differences as well as the attribute statistics. See Viewing Data Extract Task Results.

You can schedule this task to run on a regular cadence. See How to Schedule a Task.

If you configure different YAML configurations for different object types, you can also configure separate tasks to run at different intervals. For example, YAML 1 may be configured for Object X and YAML 2 for Object Y. Task 1 for YAML 1 may be scheduled to run every week, while Task 2 for YAML 2 may be scheduled to run every day.