Reusing work files

Depending on the conditions of the transformation, such as input data file size and processing complexity, work and data files can significantly affect performance. When possible, reusing work files can produce measurable performance gains.

About this task

Work files contain metadata about the various type objects found in each input data file. If the data content is static, this metadata can be reused in subsequent runs. Reusing work files allows the transformation engine to bypass the validation step for these sources. Reducing the number of steps results in a shorter overall execution time.

When possible, reusing work files can produce measurable performance gains, especially in input data files requiring complex validation logic. This option is ideal for map processes that make use of static data, such as lookup tables. Work file reuse is specified separately for each input card, either as an execution command or as an option in the Map Designer. Reusing work files with an execution command is done with the W option on the input card override (-I) execution command.

To reuse work files, you must generate a work file.

To generate a work file

Procedure

  1. Specify an input card override -I execution command for the corresponding input source for a compiled map with the (W) reuse option.
  2. Execute the map.

    A work file is generated.

Results

Subsequent map executions with the same input override options will reuse the generated work file. As mentioned previously, this option is ideal if the data content is static. If the data content changes, the work file should be regenerated.

To regenerate a work file

Procedure

  1. Remove the old work file.
  2. Specify an input card override -I execution command for the corresponding input source for a compiled map with the (W) reuse option.
  3. Execute the map.

    A work file is generated.

Results

A generated work file can be used to determine the amount of workspace required for a given input source. This can be helpful when using workspace options such as -WM.

See the Command Server documentation and the Execution Command documentation for more information about work file reuse.