DataStage Restructuring Stages

Reading Time: 2 minutes

Column Export stage

The Column Export stage is a
restructure stage. It can have a single input link, a single output link and a
single rejects link.

The Column Export stage exports
data from a number of columns of different data types into a single column of
data type ustring, string, or binary. It is the complementary stage to Column
Import.

The input data column
definitions determine the order in which the columns are exported to the single
output column. Information about how the single column being exported is
delimited is given in the Formats tab of the Input page. You can optionally
save reject records, that is, records whose export was rejected.

Column Import stage

The Column Import stage is a restructure stage. It can
have a single input link, a single output link and a single rejects link.

The Column Import stage imports data from a single column
and outputs it to one or more columns. You would typically use it to divide
data arriving in a single column into multiple columns. The data would be
fixed-width or delimited in some way to tell the Column Import stage where to
make the divisions. The input column must be a string or binary data, the output
columns can be any data type.

Column Import stage: Input category

Import input column – Specifies the name of the column containing the
string or binary data to import.

Column Import stage: Output category

Column method – Specifies whether the columns to import should be derived from
column definitions on the Output page Columns tab (Explicit) or from a schema
file (Schema File).

Column to import – Specifies an output column. The meta data for
this column determines the type that the import column will be converted to.
Repeat the property to specify multiple columns.

Schema File – Instead of specifying the source data type details via output
column definitions, you can use a schema file (note, however, that if you have
defined columns on the Columns tab, you should ensure these match the schema
file).

Column Import stage: Options category

Keep Input Column – Specifies whether the original input column
should be transferred to the output data set unchanged in addition to being
imported and converted. Defaults to False.

Reject mode – The values of this property specify the following actions:

Fail: The stage fails when it encounters a record whose
import is rejected.

Output: The stage continues when it encounters a reject
record and writes the record to the reject link.

Continue: The stage is to continue but report failures to
the log file.