Skip to main content

Add Column

It lets the user add a new column with a literal value of the desired data type.

This transformation needs below inputs from the user:

Input ArgumentsMandatoryDefault ValueDescription
column-nameYes-Name of the new column to be added
column-valueYes-Literal value of the new column
column-data-typeNo-The spark sql data type that new column needs to be casted
replace-existingNofalseIf set to true, if a column already exists with the same name as column-name, it will get replaced with the new value.
If set to false, then it returns original dataframe.

User can configure the AddColumn transformation in the below manner:

For example, consider we have below restonomer response in json:

{
"col_A": "val_A",
"col_B": "val_B",
"col_C": 10.2
}

Now, if the requirement is to add a new column col_D with the literal value val_D, then user can configure the AddColumn transformation in the below manner:

{
type = "AddColumn"
column-name = "col_D"
column-value = "val_D"
column-data-type = "string"
replace-existing = true
}

The transformed response will now have the new column col_D added:

{
"col_A": "val_A",
"col_B": "val_B",
"col_C": 10.2,
"col_D": "val_D"
}