How to handle CSV file ingestion that has multiple lines within a record? : Infoworks

How to handle CSV file ingestion that has multiple lines within a record? Print

Modified on: Tue, 19 Jan, 2021 at 10:16 PM

Problem Description:

During file-based ingestion, if the source data has multiple lines for a record, the target table on Databricks may result in additional records.

Solution:

Please add an advanced configuration at table or source level as below,

Key: is_multi_line_csv

Value: true

Affects Version:

3.2.x,4.2.x

Did you find it helpful? Yes No