How-to

How to take a dump of a mongo collection in IWX
Description: Perform the below steps to collect the dump of a mongo collection and share it with the IWX Support Team based on the request. Here we are ...
Tue, 15 Nov, 2022 at 4:11 AM
How to create a decision branch node in a workflow in IWX
Decision Branch:  This task allows you to add workflow control. The conditional logic defined in this task yields two or more branches and switch paths ...
Fri, 19 Mar, 2021 at 9:32 AM
How to change Platform Service log level to DEBUG mode
Description: Perform the below steps to change the Platform service log level to DEBUG mode from INFO. a) Login to Infoworks Edge node as the user who s...
Mon, 15 Feb, 2021 at 4:10 PM
How to handle CSV file ingestion that has multiple lines within a record?
Problem Description: During file-based ingestion, if the source data has multiple lines for a record, the target table on Databricks may result in addit...
Tue, 19 Jan, 2021 at 10:16 PM
How to ingest from SharePoint ?
Prerequisites:      Step 1:  Please register a new generic JDBC source for Sharepoint Ref:  https://docs.infoworks.io/onboard-data/generic-jdbc-source-...
Mon, 11 Jan, 2021 at 7:48 AM
How to enable debug logging for scheduler service in IWX
Description: Starting from IWX 2.7.x, the scheduler service is a part of the Platform service. Below are the steps that you need to perform to enable DE...
Tue, 22 Dec, 2020 at 10:24 AM
How to persist the sql server table during the full export job?
Description: During the full export job to the SQL Server database table in Infoworks v2.x,v3.x,v4.x, the SQL server table will be dropped and re-create...
Sun, 8 Nov, 2020 at 10:09 PM
How to build Sql Server Custom target in Infoworks on Databricks
Description We can build a custom Target for pipelines in Infoworks on Databricks. Follow the below steps to build a custom target for SQL Server. Usage: ...
Thu, 29 Oct, 2020 at 10:37 AM
How to set ERROR record threshold value for CSV ingestion in Infoworks DataFoundry
Description: The below configuration allows the CSV ingestion job to have some error records as configured and DataFoundry would not fail the job. The inges...
Thu, 6 Jan, 2022 at 7:24 PM
How to add a timestamp column from regex on filename during file ingestion?
Datafoundry fixed-width ingestion provides an option to append new columns which are extracted from a "match regex" and "extract regex" ...
Mon, 24 Aug, 2020 at 9:44 PM