General

Placeholder for KB's articles

Incremental ingestion is failing with "unable to find the column of the target table" error
Description: Incremental ingestion is failing with unable to find the column <column_name> of the target table. Error message in the databricks lo...
Mon, 9 Aug, 2021 at 1:56 PM
How to ingest from Hubspot using Datafoundry
Prerequisites:  Step 1:  Please register a new generic JDBC source for Hubspot Ref:  https://docs.infoworks.io/onboard-data/generic-jdbc-source-typ...
Thu, 22 Oct, 2020 at 9:52 PM
psycopg2.OperationalError) FATAL: sorry, too many clients already
Problem Description The below FATAL error comes up in some of the workflow nodes resulting in node failure during workflow execution in Infoworks Data F...
Mon, 19 Oct, 2020 at 8:07 PM
How to monitor Infoworks Services
Description The Admin team managing the Infoworks environment would need to know if the services are up and running. They would also need to know if the...
Wed, 14 Oct, 2020 at 10:19 PM
Ingestion job fails with java.util.concurrent.ExecutionException: java.io.FileNotFoundException in DataFoundry 4.2
Problem Description: Ingestion job fails with the below error in Infoworks DataFoundry 4.2 {"life_cycle_state":"INTERNAL_ERROR"...
Wed, 16 Sep, 2020 at 12:15 PM
How to create Generic JDBC Excel source in Infoworks DataFoundry 4.2
Description: Infoworks DataFoundry supports extracting data from an Excel file using Generic JDBC Source. a) Go to Admin>Sources>Add New Source an...
Wed, 16 Sep, 2020 at 11:31 AM
How to add custom tags to Infoworks Job clusters?
Description By default the Infoworks Job clusters spun up for ingestion or pipelines jobs will have a few default tags If customers wish to add a few c...
Thu, 4 Aug, 2022 at 3:47 AM
Ingest job fails at merge stage with Table or view not found error
Problem statement: Ingest job fails at merge state with following error message in the databricks log  20/08/18 18:46:43 ERROR DistJobsDriver: org.apach...
Fri, 1 Oct, 2021 at 11:41 AM
Kafka ingestion fails with error Caused by: java.lang.NoSuchMethodError: com.univocity.parsers.csv.CsvFormat.setDelimiter
Problem Description: Kafka streaming ingestion fails with below error Caused by: java.lang.NoSuchMethodError: com.univocity.parsers.csv.CsvFormat.se...
Mon, 24 Aug, 2020 at 9:42 PM
Steps to take backup of MongoDb data and restore the data from the backup file
Description: Below are the steps to take the backup of Infoworks DataFoundry metadata which is stored in MongoDB and to restore the same.  Note: Ensure...
Tue, 12 Jul, 2022 at 2:52 AM