General

Placeholder for KB's articles

Ingestion job TIMEDOUT after running for long time
Databricks jobs, for ingestion, submitted by infoworks DF can get timed out if it runs more than a configurable limit. The messages in job log which indicat...
Fri, 30 Oct, 2020 at 10:53 AM
Incremental ingestion is failing with "unable to find the column of the target table" error
Description: Incremental ingestion is failing with unable to find the column <column_name> of the target table. Error message in the databricks lo...
Mon, 9 Aug, 2021 at 1:56 PM
How to ingest from Hubspot using Datafoundry
Prerequisites:  Step 1:  Please register a new generic JDBC source for Hubspot Ref:  https://docs.infoworks.io/onboard-data/generic-jdbc-source-typ...
Thu, 22 Oct, 2020 at 9:52 PM
psycopg2.OperationalError) FATAL: sorry, too many clients already
Problem Description The below FATAL error comes up in some of the workflow nodes resulting in node failure during workflow execution in Infoworks Data F...
Mon, 19 Oct, 2020 at 8:07 PM
How to monitor Infoworks Services
Description The Admin team managing the Infoworks environment would need to know if the services are up and running. They would also need to know if the...
Wed, 14 Oct, 2020 at 10:19 PM
Ingestion job fails with java.util.concurrent.ExecutionException: java.io.FileNotFoundException in DataFoundry 4.2
Problem Description: Ingestion job fails with the below error in Infoworks DataFoundry 4.2 {"life_cycle_state":"INTERNAL_ERROR"...
Wed, 16 Sep, 2020 at 12:15 PM
How to create Generic JDBC Excel source in Infoworks DataFoundry 4.2
Description: Infoworks DataFoundry supports extracting data from an Excel file using Generic JDBC Source. a) Go to Admin>Sources>Add New Source an...
Wed, 16 Sep, 2020 at 11:31 AM
How to add custom tags to Infoworks Job clusters?
Description By default the Infoworks Job clusters spun up for ingestion or pipelines jobs will have a few default tags If customers wish to add a few c...
Thu, 4 Aug, 2022 at 3:47 AM
Ingest job fails at merge stage with Table or view not found error
Problem statement: Ingest job fails at merge state with following error message in the databricks log  20/08/18 18:46:43 ERROR DistJobsDriver: org.apach...
Fri, 1 Oct, 2021 at 11:41 AM
Kafka ingestion fails with error Caused by: java.lang.NoSuchMethodError: com.univocity.parsers.csv.CsvFormat.setDelimiter
Problem Description: Kafka streaming ingestion fails with below error Caused by: java.lang.NoSuchMethodError: com.univocity.parsers.csv.CsvFormat.se...
Mon, 24 Aug, 2020 at 9:42 PM