General

Placeholder for KB's articles

OutOfMemorySparkException while running Infoworks Jobs
Problem Description When you are running some incremental ingestion jobs or pipeline jobs, sometimes you might see the below errors related to broadcast...
Mon, 9 Nov, 2020 at 9:28 PM
The pipeline build failing with "Exception: cannot resolve (column name) given input columns" error
Description: The pipeline builds failing with cannot resolve 'some column name' given input columns error. Sample error log looks like below, ...
Fri, 30 Oct, 2020 at 11:28 AM
Ingestion job TIMEDOUT after running for long time
Databricks jobs, for ingestion, submitted by infoworks DF can get timed out if it runs more than a configurable limit. The messages in job log which indicat...
Fri, 30 Oct, 2020 at 10:53 AM
Incremental ingestion is failing with "unable to find the column of the target table" error
Description: Incremental ingestion is failing with unable to find the column <column_name> of the target table. Error message in the databricks lo...
Mon, 9 Aug, 2021 at 1:56 PM
How to ingest from Hubspot using Datafoundry
Prerequisites:  Step 1:  Please register a new generic JDBC source for Hubspot Ref:  https://docs.infoworks.io/onboard-data/generic-jdbc-source-typ...
Thu, 22 Oct, 2020 at 9:52 PM
psycopg2.OperationalError) FATAL: sorry, too many clients already
Problem Description The below FATAL error comes up in some of the workflow nodes resulting in node failure during workflow execution in Infoworks Data F...
Mon, 19 Oct, 2020 at 8:07 PM
How to monitor Infoworks Services
Description The Admin team managing the Infoworks environment would need to know if the services are up and running. They would also need to know if the...
Wed, 14 Oct, 2020 at 10:19 PM
Ingestion job fails with java.util.concurrent.ExecutionException: java.io.FileNotFoundException in DataFoundry 4.2
Problem Description: Ingestion job fails with the below error in Infoworks DataFoundry 4.2 {"life_cycle_state":"INTERNAL_ERROR"...
Wed, 16 Sep, 2020 at 12:15 PM
How to create Generic JDBC Excel source in Infoworks DataFoundry 4.2
Description: Infoworks DataFoundry supports extracting data from an Excel file using Generic JDBC Source. a) Go to Admin>Sources>Add New Source an...
Wed, 16 Sep, 2020 at 11:31 AM
How to add custom tags to Infoworks Job clusters?
Description By default the Infoworks Job clusters spun up for ingestion or pipelines jobs will have a few default tags.  If customers wish to add a few...
Tue, 15 Sep, 2020 at 11:42 AM