General

Placeholder for KB's articles

Ingestion job fails with java.util.concurrent.ExecutionException: java.io.FileNotFoundException in DataFoundry 4.2
Problem Description: Ingestion job fails with the below error in Infoworks DataFoundry 4.2 {"life_cycle_state":"INTERNAL_ERROR"...
Tue, 15 Sep, 2020 at 11:45 PM
How to create Generic JDBC Excel source in Infoworks DataFoundry 4.2
Description: Infoworks DataFoundry supports extracting data from an Excel file using Generic JDBC Source. a) Go to Admin>Sources>Add New Source an...
Tue, 15 Sep, 2020 at 11:01 PM
How to add custom tags to Infoworks Job clusters?
Description By default the Infoworks Job clusters spun up for ingestion or pipelines jobs will have a few default tags.  If customers wish to add a few...
Mon, 14 Sep, 2020 at 11:12 PM
Kafka ingestion fails with error Caused by: java.lang.NoSuchMethodError: com.univocity.parsers.csv.CsvFormat.setDelimiter
Problem Description: Kafka streaming ingestion fails with below error Caused by: java.lang.NoSuchMethodError: com.univocity.parsers.csv.CsvFormat.se...
Mon, 24 Aug, 2020 at 9:12 AM
Steps to take backup of MongoDb data and restore the data from the backup file
Description: Below are the steps to take the backup of Infoworks DataFoundry metadata which is stored in MongoDB and to restore the same.  Note: Ensure...
Mon, 24 Aug, 2020 at 8:53 AM
Is Hive Source table export supported in Infoworks DataFoundry ?
Problem Description Hive Source table export functionality is not supported in Infoworks DataFoundry.  You would see the export option for the hive ...
Mon, 24 Aug, 2020 at 8:51 AM
ERROR [main] org.mortbay.log: Error starting handlers java.lang.IncompatibleClassChangeError: Error while infoworks DF launching yarn application
Problem Description: Ingestion jobs fail while launching a yarn application. Application log fails with the following error message 2020-08-05 22:22:18,...
Mon, 24 Aug, 2020 at 8:51 AM
org.postgresql.util.PSQLException: The connection attempt failed while running ingestion job in DataFoundry on Databricks
Problem Description: Postgres ingestion in DataFoundry on Databricks(AWS) fails with the below error in the databricks job log. 20/08/12 22:11:20 ER...
Thu, 13 Aug, 2020 at 3:43 AM
Crawl metadata failing with "Response Row size exceeds 64K bytes and is incompatible with the Client software" error in a Teradata source.
Problem Description:   Metacrawl of a Teradata source failing with below error if the row size exceeds 64K bytes, [ERROR] 2020-07-28 10:40:00,512 [mai...
Thu, 30 Jul, 2020 at 7:52 AM
org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block while running Spark Pipeline
Problem Description: Pipeline in cluster mode with Spark as execution engine will fail with the below error in the job log. Caused by: org.apache...
Thu, 30 Jul, 2020 at 7:07 AM