General

Placeholder for KB's articles

Steps to take backup of MongoDb data and restore the data from the backup file
Description: Below are the steps to take the backup of Infoworks DataFoundry metadata which is stored in MongoDB and to restore the same.  Note: Ensure...
Mon, 24 Aug, 2020 at 8:53 AM
Is Hive Source table export supported in Infoworks DataFoundry ?
Problem Description Hive Source table export functionality is not supported in Infoworks DataFoundry.  You would see the export option for the hive ...
Mon, 24 Aug, 2020 at 8:51 AM
ERROR [main] org.mortbay.log: Error starting handlers java.lang.IncompatibleClassChangeError: Error while infoworks DF launching yarn application
Problem Description: Ingestion jobs fail while launching a yarn application. Application log fails with the following error message 2020-08-05 22:22:18,...
Mon, 24 Aug, 2020 at 8:51 AM
org.postgresql.util.PSQLException: The connection attempt failed while running ingestion job in DataFoundry on Databricks
Problem Description: Postgres ingestion in DataFoundry on Databricks(AWS) fails with the below error in the databricks job log. 20/08/12 22:11:20 ER...
Thu, 13 Aug, 2020 at 3:43 AM
Crawl metadata failing with "Response Row size exceeds 64K bytes and is incompatible with the Client software" error in a Teradata source.
Problem Description:   Metacrawl of a Teradata source failing with below error if the row size exceeds 64K bytes, [ERROR] 2020-07-28 10:40:00,512 [mai...
Thu, 30 Jul, 2020 at 7:52 AM
org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block while running Spark Pipeline
Problem Description: Pipeline in cluster mode with Spark as execution engine will fail with the below error in the job log. Caused by: org.apache...
Thu, 30 Jul, 2020 at 7:07 AM
java.lang.NoClassDefFoundError: commons/exception/IWException wile doing Parquet source Metacrawl
Problem Description Metadata Crawl for a Parquet Source fails with the below error in the job log. Error: A JNI error has occurred, please check you...
Fri, 24 Jul, 2020 at 8:10 AM
How to register custom UDF in Infoworks?
Upload the jar which has custom logic to a folder in the Infoworks edge node. Jars related to Hadoop, spark, etc, will already be available on the Infoworks...
Wed, 22 Jul, 2020 at 8:17 AM
How to ingest data from Twitter using Infoworks?
These are the configurations required to ingest Twitter feed directly into your data lake using Infoworks. Step 1: Create a 'REST Generic' API ...
Mon, 3 Aug, 2020 at 10:22 PM
Upgrade to 3.1 fails with PermissionError: [Errno 13] Permission denied: ''
Problem Description: When upgrading infoworks to a newer version upgrade.sh script can fail with the following error trace 2020-06-15 16:15:05,...
Mon, 20 Jul, 2020 at 12:13 AM