General

Placeholder for KB's articles

Ingest job fails at merge stage with Table or view not found error
Problem statement: Ingest job fails at merge state with following error message in the databricks log  20/08/18 18:46:43 ERROR DistJobsDriver: org.apach...
Fri, 1 Oct, 2021 at 11:41 AM
Kafka ingestion fails with error Caused by: java.lang.NoSuchMethodError: com.univocity.parsers.csv.CsvFormat.setDelimiter
Problem Description: Kafka streaming ingestion fails with below error Caused by: java.lang.NoSuchMethodError: com.univocity.parsers.csv.CsvFormat.se...
Mon, 24 Aug, 2020 at 9:42 PM
Steps to take backup of MongoDb data and restore the data from the backup file
Description: Below are the steps to take the backup of Infoworks DataFoundry metadata which is stored in MongoDB and to restore the same.  Note: Ensure...
Mon, 24 Aug, 2020 at 9:23 PM
Is Hive Source table export supported in Infoworks DataFoundry ?
Problem Description Hive Source table export functionality is not supported in Infoworks DataFoundry.  You would see the export option for the hive ...
Mon, 24 Aug, 2020 at 9:21 PM
ERROR [main] org.mortbay.log: Error starting handlers java.lang.IncompatibleClassChangeError: Error while infoworks DF launching yarn application
Problem Description: Ingestion jobs fail while launching a yarn application. Application log fails with the following error message 2020-08-05 22:22:18,...
Mon, 24 Aug, 2020 at 9:21 PM
org.postgresql.util.PSQLException: The connection attempt failed while running ingestion job in DataFoundry on Databricks
Problem Description: Postgres ingestion in DataFoundry on Databricks(AWS) fails with the below error in the databricks job log. 20/08/12 22:11:20 ER...
Thu, 13 Aug, 2020 at 4:13 PM
Crawl metadata failing with "Response Row size exceeds 64K bytes and is incompatible with the Client software" error in a Teradata source.
Problem Description:   Metacrawl of a Teradata source failing with below error if the row size exceeds 64K bytes, [ERROR] 2020-07-28 10:40:00,512 [mai...
Sat, 4 Sep, 2021 at 1:24 AM
org.apache.hadoop.hdfs.BlockMissingException: Could not obtain block while running Spark Pipeline
Problem Description: Pipeline in cluster mode with Spark as execution engine will fail with the below error in the job log. Caused by: org.apache...
Thu, 30 Jul, 2020 at 7:37 PM
java.lang.NoClassDefFoundError: commons/exception/IWException wile doing Parquet source Metacrawl
Problem Description Metadata Crawl for a Parquet Source fails with the below error in the job log. Error: A JNI error has occurred, please check you...
Fri, 24 Jul, 2020 at 8:40 PM
How to register custom UDF in Infoworks?
Upload the jar which has custom logic to a folder in the Infoworks edge node. Jars related to Hadoop, spark, etc, will already be available on the Infoworks...
Wed, 22 Jul, 2020 at 8:47 PM