General

Placeholder for KB's articles

CSV ingestion fails with org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: hdfs://path
Problem Description : CSV ingestion job fails with the below ERROR in the ingestion job log. [ERROR] 2020-05-19 12:03:58,169 [pool-6-thread-4] infowork...
Thu, 2 Jul, 2020 at 12:04 AM
Generic Rest API ingestion job fails with java.lang.NoClassDefFoundError: org/apache/spark/launcher/SparkLauncher
Problem Description Generic Rest API ingestion job fails with the below ERROR in the ingestion job log. Exception in thread "main" java.la...
Wed, 1 Jul, 2020 at 11:50 PM
Target Relative Path already exists error during CSV Ingestion File Mapping in DF 3.1
Problem Description: The CSV file Mapping fails with the below ERROR in the UI in Data Foundry 3.1 Root cause:  This issue occurs if the Targe...
Thu, 28 May, 2020 at 10:15 PM
java.lang.NoClassDefFoundError: org/apache/http/impl/client/HttpClientBuilder error while crawling XML based REST API getting
Problem Description XML based rest API source fails with the below error in UI during the metadata crawl. The queryservice.out in the location ...
Mon, 1 Jun, 2020 at 2:36 AM
Pipeline build job fails with ANTLR run time errors
Problem Description: Pipelines that are built with Spark or Hive as the execution engine fails with the below error in the .out file in the job log. ...
Thu, 16 Apr, 2020 at 1:31 AM
How to enable debug logging for pipeline jobs in Data Foundry
PROBLEM DESCRIPTION Sometimes, we need to change the pipeline build job log level to DEBUG mode to get more information. Steps to enable debug loggi...
Thu, 16 Apr, 2020 at 12:20 AM
Pipeline build job failed with Couldn't create directory /tmp/11ebaa21-bd81-4cf1-8cbb-614bc9e97864_resources
Problem Description: Pipeline build job failed with below exception, [pool-1-thread-1]:[05:25:32,369] [DEBUG] [SharedConnection] (SharedConnection.j...
Mon, 6 Apr, 2020 at 2:36 AM
IWX ZIW audit timestamp columns will be created as String datatype in Hive during Sqlserver ingestion
Problem Description: Sqlserver ingestion using JTDS driver will create Infoworks ZIW audit columns with string datatype instead of timestamp datatype. ...
Mon, 30 Mar, 2020 at 1:56 AM
Map operator initialization failed with OutOfMemoryError
Problem Description: The pipeline build job fails with the below error during the Map operator initialization with the below error. Caused by: java....
Thu, 20 Feb, 2020 at 11:32 PM
ParseException line 16:23 cannot recognize input near 'database' ':' 'string' in column specification
Problem Description: The REST API ingestion fails with the below error while creating the hive table. [ERROR] 2019-12-18 19:11:26,833 [pool-2-thread...
Thu, 19 Dec, 2019 at 4:18 AM