General

Placeholder for KB's articles

Sample Post Ingestion Hook Script
Description Post hook ingestion is a feature where you can provide bash scripts to be run after the ingestion job completes. The post hook runs in the s...
Sun, 12 Jul, 2020 at 11:32 PM
Script for deleting jobs in Databricks workspace for 1000 job limit/workspace
Problem Description Whenever we submit the Ingestion jobs, the Pipeline jobs or the Export Jobs from Infoworks, Infoworks runs these jobs on the Databri...
Thu, 9 Jul, 2020 at 9:45 AM
XML based rest API ingestion fails with java.lang.NoClassDefFoundError: org/json/XML
Problem Description XML based rest API ingestion fails with below error Caused by: java.util.concurrent.ExecutionException: Boxed Error at scala.co...
Fri, 10 Jul, 2020 at 12:44 AM
Unexpected character (') while crawling schema in REST API source
Problem Description: Schema crawl in REST API Generic source fails with the below error in $IW_HOME/platform/logs/queryservice.log 020-07-08 09:31:3...
Wed, 8 Jul, 2020 at 2:42 AM
Spark pipeline build job fails with SASL AUTHENTICATION ERROR
Problem Description: Spark pipeline build job fails with then below SASL Authentication error in the job log in Infoworks DataFoundry EMR 3.1.1. Fai...
Wed, 8 Jul, 2020 at 2:27 AM
Spark Pipeline build job process 0 records in Infoworks DataFoundry 3.1.1-EMR
Problem Description Pipeline build job will be successful but it will process 0 records in Infoworks DataFoundry 3.1.1-EMR Root cause: This iss...
Wed, 8 Jul, 2020 at 2:17 AM
Mongo HA Setup - Configure optimal oplog sizes
Problem Description  Infoworks mongo metadata database runs in a three node master slave setup when HA is enabled. If service on one node is down for an...
Wed, 8 Jul, 2020 at 9:27 PM
Fetch new tables or Recrawl metadata gets aborted
Problem Description  Fetch new tables or recrawl metadata job gets aborted with following error message Source refers to one or more tables that do not ...
Fri, 3 Jul, 2020 at 8:19 AM
DataFoundry UI does not display metrics on the Dashboard tab with Mixed Content Exception on browser
Problem Description Metrics on the Dashboard tab are not displayed on DatafFoundry UI with a mixed content exception on the web browser.   For...
Thu, 2 Jul, 2020 at 4:10 PM
Unable to launch clusters due to quota limit
Problem Description  Infoworks jobs failing due to the below error, "Cloud Provider Launch Failure: A cloud provider error was encountered while s...
Thu, 2 Jul, 2020 at 12:43 AM