General

Placeholder for KB's articles

Ingestion is failing with java.lang.NoClassDefFoundError: com/jcraft/jsch/SftpProgressMonitor
Problem Description: Ingestion is failing with below error for CSV source(source file location is sftp) when the target is gs bucket, 21/04/07 10:23:03...
Fri, 9 Apr, 2021 at 9:47 PM
Is it possible to change domain of existing pipeline in IWX?
Description: Is it possible to migrate a pipeline created in one domain to another in the same IWX instance? A pipeline once created under a domain cann...
Fri, 9 Apr, 2021 at 4:53 PM
Incremental ingestion job failing with column modified error for teradata tables when the jdbc driver was upgraded to newer version
Problem Description: Incremental ingestion job failing with column modified error during the pre-job step for the Teradata tables when the JDBC driver f...
Tue, 30 Mar, 2021 at 4:39 PM
Spark configurations on Infoworks 3.1.x and 3.3.x
In Infoworks 3.1.2, when user runs the pipeline build with spark as execution engine then a spark job is submitted to perform the transformations on the dat...
Sun, 21 Mar, 2021 at 1:05 PM
Incremental ingestion failing with error during table crawl due to path /target_hdfs_path/table_id/merged/orc does not exist
Problem Description: Incremental ingestion failing with /<target_hdfs_path>/<table_id>/merged/orc does not exists. Sample stack trace looks ...
Sun, 21 Mar, 2021 at 12:38 PM
Authentication using LDAP fails with an authentication error
Problem Description: On Infoworks if the authentication is configured to use LDAP, sometimes the user may see an authentication failure when logging thr...
Tue, 16 Mar, 2021 at 7:28 AM
Pipeline build fails with "Too many open files" error
Problem statement: When user runs a considerable number (around 50) of pipeline builds with hive execution engine in parallel, the user may find that some p...
Tue, 9 Mar, 2021 at 1:14 PM
Scheduled workflow not getting triggered on time in IWX v4.2
Problem Description: A scheduled workflow will not get triggered on time if there are three or more workflows scheduled to run at the same point in time...
Wed, 5 May, 2021 at 2:18 PM
Oracle source Ingestion fails with java.sql.SQLException: ORA-28040: No matching authentication protocol
Problem Description: Oracle source ingestion job fails with the below error in the job log in Infoworks on Databricks. Caused by: org.apache.spark.Spark...
Fri, 26 Feb, 2021 at 5:34 PM
Infoworks users authentication using LDAP takes more than a minute
Problem Description: When Infoworks authentication is configured through LDAP authentication the time taken for user to login is more than a minute. ...
Fri, 19 Feb, 2021 at 9:10 AM