General

Placeholder for KB's articles

Is it possible to change domain of existing pipeline in IWX?
Description: Is it possible to migrate a pipeline created in one domain to another in the same IWX instance? A pipeline once created under a domain cann...
Fri, 9 Apr, 2021 at 4:53 PM
Pipeline build job takes more time to finish when the dynamic allocation of executors is enabled in IWX o
Problem Description: Pipeline build job on IWX installed on EMR with Spark as the execution engine takes more (more than 8 hours) time while processing ...
Tue, 30 Mar, 2021 at 4:59 PM
Incremental ingestion job failing with column modified error for teradata tables when the jdbc driver was upgraded to newer version
Problem Description: Incremental ingestion job failing with column modified error during the pre-job step for the Teradata tables when the JDBC driver f...
Tue, 30 Mar, 2021 at 4:39 PM
javax.security.auth.login.LoginException: Unable to obtain password from user during Pipeline build job in kerberos enabled hadoop environments
Problem Description: Pipeline build job in Infoworks fails with the below error in the job log. io.infoworks.platform.common.exception.IWException: Logi...
Wed, 24 Mar, 2021 at 12:54 PM
Spark configurations on Infoworks 3.1.x and 3.3.x
In Infoworks 3.1.2, when user runs the pipeline build with spark as execution engine then a spark job is submitted to perform the transformations on the dat...
Sun, 21 Mar, 2021 at 1:05 PM
Incremental ingestion failing with error during table crawl due to path /target_hdfs_path/table_id/merged/orc does not exist
Problem Description: Incremental ingestion failing with /<target_hdfs_path>/<table_id>/merged/orc does not exists. Sample stack trace looks ...
Sun, 21 Mar, 2021 at 12:38 PM
Pipeline build job fails with Exit code 137 in Yarn logs in IWX on EMR
Problem Description Pipeline build job in IWX on EMR fails with the below ERROR in the yarn logs. 21/03/15 13:41:38 WARN YarnAllocator: Container fr...
Wed, 17 Mar, 2021 at 2:56 PM
Authentication using LDAP fails with an authentication error
Problem Description: On Infoworks if the authentication is configured to use LDAP, sometimes the user may see an authentication failure when logging thr...
Tue, 16 Mar, 2021 at 7:28 AM
Pipeline build fails with "Too many open files" error
Problem statement: When user runs a considerable number (around 50) of pipeline builds with hive execution engine in parallel, the user may find that some p...
Tue, 9 Mar, 2021 at 1:14 PM
Scheduled workflow not getting triggered on time in IWX v4.2
Problem Description: A scheduled workflow will not get triggered on time if there are three or more workflows scheduled to run at the same point in time...
Wed, 5 May, 2021 at 2:18 PM