General

Placeholder for KB's articles

Sync to Target (Teradata failing)
Problem Statement: Whenever Sync to target to Teradata fails with the below error because of TERADATA FASTLOAD. This is the Fastload issue. Error: Cau...
Tue, 25 Apr, 2023 at 5:31 PM
Compare configuration files before and after upgrade
# Script to compare the same files in 2 directories.  # List of files that need to be compared needs to passed as a separate file # The script takes input...
Fri, 30 Jun, 2023 at 5:58 AM
Troubleshoot row count mismatches for replicated tables
Scenario 1: Row count for the table replicated on dataproc hive is not matching with row count of the table in on-premise HDP hive. When user submits a &qu...
Fri, 3 Feb, 2023 at 3:39 PM
Troubleshoot schema related errors for replicated tables
Problem statement: Pipeline using replicated tables as source tables may fail with below error similar to the show below. Caused by: java.lang.ClassCastE...
Fri, 3 Feb, 2023 at 3:07 PM
Provisioning Dataproc Cluster's with custom machine image through Infoworks
Creating a custom Dataproc Image Google provides an option to launch a Dataproc cluster with a custom machine image Custom machine image will decre...
Wed, 5 Jul, 2023 at 10:28 PM
Steps to Update Databricks Token on IWX Version 5.2.0
This Article has the steps document to update Databricks token IWX Version 5.2.0 Instructions Prerequisites This script must be run on a VM becaus...
Wed, 24 Aug, 2022 at 7:34 PM
How to add labels for Dataproc Ephemeral clusters launched by Ingestion jobs?
Problem: I would like to add labels to Dataproc Cluster launched by Infowokrs ingestion jobs Solution: Infoworks provides a pre ingestion jo...
Fri, 13 May, 2022 at 9:21 AM
How to update the default autoscaling policy for Dataproc Ephemeral clusters ?
Problem: I would like to use a custom autoscaling policy for my Dataproc Cluster for Ephemeral jobs or I would like to use secondary worker nodes for th...
Wed, 11 May, 2022 at 8:28 PM
How to use custom user defined functions in pipelines?
Problem Description: I would like to use a custom UDF in Infoworks Pipelines Solution: You could use custom user-defined functions after regi...
Wed, 11 May, 2022 at 12:02 AM
Delegation token expiry
Infoworks uses a JWT token for internal services communication, this token has to be updated by March 8th, 2022 Effected Infoworks Versions: 2.9.x,3....
Wed, 18 May, 2022 at 1:08 PM