General

Placeholder for KB's articles

IBM DB2 ingestion job fails with CharConversionException
Problem Character encoding issues can sometimes cause errors during data ingestion from an IBM DB2 database. These errors are typically related to data in ...
Thu, 2 Nov, 2023 at 2:55 AM
Pipeline Job failing with Dates older than '1582-10-15' or Timestamp older than ‘1900-01-01 00:00:00.0'
This is due to Spark 2.X's legacy calendar. Please add the below Spark configuration to your pipeline job and retry the job Key:iw_spark_app_co...
Fri, 22 Sep, 2023 at 9:19 AM
Write to BQ jobs, Direct load and Indirect load options
After running several internal tests with both the Direct load and Indirect load options, we have observed the following performance results: Please no...
Tue, 22 Aug, 2023 at 11:29 PM
Jobs failing with "Invalid JWT Signature."
Infoworks/ Replicator jobs failing with below error is due to expiry of the configured Service Account in the Infoworks/ Replicator jobs or custom script in...
Tue, 22 Aug, 2023 at 11:20 PM
Export list of Infoworks users and accessible domains to CSV
Python script(attached) to extract user details.  Exported fields:  id, roles, name, email,accessible_domains,created_at,last_login_details Infowork...
Tue, 8 Aug, 2023 at 10:39 PM
Infoworks Services Information & Log Locations
This document describes the services that are a part of the Infoworks application and their corresponding log location: User Interface (UI):  This Compon...
Thu, 3 Aug, 2023 at 1:20 PM
Monitor active job drivers for EMR cluster
Below is a script to monitor for active EMR job drivers that start with "ClusterJobDriver_". At any given time there should be only one "Clus...
Thu, 8 Jun, 2023 at 3:38 AM
Sync to Target (Teradata failing)
Problem Statement: Whenever Sync to target to Teradata fails with the below error because of TERADATA FASTLOAD. This is the Fastload issue. Error: Cau...
Tue, 25 Apr, 2023 at 5:31 PM
Compare configuration files before and after upgrade
# Script to compare the same files in 2 directories.  # List of files that need to be compared needs to passed as a separate file # The script takes input...
Fri, 30 Jun, 2023 at 5:58 AM
Troubleshoot row count mismatches for replicated tables
Scenario 1: Row count for the table replicated on dataproc hive is not matching with row count of the table in on-premise HDP hive. When user submits a &qu...
Fri, 3 Feb, 2023 at 3:39 PM