Infoworks

Part 1: Creating a Databricks Job to Run a Notebook 1: Create the Notebook in Databricks Open your Databricks workspace. Navigate to the Workspace secti...

Check if Docker Installed: Ensure that Docker is installed on your system. You can verify this by running: docker --version Create Dockerfil...

Issue 1: Pods fails to come up with CreateContainerConfigError. Error Message: failed to prepare subPath for volumeMount "dit-diyprod-rel-a-logs"...

Problem Character encoding issues can sometimes cause errors during data ingestion from an IBM DB2 database. These errors are typically related to data in ...

This is due to Spark 2.X's legacy calendar. Please add the below Spark configuration to your pipeline job and retry the job Key:iw_spark_app_co...

After running several internal tests with both the Direct load and Indirect load options, we have observed the following performance results: Please no...

Infoworks/ Replicator jobs failing with below error is due to expiry of the configured Service Account in the Infoworks/ Replicator jobs or custom script in...

Python script(attached) to extract user details.  Exported fields:  id, roles, name, email,accessible_domains,created_at,last_login_details Infowork...

This document describes the services that are a part of the Infoworks application and their corresponding log location: User Interface (UI):  This Compon...

Below is a script to monitor for active EMR job drivers that start with "ClusterJobDriver_". At any given time there should be only one "Clus...