Infoworks

General 80

• Triggering Databricks Notebook from Infoworks Bash Node
• Custom docker image
• Common infrastructure issues during Infoworks Installation on AKS
• IBM DB2 ingestion job fails with CharConversionException
• Pipeline Job failing with Dates older than '1582-10-15' or Timestamp older than ‘1900-01-01 00:00:00.0'

View all 80

How-to 28

• Add a new streaming extension to configure the custom deserializer for Kafka ingestion
• How to add Infoworks audit columns to custom target tables
• How to configure custom Spark settings at Cluster template
• How to add a new region for AWS Databricks in Infoworks
• SAML integration with Okta

View all 28

Infoworks Guides 2

• The Guide for Infoworks DataFoundry on Databricks logs
• The Guide for Infoworks DataFoundry logs (GCP, HDI, CDH, AZURE, EMR)

Generic JDBC 9

• How to setup CDATA Google Analytics Source
• How to set up Generic JDBC Rest source in IWX on Databricks
• Setting Up Survey Monkey Source
• Setting Up HubSpot Source
• How to perfrom rest ingestion using Generic JDBC source with OAuth authentication

View all 9

FAQs 9

• Does Infoworks reads the masked data from source and pass the same to the target system?
• If there is a schema or column change in the source, how does Infoworks handle it?
• If there are no timestamp columns in the source how does the watermark works? Does it handle or need a watermark column?
• After a table is ingested to a target, is it possible to re-ingest only a subset of columns or un-exclude additional source columns without re-ingesting the entire table?
• After data is ingested to a Data Lakehouse, what happens if the data is structurally modified by a process outside of Infoworks and the metastore records are changed?

View all 9