Infoworks

General 84

• Optimizing Ingestion Performance and Reducing Cluster Costs Using Split-By and Table Group Parallelism in Infoworks
• Databricks Cluster Launch Fails Due to Cluster Policy Mismatch
• "Test Connection" Fails from Infoworks to Data Source
• Troubleshooting Insufficient Privileges for Snowflake Roles
• Triggering Databricks Notebook from Infoworks Bash Node

See all 84 articles

How-to 28

• Add a new streaming extension to configure the custom deserializer for Kafka ingestion
• How to add Infoworks audit columns to custom target tables
• How to configure custom Spark settings at Cluster template
• How to add a new region for AWS Databricks in Infoworks
• SAML integration with Okta

See all 28 articles

Infoworks Guides 2

• The Guide for Infoworks DataFoundry on Databricks logs
• The Guide for Infoworks DataFoundry logs (GCP, HDI, CDH, AZURE, EMR)

Generic JDBC 9

• How to setup CDATA Google Analytics Source
• How to set up Generic JDBC Rest source in IWX on Databricks
• Setting Up Survey Monkey Source
• Setting Up HubSpot Source
• How to perfrom rest ingestion using Generic JDBC source with OAuth authentication

See all 9 articles

FAQs 9

• Does Infoworks reads the masked data from source and pass the same to the target system?
• If there is a schema or column change in the source, how does Infoworks handle it?
• If there are no timestamp columns in the source how does the watermark works? Does it handle or need a watermark column?
• After a table is ingested to a target, is it possible to re-ingest only a subset of columns or un-exclude additional source columns without re-ingesting the entire table?
• After data is ingested to a Data Lakehouse, what happens if the data is structurally modified by a process outside of Infoworks and the metastore records are changed?

See all 9 articles