Spark pipeline build fails with the below error in the job log.
[pool-1-thread-1]:[16:33:44,999] [DEBUG] [AwbUtil] (AwbUtil.java:140) - stacktrace java.lang.NoSuchMethodError: com.fasterxml.jackson.databind.JsonMappingException.<init>(Ljava/io/Closeable;Ljava/lang/String;)V
This issue occurs if an incorrect/old Jackson-databind jar is getting picked up (which does not have the Closeable method) during the pipeline build job.
Perform the below steps to resolve this issue.
a) cd /opt/infoworks/conf
b) Open the conf.properties file and add locate df_batch_classpath.
c) Append /usr/hdp/current/spark2-client/jars/* in the beginning of the df_batch_classpath
d) Save the file and run the pipeline build job.
Applicable Infoworks versions: