Problem Description:

Spark pipeline build fails with the below error in the job log.

[pool-1-thread-1]:[16:33:44,999] [DEBUG] [AwbUtil] ( - stacktrace java.lang.NoSuchMethodError: com.fasterxml.jackson.databind.JsonMappingException.<init>(Ljava/io/Closeable;Ljava/lang/String;)V

Root cause:

This issue occurs if an incorrect/old Jackson-databind jar is getting picked up (which does not have the Closeable method) during the pipeline build job.


Perform the below steps to resolve this issue.
a) cd /opt/infoworks/conf
b) Open the file and add locate df_batch_classpath.
c) Append /usr/hdp/current/spark2-client/jars/* in the beginning of the df_batch_classpath 
d) Save the file and run the pipeline build job.

Applicable Infoworks versions:

IWX v2.4.x,2.5.x,2.6.x,2.7.x,2.8.x