Problem Description:


Spark pipeline build fails with the below error in the job log.


[pool-1-thread-1]:[16:33:44,999] [DEBUG] [AwbUtil] (AwbUtil.java:140) - stacktrace java.lang.NoSuchMethodError: com.fasterxml.jackson.databind.JsonMappingException.<init>(Ljava/io/Closeable;Ljava/lang/String;)V


Root cause:


This issue occurs if an incorrect/old Jackson-databind jar is getting picked up (which does not have the Closeable method) during the pipeline build job.


Solution:


Perform the below steps to resolve this issue.
a) cd /opt/infoworks/conf
b) Open the conf.properties file and add locate df_batch_classpath.
c) Append /usr/hdp/current/spark2-client/jars/* in the beginning of the df_batch_classpath 
d) Save the file and run the pipeline build job.

Applicable Infoworks versions:


IWX v2.4.x,2.5.x,2.6.x,2.7.x,2.8.x