PROBLEM DESCRIPTION


Please refer this article in order to clear the jars shipped from Infoworks ADE from Hadoop/HDFS cache.


WORKAROUND/ RESOLUTION


Please follow the below steps,

  1. Login to the Infoworks edge node
  2. Please execute the below commands
    cd $IW_HOME/bin
    source env.sh
    ./stop.sh hangman
    cd $IW_HOME/conf
    cat conf.properties | grep hdfs_temp

    Note: Make sure no infoworks Jobs are running in Infoworks UI by looking into Job queue from Admin page

Example:

Assuming the output of cat conf.properties | grep hdfs_temp to be output_of_step_2,

hadoop fs -rm -R  output_of_step_2/iwjobs/libjars/opt/infoworks/

[For Ingestion and related jars]

hadoop fs -rm -R output_of_step_2/udfs/opt/infoworks

[For UDF and related jars]

     

       3. Start the hangman by executing the below commands 

cd $IW_HOME/bin
source env.sh
./start.sh hangman

     

        4. Go to Infoworks UI and re-run the job.