Description:

In 5.0.1-dataproc environment, when we set minimum worker count > 2, jobs were failing with below error,

[ERROR] 2021-09-01 08:12:43,034 [pool-11-thread-1] io.infoworks.platform.job.dispatcher.core.cluster.impl.dataproc.DataprocCluster:207 :: Failed to create dataproc cluster:java.util.concurrent.ExecutionException: com.google.api.gax.rpc.InvalidArgumentException: io.grpc.StatusRuntimeException: INVALID_ARGUMENT: Requested number of primary workers must be within autoscaler min/max range (5, 10). Requested: 2at com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:502)at com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:481

This is a proper code bug and to resolve this one needs to perform the below-mentioned steps.

JIRA: https://infoworks.atlassian.net/browse/IPD-15261


Steps:

1) stop all services
2) su infoworks
3) cd /opt/infoworks/platform/bin/
4) mv dispatcher-core.jar /tmp/dispatcher-core.jar.bak
5) wget https://iw-saas-setup.s3.us-west-2.amazonaws.com/5.0.1/patch/dispatcher-core.jar
6) sudo chown infoworks:infoworks dispatcher-core.jar (3467634466 445932 dispatcher-core.jar)
7) start all services


Applicable IWX versions:

5.0.1-dataproc