problem statement:

Zookeeper quorum hive connection JDBC url issue for hive source during test connection.


Solution:

a) Set a new class path in conf.properties file *iw_hive_schema_crawl_classpath* =

b) Copy paste the path from iw_jobs_classpath to iw_hive_schema_crawl_classpath

c) Remove lib/parquet-support/* from iw_hive_schema_crawl_classpath

d) Add hive/conf/ *and hive/lib* to iw_hive_schema_crawl_classpath

e) Add the admin config HIVE_METASTORE_URI and set it to thrift url.


Make sure that there is a '/' at the end of JDBC url.

Add the /opt/mapr/hive/hive-2.1/lib/* at the end of iw_hive_schema_crawl_classpath.

Finally iw_hive_schema_crawl_classpath should look something like below:

iw_hive_schema_crawl_classpath=/opt/infoworks/lib/jwt/*:/opt/mapr/lib/log4j-1.2.17.jar:/opt/infoworks/lib/schemacrawler-12.06.03-main/schemacrawler-12.06.03.jar:/opt/infoworks/lib/mongodb/mongo-java-driver-3.8.0.jar:/opt/infoworks/bin/tools.jar:/opt/infoworks/lib/exec/commons-exec-1.2.jar:/opt/infoworks/lib/teradata/tdgssconfig.jar:/opt/infoworks/lib/teradata/teradata-connector-1.1.1.jar:/opt/infoworks/lib/teradata/terajdbc4.jar:/opt/infoworks/lib/mongodblogger/logger.jar:/opt/infoworks/lib/mongodblogger/log4mongo-java-0.7.4.jar:/opt/infoworks/lib/antlr/*:/opt/infoworks/lib/jsqlparser/*:/opt/infoworks/lib/shared/*:/opt/mapr/hive/hive-2.1/lib//libthrift-0.9.3.jar:/opt/mapr/hive/hive-2.1/lib//httpclient-4.4.jar:/opt/mapr/hive/hive-2.1/lib//httpcore-4.4.jar:/opt/mapr/hive/hive-2.1/lib//hive-cli-2.1.1-mapr-1803.jar:/opt/mapr/hive/hive-2.1/lib//hive-service-2.1.1-mapr-1803.jar:/opt/mapr/hive/hive-2.1/lib/hive-metastore-2.1.1-mapr-1803.jar:/opt/mapr/hive/hive-2.1/lib//../hcatalog/share/hcatalog/hive-hcatalog-streaming-2.1.1-mapr-1803.jar:/opt/mapr/hive/hive-2.1/lib//libfb303-0.9.3.jar:/opt/mapr/hive/hive-2.1/hcatalog/share/hcatalog/*:/opt/mapr/hive/hive-2.1/conf:/opt/infoworks/lib/commons-lang3/*:/opt/infoworks/lib/sql-server-jtds-driver/jtds-1.3.1.jar:/etc/hive/conf:/opt/infoworks/lib/ignite/*:/opt/mapr/hive/hive-2.1/lib//datanucleus-core-4.1.17.jar:/opt/infoworks/platform/bin/notification-common.jar:/opt/infoworks/platform/bin/platform-common.jar:/opt/mapr/hive/hive-2.1/lib/*:/opt/mapr/hive/hive-2.1/conf/*:/opt/mapr/hive/hive-2.1/lib/*