Problem Description


The date value will be ingested incorrectly for a DFI ingestion. The source CSV file has 0001-01-01 as the date and it will be converted to 0001-01-03 in the hive after ingestion.


Date value in the source file:


0001-01-01


Data in hive table post ingestion:


>select ITEM_1ST_SOLD_DT from test_date;

-------------------+

item_1st_sold_dt

-------------------+

0001-01-03


The day value will be changed from 01 to 03


Root cause


This issue occurs if the timezone of the target hive machine is of different time zone than source machine which is Infoworks Edge node in this case.


Solution


Set the below Advanced configuration at the Source level and run the ingestion job again to resolve this issue.


Go to the Source>Advanced configurations, set the below configuration


key: PARSE_TIME_AS_LOCALTIME

value: true


Note: This configuration is available at Table,Source and Global levels.


Applies to Infoworks ADE versions:


v2.3.x,v2.4.x,2.5.x,2.7.x