Incremental Update in Hive


#1

Hi,

Can anyone tell me the steps of Incremental update in Hive with an example ?

Thanks!
Siddharth


#2

@siddharthmahakur,

Incremental Import with Sqoop & Hive is possible but coming to “Incremental Update”, it needs a little work around. Like Hive transactional table. Because HDFS doesn’t support updates. Try Hive table with below settings:
ORC file format, bucketted, Transactional update. Then it will work for Incremental update.
Already i’m having some set of steps-by-step guide will share it shortly, meanwhile give it a try & let me know.