Search for a command to run...
Series
In this series we will be learning Hive from scratch. Hopefully I will be covering all the topics...
Why Hive? In Big Data ecosystem we have 3 main components, Distributed File System - Storage Layer Map Reduce - Processing Engine YARN - Resource Manager Before Hive we(Data folks) used Java as a scripting tool to interact with these components. Bu...
There are two type of Tables available in Hive Data warehouse. 1. Internal Table All the meta definition are maintained by Hive Actual Data resides on Hive Data warehouse. Steps to load: We can directly load data to table 2. External Table All t...
Hive Files: There are two type of data store method, one is Row-Columnar store and Columnar store. Parquet file It is suitable for spark data processing, and columnar based data store. ORC file It is suitable for hive and it also a columnar data st...
Hive SerDe Hive uses SerDe and File format for IO operations on HDFS. Serialization -> Converting Java Objects into bytes(String or Binary data) De-serialization ->Converting bytes into Java Objects. Hive uses inbuilt library for this kind of operat...
Hive Partition For efficient data analysis and loading we need partition in Hive, not only hive partition concept can be applicable in all other data platforms. In Hive we can load only structured data, in that we can choose partitions in available c...