Hive_HIVE optimization guide_scene eight_data cropping problem

 

Hive optimization, outline address:

https://blog.csdn.net/u010003835/article/details/105334641

 

 

Test Data 

 

 

 

Scene 8_Data cropping problem

 

1) Record number cropping

   i. Build through the advantages of partitioning and bucket table 

  ii. Remove the invalid records through the filtering conditions, so that the invalid data is eliminated in the map stage

2) Column cropping

 i. Eliminate invalid, non-calculated column data

 ii. Use columnar storage