1. Set itemView: android:clickable="false";
2.设置GridView:android:descendantFocusability="blocksDescendants"
3. Replace Button with normal View such as TextView
blocksDescendants: viewgroup will override subclass controls and get the focus directly