Revisiting Spatial Invariance with Low Rank Local Connectivity