[KDD 2020] CurvaNet: Geometric Deep Learning based on Multi-scale Directional Curvature for 3D Shape Analysis
Aug 13, 20204 views
Over the last decade, deep learning research has achieved tremendous success in computer vision and natural language processing.,The current widely successful deep learning models are largely,based on convolution and pooling operations on a Euclidean plane,with a regular grid (e.g., image and video data) and thus cannot,be directly applied to the non-Euclidean surface. Geometric deep,learning aims to fill the gap by generalizing deep learning models,from a 2D Euclidean plane to a 3D geometric surface. The problem,has important applications in human-computer interaction, biochemistry, and mechanical engineering, but is uniquely challenging,due to the lack of a regular grid framework and the difficulties in,learning geometric features on a non-Euclidean manifold. Existing,works focus on generalizing deep learning models from 2D image,to graphs (e.g., graph neural networks) or 3D mesh surfaces but,without fully learning geometric features from a differential geometry perspective. In contrast, this paper proposes a novel geometric,deep learning model called CurvaNet that integrates differential,geometry with graph neural networks. The key idea is to learn,direction sensitive 3D shape features through directional curvature,filters. We design a U-Net like architecture with downsampling and,upsampling paths based on mesh pooling and unpooling operations.,Evaluation on real-world datasets shows that the proposed model,outperforms several baseline methods in classification accuracy.