Point cloud are precise digital record of an objects in space. It starts to getting more attention due to the additional information it provides compared to 2D images. In this paper, we propose a new deep learning architecture called R-CovNets, designed for 3D object recognition. Unlike to previous approaches that usually sample or convert point cloud into three-dimensional grids, R-CovNets does not reckon on any preprocessing. Our architecture is specially designed for cloud point, permutation invariant and can take as input, a data of any size. In our experiments with a series of well-known benchmarks, R-CovNets achieves state-of-art performances.