This paper focuses on face spoofing detection using video. The purpose is to find out the best scheme for this task in the end-to-end learning manner. We investigate 4 different types of structure to fully exploit the raw data in its spatial-temporal domain, which are the pure CNN, CNN with 3D convolu-tion, CNN+LSTM and CNN+Conv-LSTM. Moreover, anoth-er stream built on optical flow is also used, and with a proper fusion method, it can improve the accuracy. In experiments, we compare schemes on the raw data in single stream and fusion methods with optical flow in two streams. The perfor-mance are not only given within each dataset, but also mea-sured across different datsets, which is crucial to avoid the overfitting.