Image denoising methods based on deep learning have effectively solved the problems of cumbersome parameter tuning and complex noise modeling in traditional denoising methods. However, the model training of supervised learning relies heavily on pairs of clean and noisy images, which limits the wide application of such models. Unsupervised learning denoising models only require single noisy images for training, but the existing unsupervised denoising methods still have the problem that it is difficult to balance network training efficiency and denoising performance.In this paper, we propose an efficient image denoising method, which improves the efficiency of denoising model training. Specifically, this method proposes a deep neighbor downsampler, which is used to obtain similar image pairs for training the noise model from the same noisy image. Our proposed sampler method not only meets the requirements that the pixels of the image pairs are adjacent and the appearances are similar, but also the deep neighbor downsampling discards some redundant information and avoids heavy dependence on assumptions about the noise distribution.Finally, we verify the effectiveness of our method through synthetic experiments with different noise distributions in the sRGB space and real image experiments. The experimental results confirm that the sampling strategy we proposed effectively overcomes the balance problem between training efficiency and denoising performance.