Point-Wise Conditional Diffusion Models