3D Diffusion Models for Generating and Understanding 3D Scenes. Diffusion models, such as DALL-E2 and Imagen, have achieved remarkable success in generating photorealistic images and hold promise to s

Description

3D Diffusion Models for Generating and Understanding 3D Scenes. Diffusion models, such as DALL-E2 and Imagen, have achieved remarkable success in generating photorealistic images and hold promise to solve long-standing computer vision problems. However, 3D scene generation remains unexplored. This research project aims to bridge the gap by developing 3D diffusion models capable of generating complete 3D scenes. This will advance our theoretical understanding of diffusion in complex 3D environments and open up new possibilities for applications in fields such as virtual reality, architecture, and city planning. The proposed 3D diffusion models will also enhance the accuracy of computer vision tasks related to 3D scene understanding, such as object detection, tracking, and semantic segmentation.. Scheme: Discovery Projects. Field: 4603 - Computer Vision and Multimedia Computation. Lead: Prof Ajmal Mian