SUTDxSUNS Spatial Project: A 2.5D Control Generator

Status

Currently ongoing - will be completed by the 17th of December

Demo

Try out the prototype on COLAB

Project Description

This project was for a short-term design studio that required applied deep learning and linking of existing models for spatial design. Special thanks to SUNS for providing us with data. The controlnet training model and generation code is credited to fffiloni, while the depthmap generation to GLTF model is credited to Radamés Ajna.

Training model Generation model 3D Depth model

Pipeline

Key Features

• User-Friendly Training Interface for non-developers

• Text-to-Image Generation with control

• Specific Training Data

• 2.5D Visualisation B