Play all

Intro

MVDream: what is it/what does it solve?

Dataset Overview

Camera settings explanation

Multiview perspective

Multiview 2D code dive

Camera embedding

Camera utils

Setting up MVDream 2D environment

Trying out the Gradio server

Start of MVDream-threestudio

Setting up Docker environment for MVDream-threestudio

Explaining why the gradio server for 3D is not usable

Generating NeRFs through CLI

Exporting meshes

Evaluating MVDream mesh fidelity

Second stage refinement and why I don't recommend it

Redesign from refinement = unusable

Showing some other NeRF to 3D mesh objects

Rendering out a 3D object

Using 3D renders as ControlNet guides

Worldbuilding overview context

Potential room designs

Potential chair designs

Generating albedo map texture in ComfyUI

Using Adobe 3D Sampler to convert albedo into PBR textures

Quick setup of converted PBR textures

Using same process to generate metal textures

Quick overview of using Cube by CSM to convert a picture to a mesh

Checking refined mesh from Cube

Closing thoughts

Description:

Dive into a comprehensive tutorial on MVDream, a unique text-to-3D model, and explore its application in worldbuilding with 3D and AI. Learn about the theory, setup, and usage of MVDream repositories, focusing on creating a character's living space. Discover how to generate 3D objects from single images, export meshes, and refine them. Explore techniques for rendering 3D objects, using ControlNet guides, and generating textures with ComfyUI and Adobe 3D Sampler. Gain insights into the potential of AI-assisted worldbuilding and conceptual design for intellectual property development.

Stable Diffusion: Worldbuilding with 3D and AI Using MVDream - Part 1

kasukanra

Add to list

#Computer Science #Deep Learning #Stable Diffusion #Artificial Intelligence #Neural Networks #ControlNet #Art & Design #Visual Arts #3D Design #3d Modeling #Humanities #Grammar & Writing #Creative Writing #Worldbuilding #Computer Vision #AI Image Generation #ComfyUI