Designing a house with AI
Introducing the modwell design quiz
Jonathan led Modwell’s generative AI initiative with a vision to transform real estate interactions through dynamic content creation, personalized design guidance, and user-friendly search experiences. Under his direction, Modwell developed a custom large language model fine-tuned on various architectural design styles, encompassing both interior and exterior aesthetics.
Jonathan designed a custom design quiz powered by this model, enabling users to discover and define their unique design preferences.
Training a custom LLM
Fine tuned model training
By deconstructing architecture into individual components—such as flooring, cabinetry, roof styles, and facades—Jonathan and his ML specialists created a comprehensive model that could generate highly nuanced responses, reflecting the broad spectrum of design options available in residential real estate.
Producing Synthetic Data
Creating Synthetic AI Content
His team also reverse-engineered housing metadata to generate synthetic data and create diverse, regionally tailored house designs. These innovations streamlined the process of producing visual and interactive real estate content. Through this custom model, Modwell could generate diverse, style-specific content tailored to users' preferences, significantly enhancing both the search and visualization experience.
Jonathan’s AI-driven approach allowed his team to leverage a range of mediums, including text-to-image generation to streamline rendering processes, image-to-video tools for social and marketing materials, and video-to-3D models to support a lightweight 3D mapping solution. Together, these methods created an immersive experience for users while reducing the time and resources typically required for high-quality content creation.
Text to image prompt
Prompt Engineering
Leveraged text to image AI prompting to create renderings and static content.
Image to Video prompt
Prompt Engineering
Leveraged text and image to video AI prompting to create activated video content.
Video to 3D Prompt
Prompt Engineering
Leveraged Image and Video to 3D AI Prompting to create interactive experiences.
Designing for brands with AI
Jonathan also expanded Modwell’s generative AI capabilities to offer white-label content solutions tailored to individual brands. From developing a proof-of-concept for a back-to-college experience to creating brand-specific environments, he ensured that each design maintained a clear alignment with the brand’s ethos and identity.
Brand specific curated experiences
This required a delicate balance of creativity and precision, iterating rapidly with AI tools to deliver content that felt authentic and fully integrated into each brand’s vision.
Dynamic, intelligent user journeys
Building brand personas
Embracing the future of AI-driven engagement, Jonathan launched custom AI avatars to provide users with a unique interactive experience. He began by cloning himself, creating a lifelike digital avatar using NVIDIA ACE and Unreal Engine’s Metahuman Creator, a foundational step towards deploying personalized AI avatars.
Deploying Custom GPT Avatars
_pn.png)
These digital representatives allowed users to engage directly with AI-driven interfaces, setting the stage for an era where brand and personal avatars, connected to fine-tuned intelligence models, will redefine user engagement.
Jonathan’s vision extends beyond traditional media, positioning Modwell to pioneer the use of 3D and AI avatars, transforming not only how users experience real estate but also how they interact within immersive, AI-enhanced digital environments.
Explore Jonathans Custom GPTS
Creative architect generating home visuals based on client's design style
Real estate appraisal support using market comparables
Friendly real estate navigator guiding users to ideal home listings
