metadata
license: other
license_name: flux-1-dev-non-commercial-license
license_link: >-
https://github.com/black-forest-labs/flux/blob/main/model_licenses/LICENSE-FLUX1-dev
base_model:
- black-forest-labs/FLUX.1-dev
tags:
- flux
- flux-diffusers
- image-to-image
- diffusers
- lora
pipeline_tag: image-to-image
library_name: diffusers
widget:
- src: assets/input1.png
text: >-
A modern living room features a clean and minimalist design. On the left,
a light beige wall houses a built-in shelving unit with a textured,
neutral finish, adorned with a few decorative items. The right wall
showcases a ribbed, light gray panel with a built-in storage unit below.
The floor is covered with a light beige carpet, which extends into the
midground where a beige sofa with patterned throw pillows is positioned. A
small round ottoman sits in front of the sofa, adding a cozy touch. In the
background, large windows with sheer curtains allow natural light to flood
the room, highlighting the light gray curtains and the greenery outside. A
tall, narrow plant stand with a potted plant stands beside the window,
adding a touch of nature. The ceiling features a circular chandelier with
a modern design, casting a warm glow over the space.
output:
url: assets/teaser1.png
- src: assets/input2.png
text: >-
A contemporary bedroom features a large, plush bed with a white and gray
upholstered headboard and matching bedding. The bed is positioned
centrally, flanked by two nightstands with modern, metallic lamps. The
walls are finished in light gray paneling, creating a clean and minimalist
backdrop. A large window on the left side of the room allows natural light
to flood in, with sheer curtains partially drawn to diffuse the sunlight.
The flooring is a smooth, light gray tile that reflects the ambient light,
enhancing the room's bright and airy feel. The artwork above the bed is a
modern abstract piece, featuring a circular design with a mix of dark and
light tones, adding a touch of sophistication to the space.
output:
url: assets/teaser2.png
- src: assets/input3.png
text: >-
A contemporary bedroom features a large bed positioned centrally, with a
soft, light gray upholstered headboard. The bed is dressed in crisp white
linens, accented by a beige throw blanket with a textured pattern.
Flanking the bed are two gray pillows, adding a subtle contrast. Above the
bed, a minimalist abstract painting with gold and gray tones hangs on the
white wall. The room is bathed in natural light streaming through a large
window with sheer white curtains, which are drawn back to reveal a
black-framed view outside. The light wooden flooring complements the
serene and modern aesthetic of the space.
output:
url: assets/teaser3.png
- src: assets/input4.png
text: >-
A modern dining area features a sleek, dark wood dining table with a
minimalist design, flanked by six matching chairs with light brown
upholstery. The table is positioned in the foreground, with a large window
on the left side allowing natural light to flood the space. The midground
showcases a built-in storage unit with glass and wood paneling, housing
various decorative items and wine glasses. The background reveals a
polished tile floor that extends throughout the room, with a light gray
and white color scheme that enhances the contemporary aesthetic. The
ceiling is adorned with recessed lighting, casting a soft glow over the
dining area, while the large window on the left provides ample daylight,
creating a bright and airy atmosphere.
output:
url: assets/teaser4.png
FLUX.1-Wireframe-dev-lora for SpatialGen
FLUX.1 Wireframe [dev] LoRA is an improved version of FLUX.1-Layout-ControlNet, which serves as a key component of the SpatialGen. FLUX.1 Wireframe [dev] LoRA is a LoRA for FLUX.1 [dev], capable of generating an image based on a text description while following the structure of the given wireframe image.
- Prompt
- A modern living room features a clean and minimalist design. On the left, a light beige wall houses a built-in shelving unit with a textured, neutral finish, adorned with a few decorative items. The right wall showcases a ribbed, light gray panel with a built-in storage unit below. The floor is covered with a light beige carpet, which extends into the midground where a beige sofa with patterned throw pillows is positioned. A small round ottoman sits in front of the sofa, adding a cozy touch. In the background, large windows with sheer curtains allow natural light to flood the room, highlighting the light gray curtains and the greenery outside. A tall, narrow plant stand with a potted plant stands beside the window, adding a touch of nature. The ceiling features a circular chandelier with a modern design, casting a warm glow over the space.
- Prompt
- A contemporary bedroom features a large, plush bed with a white and gray upholstered headboard and matching bedding. The bed is positioned centrally, flanked by two nightstands with modern, metallic lamps. The walls are finished in light gray paneling, creating a clean and minimalist backdrop. A large window on the left side of the room allows natural light to flood in, with sheer curtains partially drawn to diffuse the sunlight. The flooring is a smooth, light gray tile that reflects the ambient light, enhancing the room's bright and airy feel. The artwork above the bed is a modern abstract piece, featuring a circular design with a mix of dark and light tones, adding a touch of sophistication to the space.
- Prompt
- A contemporary bedroom features a large bed positioned centrally, with a soft, light gray upholstered headboard. The bed is dressed in crisp white linens, accented by a beige throw blanket with a textured pattern. Flanking the bed are two gray pillows, adding a subtle contrast. Above the bed, a minimalist abstract painting with gold and gray tones hangs on the white wall. The room is bathed in natural light streaming through a large window with sheer white curtains, which are drawn back to reveal a black-framed view outside. The light wooden flooring complements the serene and modern aesthetic of the space.
- Prompt
- A modern dining area features a sleek, dark wood dining table with a minimalist design, flanked by six matching chairs with light brown upholstery. The table is positioned in the foreground, with a large window on the left side allowing natural light to flood the space. The midground showcases a built-in storage unit with glass and wood paneling, housing various decorative items and wine glasses. The background reveals a polished tile floor that extends throughout the room, with a light gray and white color scheme that enhances the contemporary aesthetic. The ceiling is adorned with recessed lighting, casting a soft glow over the dining area, while the large window on the left provides ample daylight, creating a bright and airy atmosphere.
Diffusers
import torch
from diffusers.pipelines.flux.pipeline_flux_control import FluxControlPipeline
from diffusers.utils import load_image
pipe = FluxControlPipeline.from_pretrained(
"black-forest-labs/FLUX.1-dev",
torch_dtype=torch.bfloat16,
)
pipe.load_lora_weights("manycore-research/FLUX.1-Wireframe-dev-lora")
pipe = pipe.to("cuda")
control_image = load_image(
"https://huggingface.co/manycore-research/FLUX.1-Wireframe-dev-lora/resolve/main/assets/input1.png"
)
prompt = "A modern living room features a clean and minimalist design. On the left, a light beige wall houses a built-in shelving unit with a textured, neutral finish, adorned with a few decorative items. The right wall showcases a ribbed, light gray panel with a built-in storage unit below. The floor is covered with a light beige carpet, which extends into the midground where a beige sofa with patterned throw pillows is positioned. A small round ottoman sits in front of the sofa, adding a cozy touch. In the background, large windows with sheer curtains allow natural light to flood the room, highlighting the light gray curtains and the greenery outside. A tall, narrow plant stand with a potted plant stands beside the window, adding a touch of nature. The ceiling features a circular chandelier with a modern design, casting a warm glow over the space."
image = pipe(
prompt=prompt,
control_image=control_image,
num_inference_steps=20,
generator=torch.Generator(device="cpu").manual_seed(42),
height=512,
width=512,
guidance_scale=10.0,
).images[0]
image.save("output.png")
LICENSE
FLUX.1-Wireframe-dev-lora is licensed under the FLUX.1-dev Non-Commercial License.