Lesson 2 of 7 · 16 min
AI Image Generation — Midjourney, DALL-E, and Stable Diffusion for Designers
Three Generators, Three Strengths
Choosing the right image generator for a design task is like choosing the right brush for a painting. Each has a distinct personality:
- Midjourney ($10-60/month): The aesthetic powerhouse. Midjourney v6 produces the most visually striking, stylistically consistent images. Its outputs have a "look" — cinematic, rich, and slightly idealized. Best for: hero images, editorial illustrations, mood boards, and any context where visual impact matters more than photorealism.
- DALL-E 3 (included with ChatGPT Plus at $20/month): The instruction follower. DALL-E is the most accurate at understanding complex prompts with specific spatial relationships, text, and composition requirements. Best for: concept mockups, UI illustrations, diagrams, and images where precision matters more than artistry.
- Stable Diffusion (free, open-source): The customizable engine. Run locally, fine-tune on your own datasets, control every parameter. Best for: batch processing, custom style training, product photography, and any workflow where you need full control over the pipeline.
Prompt Engineering for Design
Design prompts are different from casual image generation prompts. Designers need control over specific visual properties:
The Designer's Prompt Template
[Subject/Scene], [Style] style, [Color palette],
[Lighting], [Composition], [Mood/Atmosphere],
[Technical specifications] --ar [aspect ratio]
Example for a SaaS hero image:
Abstract geometric shapes representing data flow,
minimalist flat design style, navy blue and electric purple
color palette with white accents, soft gradient lighting,
centered composition with negative space on right for text overlay,
clean and professional atmosphere,
high resolution, web-optimized --ar 16:9 --v 6
Style Control Keywords
| Design Need | Keywords |
|---|---|
| Corporate/SaaS | minimalist, clean, professional, geometric, flat design |
| Editorial/Blog | editorial illustration, bold colors, conceptual, hand-drawn feel |
| E-commerce | product photography, studio lighting, white background, commercial |
| Mobile/App | UI illustration, isometric, soft gradients, rounded shapes |
| Brand/Identity | logo concept, vector style, iconic, simple forms, scalable |
Practical Design Applications
1. Hero Images (Midjourney)
The most common design AI use case. Generate hero images for landing pages, blog headers, and marketing materials. Key: always leave space for text overlay by specifying "negative space" or "text area" in the prompt.
2. Texture and Pattern Generation (Stable Diffusion)
Generate seamless textures and patterns for backgrounds, packaging, and print design. Stable Diffusion with the "tile" mode generates perfectly seamless patterns that tile infinitely. This alone saves hours of manual pattern creation.
3. Concept Exploration (DALL-E)
During the ideation phase, generate 20-30 concept variations in 10 minutes. Instead of sketching one concept per hour, you explore the entire possibility space and identify the strongest direction before investing time in detailed design.
4. Custom Illustrations (Midjourney)
Instead of buying generic stock illustrations ($50-500 per set), generate custom illustrations that match your brand's exact style. Midjourney's "style reference" feature (--sref) lets you upload an existing illustration and generate new images in the same visual style.
Maintaining Brand Consistency Across AI-Generated Images
The biggest challenge: every AI-generated image looks slightly different. Strategies for consistency:
- Seed locking (Midjourney): Use the same seed number to maintain a consistent style across generations
- Style references: Upload a reference image that defines the target aesthetic
- Post-processing template: Apply the same color grading, filter, or overlay to all AI images in Photoshop or Figma
- LoRA training (Stable Diffusion): Train a custom model on your brand's visual identity. Generate unlimited images that automatically match your style.
Licensing and Legal Considerations
Know the rules before using AI images in client work:
- Midjourney: You own the images on paid plans. Commercial use allowed.
- DALL-E: OpenAI grants full rights including commercial use.
- Stable Diffusion: Open-source model. You own the outputs. But be cautious about models trained on copyrighted works.
- Client disclosure: Best practice is to disclose AI use in your design process. Most clients don't care about the tool — they care about the result. But transparency builds trust.
Key Takeaways
- Midjourney for visual impact, DALL-E for instruction accuracy, Stable Diffusion for customization — choose based on the task
- The designer's prompt template controls subject, style, color, lighting, composition, mood, and aspect ratio for consistent results
- Style references (Midjourney --sref) and LoRA training (Stable Diffusion) maintain brand consistency across AI-generated images
- All three platforms allow commercial use on paid plans — disclose AI use to clients as best practice for transparency
Lesson 2 of 7