Stability AI Unveils Stable Diffusion XL 1.0, Its Most Advanced Image-Generating Model Yet

Listen to this article
Stability AI - Open Source Models

Stability AI, an AI startup, has announced the release of its latest image-generating AI model, Stable Diffusion XL 1.0. The company describes this as its most advanced release to date. The model is available in open source on GitHub and also through Stability’s API and consumer apps, ClipDrop and DreamStudio. Stability AI, which has raised over $100 million in venture capital to date, is facing stiff competition from other AI companies like OpenAI and Midjourney.

Features and Improvements of Stable Diffusion XL 1.0

Stable Diffusion XL 1.0 boasts more vibrant and accurate colors, better contrast, shadows, and lighting compared to its predecessor. The model, which contains 3.5 billion parameters, can generate full 1-megapixel resolution images in seconds in multiple aspect ratios.

The model is also customizable and ready for fine-tuning for concepts and styles. It’s easier to use, capable of complex designs with basic natural language processing prompting. In addition to these improvements, Stable Diffusion XL 1.0 also excels in the area of text generation, capable of advanced text generation and legibility.

Additional Capabilities

Stable Diffusion XL 1.0 supports inpainting (reconstructing missing parts of an image), outpainting (extending existing images), and “image-to-image” prompts. Users can input an image and add some text prompts to create more detailed variations of that picture. The model understands complicated, multi-part instructions given in short prompts, a significant improvement over previous Stable Diffusion models that needed longer text prompts.

Ethical Considerations and Mitigation Measures

The open-source version of Stable Diffusion XL 1.0 can potentially be used by bad actors to generate harmful content, such as nonconsensual deepfakes. To mitigate this, Stability AI has taken steps to filter the model’s training data for unsafe imagery, release new warnings related to problematic prompts, and block as many individual problematic terms in the tool as possible.

Future Plans and Collaborations

To coincide with the release of Stable Diffusion XL 1.0, Stability AI is releasing a fine-tuning feature in beta for its API. This feature will allow users to use as few as five images to specialize generation on specific people, products, and more. The company is also bringing Stable Diffusion XL 1.0 to Bedrock, Amazon’s cloud platform for hosting generative AI models, expanding on its previously announced collaboration with AWS.

This release marks a significant milestone for Stability AI as it continues to innovate in the field of AI image generation, setting the stage for a new era in the AI industry.

Please email us your feedback and news tips at hello(at)

  • Reading time:4 mins read
  • Post category:News