Test 2 - following instructions (a treasure island map outline)

This page has 0 threads | Add post

Blogs

Finding our blogs useful? Please consider helping us to share more!

Comparing the 5 leading AI tools for image generaton from text Part five of an eight-part series of blogs
Having recently compared the 4 main AI tools for text prompts, I thought I'd do the same for image generation tools. In this blog series we compare Dall-E (via ChatGPT and separately via Copilot), Firefly, Midjourney and Stable Diffusion for 3 pre-defined tests to see which ones score most highly for cost, ease-of-use, speed, editing ability and above all for quality of image. A deep-dive review of text-to-image AI tools The 5 AI image generation tools that we will compare The 3 pre-defined tests that we will run for each tool Test 1 - photo-realism (a picture of mice being judged) Test 2 - following instructions (a treasure island map outline) (this blog) Test 3 - being creative (a toy sheep as superhero) Summing up: how our tools compare for cost, speed, ease of use and quality Conclusions and recommendations

Comparing the 5 leading AI tools for image generaton from text

Part five of an eight-part series of blogs

Having recently compared the 4 main AI tools for text prompts, I thought I'd do the same for image generation tools. In this blog series we compare Dall-E (via ChatGPT and separately via Copilot), Firefly, Midjourney and Stable Diffusion for 3 pre-defined tests to see which ones score most highly for cost, ease-of-use, speed, editing ability and above all for quality of image.

A deep-dive review of text-to-image AI tools
The 5 AI image generation tools that we will compare
The 3 pre-defined tests that we will run for each tool
Test 1 - photo-realism (a picture of mice being judged)
Test 2 - following instructions (a treasure island map outline) (this blog)
Test 3 - being creative (a toy sheep as superhero)
Summing up: how our tools compare for cost, speed, ease of use and quality
Conclusions and recommendations

Posted by Andy Brown on 22 July 2024

In this blog

Comparing the images produced
Editing the Images
Winners and losers

Here's a reminder of the second picture I want to create:

Create a line drawing of a treasure island with a curvy coastline. The background of the island should be white apart from child-like drawings of the following features:

Hell’s Kitchen (a volcano)
Hangman’s lookout (a gibbet with a skeleton hanging from it)
Dead man’s desert
Sulphur Springs
Magwitch marshes
Tombs Town
Lone Palm
Treachery Hills

These features should be roughly equally spaced around the island. Do not show any text on the picture – I will add that later.

The coastline of the island should be clearly delineated, and child-like drawings appear in the sea of the following:

2 or 3 child-like drawings of whales
A line-drawing of a large bird like an albatross
A pirate ship in a bay

Keep everything simple. Avoid having much fill or background colouring. When in doubt, use simple outline drawings of things. Use pastel colours throughout.

Here's the sort of thing I'm trying to produce:

I'm fervently hoping my AI tools can do far better than this!

Comparing the images produced

Here's what the 4 tools produced:

AI tool	Image produced
ChatGPT
Copilot
Firefly
Midjourney
Stable Diffusion

Editing the Images

After reviewing the images, I decided there was no point trying to edit them, as they were all so far away from what I had tried to achieve. This is probably my fault, not that of the AI tools!

Winners and losers

For me there's a clear winner and a clear loser:

Position	AI tool	Reasoning
Winner	Copilot	Copilot has given me 4 good choices, with the bottom left image showing exactly the effect I was trying to achieve.
Loser	Stable Diffusion	If you're wondering why this picture doesn't seem to contain many of the things I asked for, here's why: Stable Diffusion not only has a 500-character prompt limit and also seemed to object to some of my punctuation. So in the end here's what this image is showing: "Create a line drawing of a treasure island with a curvy coastline. The background of the island should be white apart from child-like drawings of a few features typical to a treasure island map. Do not show any text on the picture. Keep everything simple. Avoid having much fill or background colouring. "
Other runners	ChatGPT, Firefly, Midjourney	These aren't bad attempts - Firefly tried hard to follow my instructions, and ChatGPT came up with an image having exactly the vibe I was looking for. I feel if I was a better consumer of AI tools I could have given a better steer and got better results.

I'm nervous now for Stable Diffusion: it's come bottom in both of the tests set so far. There's one more test for you to redeem yourself, Stable Diffusion!

Parts of this blog
A deep-dive review of text-to-image AI tools The 5 AI image generation tools that we will compare The 3 pre-defined tests that we will run for each tool Test 1 - photo-realism (a picture of mice being judged) Test 2 - following instructions (a treasure island map outline) (this blog) Test 3 - being creative (a toy sheep as superhero) Summing up: how our tools compare for cost, speed, ease of use and quality Conclusions and recommendations

Parts of this blog

A deep-dive review of text-to-image AI tools
The 5 AI image generation tools that we will compare
The 3 pre-defined tests that we will run for each tool
Test 1 - photo-realism (a picture of mice being judged)
Test 2 - following instructions (a treasure island map outline) (this blog)
Test 3 - being creative (a toy sheep as superhero)
Summing up: how our tools compare for cost, speed, ease of use and quality
Conclusions and recommendations

Some other pages relevant to the above blogs include:

Learn Artificial Intelligence

This blog has 0 threads

Add a new post

BLOGS BY TOPIC

BLOGS BY AUTHOR

Comparing the images produced

Editing the Images

Winners and losers

Head office

London

Manchester