Skip to main content
Participant
December 30, 2024
Question

Book Cover Background Generation: API Integration Project

  • December 30, 2024
  • 5 replies
  • 1049 views

I'm working on a project that aims to generate an appropriate background for a book cover, which should seamlessly merge with the book. It's worth noting that the book itself also needs to be generated since I only have the cover.

This process needs to be automated. Which Adobe APIs would allow me to accomplish this task? I read about autoblend. Can it be used in the API? Would it be useful for this problem?

One of the difficulties I've encountered so far is that while using Firefly generates backgrounds, it systematically fails to include a book, and even when I manage to generate a closed book, I don't know how to integrate the original book cover.

5 replies

Participant
January 2, 2025

@Trevor.Dennis @c.pfaffenbichler @J E L 

 

I will explain my idea in more detail.

The concept is to automatically generate backgrounds to promote books based on their descriptions. The goal is to present several options for authors to select their preferred choice.

Let's take "The Martian" as an example. The book cover is as follows The_Martian.png.

I used the book's description in a Large Language Model (LLM) to generate a pictorial prompt that can be used as input for models like Stable Diffusion, Midjourney, DALL-E, or Adobe Firefly. The result looks similar to this The_Martian_Background.png

The main challenges are:

  • How to generate the rest of the book given the cover, and
  • How to seamlessly integrate both images (the book cover and the background).

Assume the author specifies their preferred placement for the book in the composition.

It's important to note that maintaining fidelity to the original book cover and automating the process are crucial requirements.

I've explored alternative approaches, such as generating the background based on the book cover alone, but the results haven't been satisfactory either.
The final output should be something like Final.png

Thanks in advance...

Feder

Participant
January 2, 2025

The cover was no attached, so here it goes.

c.pfaffenbichler
Community Expert
Community Expert
January 7, 2025

Have you looked into Photoshop Beta’s combination with Substance 3D Stager? 

J E L
Community Expert
Community Expert
January 1, 2025

@federico_1707, after reading your post again, I am wondering if you are attempting to create a mock-up of the book in a setting that extends the book cover background. You will need to use layers in Photoshop to accomplish this. There are some free templates from CoverVault that have been added to Dropbox that might help you. You could then use AI to fill in the blank areas around the book cover. Maybe I still have what you are looking for all wrong, lol… but let us know how it goes!

c.pfaffenbichler
Community Expert
Community Expert
December 31, 2024
quote

It's worth noting that the book itself also needs to be generated since I only have the cover.

What does this actually mean (hardcover, softcover, perspective, layout, …)?

You may have to provide more meaningful information. 

J E L
Community Expert
Community Expert
December 31, 2024

@federico_1707, indeed, @c.pfaffenbichler asks a very good question. I hope you are not attempting to create the entire book, page-by-page, in Photoshop? Unless your circumstances are extremely unique, you need Adobe InDesign for bookmaking, including covers. InDesign can extend backgrounds for covers now, too. 

c.pfaffenbichler
Community Expert
Community Expert
January 1, 2025

I suspect the cover is a »given« and the OP wants to create a backgrund (for marketing materials like ads, posters, …) that »seasmlessly« extends the image on the cover. 

Depending on the image that might be a tall order and resolution may be insufficient anyway … 

c.pfaffenbichler
Community Expert
Community Expert
December 31, 2024

Please provide a few of the covers (feel free to pixelate title/author’s name/…) and a sketch/mock-up of the intended result. 

Trevor.Dennis
Community Expert
Community Expert
December 30, 2024

I'd be using Photoshop beta 26.3 and Edit > Generative Workspace

I'd also think about suplying it with an example image of what you'd like it to look like.

If you could also show us an example, then we'd be much better placed to give you specific advice.

The two videos below are probablyt the best tutorials on how to get the best from Generative Workspace.  In fact they are the two channels that anyone who is serious about Photoshop should follow.

 

https://www.youtube.com/watch?v=IqwDAsqDfAk&t

https://www.youtube.com/watch?v=50dFbEC9WpM&t