$12256 / $11500
I tried several AI text-to-image tools, but as of now none is yet able to cope with spritesheets, they create random, inconsistent frames.
Does it exist any specific AI tool trained on spritesheets?
This website's content is licensed under a Creative Commons Attribution-ShareAlike 3.0 Unported License.
Hi Jumpjack, not that I know and those inconsistencies are still inherent to a.i., your only chance is to process every single sprite one by one in my opinion, otherwise you will get different faces and everything will be inconsistent.
Even if you try one by one, if you want consistent faces you have more chances if the base image is well defined and your prompts are consistent. In other words: I never managed to get any consistent characters /faces with low resolution pixelated faces / sprites (I'm not saying is not possible, just I never managed to do it).
So that I explain myself better: to achieve consistency you don't let the A.I. draw the sprites, you draw them yourself and then change the style or improve it with the help of A.I., sometimes you add a human process at the end to correct imperfections. A.I. is in the middle of the process, not the only process and A.I. improves your work, it does not replace it.
The tool and model you are looking for that process hundreds of sprites with perfect consistency with a single prompt does not exist, maybe in a few years, but not yet.
I hope this help.
This may help people modulate their expectations in regards to A.I.
A.I. ≠ Replace your whole workflow with a single prompt
yah if you are comfortable with the ethical implications of AI, then it can be a useful tool for concept art. as far as generating actual pixel art, you just aren't going to get anything useful out of the box. inconsistent generations are the norm.
but if you are looking for a starting point, to refine, improve, and animate yourself, it can be done.
if you are looking for something genuinely unique, ai can't do that. ai algorithms are trained on existing art (99% of which is stolen by web-scraping, but different topic) and can really only imitate what is in the dataset combined with language parsing in the prompt. having a start image and an understanding of prompt engineering is helpful, and understanding that you are going to be doing dozens if not hundreds of generations and iterations to get what you want.
glitchart's statement of " A.I. ≠ Replace your whole workfload with a single prompt " is 100% on point. 150%. 200%.
real art techniques will always be supreme, and ai generations are only truly useful as part of a workflow for human artists.
In the meantime I found this amazing AI experiment by META, called "Animated drawings"! https://sketch.metademolab.com/canvas
Unfortunately it currently can only export in an useless MP4 format and cannot import custom BVH motion capture files (there are hundreds of free BVH files here: https://sites.google.com/a/cgspeed.com/cgspeed/motion-capture), but maybe the python version can? I don't know how to use it.
I also think that "Universal LPC Spritesheet Generator" associated to an AI could give amazing results... but unfortunately I can't do also this.
But I'll give a try to use ChatGPT to:
- Convert the MP4 fron Animated Drawings into a spritesheet
- Modify Universal LPC Spritesheet Generator to allow uploading just the 4 needed faces, which must be overlayed properly to all characters.
Ok ChatGPT-4o just abandoned me due to overwork ;-) , but if anybody wants to continue...
https://github.com/jumpjack/MotionCapSpritesheet/blob/main/mp4-to-sprite...
I'm using creart and wombo dream, if I make a lot of requests I can get something like that.
Two times I got something that could be used as a sprite-sheet, each of these 2 times with 2 images. 2 images is the minimum to get something that could be animated (animated-gif often had only 2 images). This is not a professionnal quality, but we can be happy with something like that for a free and/or open-source game or demo.