I first saw this reddit post about a cool video. Decided to give it a try and posted the results on my YouTube channel. One person has asked about a tutorial, so here you are. Read on to learn how to use Loopback Wave script to generate AI animation(AI slide transition).
Download
- The script is not available as an extension, so you will have to download the script manually. Visit the script’s page: https://rentry.co/sd-loopback-wave .
- Right click on Loopback Wave Script V1.4.1 and select save link as. Save the script in the scripts folder of stable-diffusion-webui folder.
- Download the model, LoRA model and the TI
Model: AbyssOrangeMix2_nsfw
LoRA: Fairy Tail Girlpack LoRA 0.2
TIs: Bad Artist, Bad Prompt Version 2, Bad Hands 5 - Move the model to models/Stable-diffusion folder. Move the LoRA to models/Lora folder. Move the TIs to embeddings folder.
- Restart webui.
- If you don’t have ffmpeg installed, visit this page to download ffmpeg.
Example
- Click on txt2img to generate the initial image. Use these parameters:
masterpiece, best quality, high quality, absurdres, (((extreme details))), realistic lighting, beautiful detailed glow, realistic, perfect face, perfect eyes, (cowboy shot:1.3),mirajane, fairy tail, anime art style, 1girl, solo, long_hair, breasts, looking_at_viewer, smile, open_mouth, blue_eyes, large_breasts, dress, cleavage, white_hair, :d, choker, topknot, anime_coloring <lora:fairyTailGirlpack_02:0.6> Negative prompt: sketch by bad-artist), (bad_prompt_version2:0.8), bad hands,(worst quality, low quality:1.3), (greyscale, monochrome:1.1), cropped, lowres, text, jpeg artifacts, signature, watermark, username, blurry, artist name, trademark, watermark, title, (tan, muscular, loli, petite, child, infant, toddlers, chibi, sd character:1.1), multiple view, Reference sheet, (((ugly))), (((unclear eyes))), bad-hands-5 Steps: 30, Sampler: DPM++ 2M Karras, CFG scale: 7, Seed: 662953372, Size: 432x768, Model hash: 0873291ac5, Model: AbyssOrangeMix2_nsfw, ENSD: 31337
- Alternatively, you can drag this image to PNG Info tab and click on Send to txt2img to set the parameters automatically. Note that you might not get the same result even when you use the same parameters because everyone’s setup is different. You can try different seeds and pick the one you like for the first image.
- Once you pick the image you want, click on Send to img2img. Select Loopback Wave V1.4.1 under Script and fill in the parameters.
Generation Settings Total Frames: 120 Frames Per Wave: 30 Wave Offset: 0.0 Base Denoising Strength: 0.33 Max Additional Denoise: 0.6 Initial Image Number: 0.0 Video Encoding Settings Save Video: True Framerate: 20 Quality: 40 Encoding: VP9 (webm) Create Segmented Video: False Prompt Details Initial Prompt:masterpiece, best quality, high quality, absurdres, (((extreme details))), realistic lighting, beautiful detailed glow, realistic, perfect face, perfect eyes, (cowboy shot:1.3),mirajane, fairy tail, anime art style, 1girl, solo, long_hair, breasts, looking_at_viewer, smile, open_mouth, blue_eyes, large_breasts, dress, cleavage, white_hair, :d, choker, topknot, anime_coloring <lora:fairyTailGirlpack_02:0.6> Negative Prompt:sketch by bad-artist), (bad_prompt_version2:0.8), bad hands,(worst quality, low quality:1.3), (greyscale, monochrome:1.1), cropped, lowres, text, jpeg artifacts, signature, watermark, username, blurry, artist name, trademark, watermark, title, (tan, muscular, loli, petite, child, infant, toddlers, chibi, sd character:1.1), multiple view, Reference sheet, (((ugly))), (((unclear eyes))), bad-hands-5 Frame change prompts: 0::masterpiece, best quality, high quality, absurdres, (((extreme details))), realistic lighting, beautiful detailed glow, realistic, perfect face, perfect eyes,juvia, fairy tail, anime art style, 1girl, solo, blush, smile, hat, blue_hair, closed_eyes, fur_trim, parody, hands_on_own_face, hands_on_own_cheeks, <lora:fairyTailGirlpack_02:0.6> 30::masterpiece, best quality, high quality, absurdres, (((extreme details))), realistic lighting, beautiful detailed glow, realistic, perfect face, perfect eyes, anime style,kagura, fairy tail, anime art style, 1girl, solo, long_hair, looking_at_viewer, bangs, brown_eyes, closed_mouth, school_uniform, purple_hair, hairband, necktie, collared_shirt, blunt_bangs, red_necktie, portrait, close-up, tsurime, serious, white_hairband, hime_cut,(character focus), ((perfect anatomy)), looking at viewer, (((from front))), <lora:fairyTailGirlpack_02:0.6> 60::masterpiece, best quality, high quality, absurdres, (((extreme details))), realistic lighting, beautiful detailed glow, realistic, perfect face, perfect eyes, anime style,levy, fairy tail, anime art style, 1girl, solo, long_hair, smile, hair_ornament, bare_shoulders, brown_eyes, blue_hair, collarbone, upper_body, :d, hairband,(character focus), ((perfect anatomy)), looking at viewer, (((from front))), <lora:fairyTailGirlpack_02:0.6> 90::masterpiece, best quality, high quality, absurdres, (((extreme details))), realistic lighting, beautiful detailed glow, realistic, perfect face, perfect eyes, anime style,lucy, fairy tail, anime art style, 1girl, solo, long_hair, breasts, smile, open_mouth, blonde_hair, large_breasts, cleavage, bare_shoulders, brown_eyes, jewelry, upper_body, ponytail, :d, sidelocks, earrings, detached_sleeves, anime_coloring,(character focus), ((perfect anatomy)), looking at viewer, (((from front))), <lora:fairyTailGirlpack_02:0.6>
- Note that if you have Save images to a subdirectory checked in the Settings, the script might fail. Also, if you select other Video encoding codec other than VP9 (webm), the script might fail too.
- Click on Generate to generate the video. When it’s done, the video is in outputs/img2img-images/loopback-wave folder.
Here is the output video:
Here are the YouTube shorts I created using this script:
This post may contain affiliated links. When you click on the link and purchase a product, we receive a small commision to keep us running. Thanks.
Leave a Reply