How to get VKTRS Working (Almost) as of Jan-13-24

[npgilbertson]

*I had these issues while running with a connected gpu. After being booted out and retrying after some time, it's working fine up until animation on cpu only with these edits.

If it stops working partway through, i recommend restarting a fresh project. Trying to resume tends to leave things in a messy state that even I couldn't always recover from.

Firstly, start by copying this code and pasting it over the old code in Setup: Install Dependencies section.

#%%capture

# @title # 🛠️ Setup: Install Dependencies

# Install dependencies

try:
    import google.colab
    local=False
except:
    local=True

# TODO: pin versions

# local only additional dependencies
if local:
    %pip install pandas torch pillow beautifulsoup4 scipy toolz numpy lxml librosa scikit-learn rich

# dependencies for both colab and local
%pip install yt-dlp python-tsp stability-sdk[anim_ui] diffusers transformers ftfy accelerate omegaconf
%pip install openai-whisper panel huggingface_hub ipywidgets safetensors keyframed demucs parse install torch==2.0.1 triton==2.0.0

Then you will take this code and add it at the bottom of the Imports and Definitions section.
(I usually put it below the comment: # TODO: copy init images into this folder, add to settings.txt's)
NOTE: you may need to add more incremental lines for longer videos or videos with more than 19 scenes. The "frames" Number being declared here is to prevent missing key frames error as value is missing. I'm sure these values will need to be edited

    storyboard.prompt_starts[1]['frames'] = 60
    storyboard.prompt_starts[2]['frames'] = 60
    storyboard.prompt_starts[3]['frames'] = 60
    storyboard.prompt_starts[4]['frames'] = 60
    storyboard.prompt_starts[5]['frames'] = 60
    storyboard.prompt_starts[6]['frames'] = 60
    storyboard.prompt_starts[7]['frames'] = 60
    storyboard.prompt_starts[8]['frames'] = 60
    storyboard.prompt_starts[9]['frames'] = 60
    storyboard.prompt_starts[10]['frames'] = 60
    storyboard.prompt_starts[11]['frames'] = 60
    storyboard.prompt_starts[12]['frames'] = 60
    storyboard.prompt_starts[13]['frames'] = 60
    storyboard.prompt_starts[14]['frames'] = 60
    storyboard.prompt_starts[15]['frames'] = 60
    storyboard.prompt_starts[16]['frames'] = 60
    storyboard.prompt_starts[17]['frames'] = 60
    storyboard.prompt_starts[18]['frames'] = 60

After audio processing first hit math, then go back to view your storyboard and subdivide. Math adds some stuff for the others to work but its out of place in the list.

Proceed through each step, even generating the deforum file, until you reach Animate Scences
Where you will want to find
args = AnimationArgs(**args)
and change it to
args = AnimationArgs()

From here i've gotten lost as the line
for img in tqdm(animator.render(), initial=animator.start_frame_idx, total=args.max_frames)
is looking for stable diffusion v1.5 when it's no longer active on dream studio as they use v1.6 or SDX. I've tried changing different files to call for that included changing the animation settings tab's engine option (but as far as I can see, It doesn't actually change the engine, maybe not even anything?)