Best place to host remotely or possible runpod serverless worker

[TheMindExpansionNetwork]

what do you recommend would be a good way to make this like an end point where they can connect to it as needed with other AI's

I'm not sure if it's best to just push it over to a docker image and run pond serverless or if you all know something a little easier to do this

Trying to build a little project to provide open source to trying to be as budget friendly as I can. Any advice is much appreciated thank you. I was planning on using live kit if it makes sense and possibly a. Eliza framework

[anujnayyar1]

@remsky firstly thank you for this awesome repo.

A Runpod Serverless compatible container would be extremely helpful!

[remsky]

@anujnayyar1 @TheMindExpansionNetwork

That sounds like a great idea, glad it's been helpful. I'll take a look, just finishing up some restructuring to simplify container setup which should make it more deployable

[TheMindExpansionNetwork]

yeah, it's super awesome. I'll tell you. I guess the stack that I'm looking to push with.

Serverless-runpod>kokoro>possible rvc but I like your voices > live kit > eliza>to machine or like avatar have a little Meta corner idea for digital entity that lives

I been looking something stable sounds decent because plans start deploying this stuff give people from homeless to learn free education

Throw partys and raves to fund it all

Super impressed quality amazing how you did it to super transparent

What if we did this just idea love to help

We can have AI even got the pro ai to generate a basic synthetic dataset

Of just midi notes

Then we take that bad boy with all native instruments or other stuff purchased

Then in theory we be legal train ai on it release apache or what ever

Idk how hard be but its and idea

Think we need more open source quality music models

[quetzalsly]

Hey sorry to ask this question here but, how does this version of kokoro differ from replicate/jaaari/kokoro-82m?

I really love the simplicity of using replicate in my workflow but thinking of switching to this one, but also not sure where to host it, how about huggingface dedicated endpoints?

[remsky]

Not sure to be honest, they have it always live and hosted there for cloud use, but I don't know know what source code they're using, just the same base model. This repo is geared more towards local use and development, source files so it can be modified if needed and built on over time.

For an equivalent endpoint on local hardware, or any cloud endpoints (haven't tested yet, so if you do manage to, feel free to submit a PR with instructions/mods), you'd probably want to run these to just get the voice server up fast.

docker run -p 8880:8880 ghcr.io/remsky/kokoro-fastapi-cpu:v0.1.0post1 # CPU or
docker run --gpus all -p 8880:8880 ghcr.io/remsky/kokoro-fastapi-gpu:v0.1.0post1 # Nvidia GPU

If HF doesn't already have a drop in hosting for the voice images, I can take a look around to try and include a guide along with RunPod/etc instructions, just gotta finish up getting the quantized versions and model selection update worked into the code first

[TheMindExpansionNetwork]

Has anyone been able to figure out anything I found out works awesome with livekit swap out url but need to host bad boy I got it with the docker image and the thing they had in new endpoint but I did not know how to access it

Think need to do something with this

https://github.com/runpod-workers/worker-template

If anyone has input be dope not many serverless endpoints especially so fast