Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP][Serve] Enable launching multiple external LB on controller. #4362

Draft
wants to merge 9 commits into
base: master
Choose a base branch
from

Conversation

cblmemo
Copy link
Collaborator

@cblmemo cblmemo commented Nov 14, 2024

$ sky serve status
Clusters
NAME                           LAUNCHED    RESOURCES                                                    STATUS  AUTOSTOP  COMMAND                       
ap-northeast-1-client          14 hrs ago  1x AWS(m6i.large)                                            UP      -         sky launch --region ap-no...  
sky-serve-controller-4a0782e9  1 min ago   1x GCP(n2-standard-4, disk_size=200, ports=['20001-20020'])  UP      10m       sky serve up examples/ser...  

Managed jobs
No in-progress managed jobs. (See: sky jobs -h)

Services
NAME      VERSION  UPTIME  STATUS      REPLICAS  ENDPOINT                      
test      1        9m 3s   READY       2/2       test.aws.cblmemo.net:8000       
test-dns  1        3m 52s  READY       2/2       test-dns.aws.cblmemo.net:8000   
service   -        -       NO_REPLICA  0/2       service.aws.cblmemo.net:8000  

Service Replicas
SERVICE_NAME  ID  VERSION  ENDPOINT                    LAUNCHED        RESOURCES       STATUS        REGION     
test          1   1        http://54.211.41.3:8080     9 mins ago      1x AWS(vCPU=2)  READY         us-east-1  
test          2   1        http://3.84.9.202:8080      9 mins ago      1x AWS(vCPU=2)  READY         us-east-1  
test-dns      1   1        http://18.234.191.41:8080   4 mins ago      1x AWS(vCPU=2)  READY         us-east-1  
test-dns      2   1        http://54.234.129.50:8080   4 mins ago      1x AWS(vCPU=2)  READY         us-east-1  
service       1   1        http://3.84.141.45:8080     a few secs ago  1x AWS(vCPU=2)  PROVISIONING  us-east-1  
service       2   1        http://44.201.191.235:8080  16 secs ago     1x AWS(vCPU=2)  STARTING      us-east-1  

External Load Balancers
SERVICE_NAME  ID  ENDPOINT            
test          0   3.137.187.47:8000   
test          1   54.238.10.138:8000  
test-dns      0   18.188.68.130:8000  
test-dns      1   13.230.9.98:8000    
service       0   18.227.81.22:8000   
service       1   13.115.58.105:8000  

* To see detailed service status: sky serve status -a
* 1 cluster has auto{stop,down} scheduled. Refresh statuses with: sky status --refresh

Tested (run the relevant ones):

  • Code formatting: bash format.sh
  • Any manual or new tests for this PR (please specify below)
  • All smoke tests: pytest tests/test_smoke.py
  • Relevant individual smoke tests: pytest tests/test_smoke.py::test_fill_in_the_name
  • Backward compatibility tests: conda deactivate; bash -i tests/backward_compatibility_tests.sh

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant