We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
hello,我下载了kagentlms_baichuan2_13b_mat模型,但是没办法通过fastchat部署,,以下是报错:
2024-03-11 22:02:00 | INFO | model_worker | args: Namespace(host='192.168.80.2', port=9015, worker_address='http://192.168.80.2:9015', controller_address='http://192.168.80.2:9083', model_path='/home/ssd1/record/llm_models/kagentlms_baichuan2_13b_mat/', revision='main', device='cuda', gpus=None, num_gpus=1, max_gpu_memory=None, dtype=None, load_8bit=False, cpu_offloading=False, gptq_ckpt=None, gptq_wbits=16, gptq_groupsize=-1, gptq_act_order=False, awq_ckpt=None, awq_wbits=16, awq_groupsize=-1, model_names=['kwai_agent_baichuan'], conv_template=None, embed_in_truncate=False, limit_worker_concurrency=5, stream_interval=2, no_register=False, seed=None) 2024-03-11 22:02:00 | INFO | model_worker | Loading the model ['kwai_agent_baichuan'] on worker a59d1063 ... Could not locate the modeling_baichuan.py inside kwaikeg/kagentlms_baichuan2_13b_mat. 2024-03-11 22:02:03 | ERROR | stderr | Traceback (most recent call last): 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connection.py", line 203, in _new_conn 2024-03-11 22:02:03 | ERROR | stderr | sock = connection.create_connection( 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/util/connection.py", line 85, in create_connection 2024-03-11 22:02:03 | ERROR | stderr | raise err 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/util/connection.py", line 73, in create_connection 2024-03-11 22:02:03 | ERROR | stderr | sock.connect(sa) 2024-03-11 22:02:03 | ERROR | stderr | OSError: [Errno 101] Network is unreachable 2024-03-11 22:02:03 | ERROR | stderr | 2024-03-11 22:02:03 | ERROR | stderr | The above exception was the direct cause of the following exception: 2024-03-11 22:02:03 | ERROR | stderr | 2024-03-11 22:02:03 | ERROR | stderr | Traceback (most recent call last): 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 790, in urlopen 2024-03-11 22:02:03 | ERROR | stderr | response = self._make_request( 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 491, in _make_request 2024-03-11 22:02:03 | ERROR | stderr | raise new_e 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 467, in _make_request 2024-03-11 22:02:03 | ERROR | stderr | self._validate_conn(conn) 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1092, in _validate_conn 2024-03-11 22:02:03 | ERROR | stderr | conn.connect() 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connection.py", line 611, in connect 2024-03-11 22:02:03 | ERROR | stderr | self.sock = sock = self._new_conn() 2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connection.py", line 218, in _new_conn 2024-03-11 22:02:03 | ERROR | stderr | raise NewConnectionError( 2024-03-11 22:02:03 | ERROR | stderr | urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f9aaccac430>: Failed to establish a new connection: [Errno 101] Network is unreachable
Could not locate the modeling_baichuan.py inside kwaikeg/kagentlms_baichuan2_13b_mat. 我已经在下好模型文件了啊
The text was updated successfully, but these errors were encountered:
No branches or pull requests
hello,我下载了kagentlms_baichuan2_13b_mat模型,但是没办法通过fastchat部署,,以下是报错:
2024-03-11 22:02:00 | INFO | model_worker | args: Namespace(host='192.168.80.2', port=9015, worker_address='http://192.168.80.2:9015', controller_address='http://192.168.80.2:9083', model_path='/home/ssd1/record/llm_models/kagentlms_baichuan2_13b_mat/', revision='main', device='cuda', gpus=None, num_gpus=1, max_gpu_memory=None, dtype=None, load_8bit=False, cpu_offloading=False, gptq_ckpt=None, gptq_wbits=16, gptq_groupsize=-1, gptq_act_order=False, awq_ckpt=None, awq_wbits=16, awq_groupsize=-1, model_names=['kwai_agent_baichuan'], conv_template=None, embed_in_truncate=False, limit_worker_concurrency=5, stream_interval=2, no_register=False, seed=None)
2024-03-11 22:02:00 | INFO | model_worker | Loading the model ['kwai_agent_baichuan'] on worker a59d1063 ...
Could not locate the modeling_baichuan.py inside kwaikeg/kagentlms_baichuan2_13b_mat.
2024-03-11 22:02:03 | ERROR | stderr | Traceback (most recent call last):
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connection.py", line 203, in _new_conn
2024-03-11 22:02:03 | ERROR | stderr | sock = connection.create_connection(
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/util/connection.py", line 85, in create_connection
2024-03-11 22:02:03 | ERROR | stderr | raise err
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/util/connection.py", line 73, in create_connection
2024-03-11 22:02:03 | ERROR | stderr | sock.connect(sa)
2024-03-11 22:02:03 | ERROR | stderr | OSError: [Errno 101] Network is unreachable
2024-03-11 22:02:03 | ERROR | stderr |
2024-03-11 22:02:03 | ERROR | stderr | The above exception was the direct cause of the following exception:
2024-03-11 22:02:03 | ERROR | stderr |
2024-03-11 22:02:03 | ERROR | stderr | Traceback (most recent call last):
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 790, in urlopen
2024-03-11 22:02:03 | ERROR | stderr | response = self._make_request(
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 491, in _make_request
2024-03-11 22:02:03 | ERROR | stderr | raise new_e
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 467, in _make_request
2024-03-11 22:02:03 | ERROR | stderr | self._validate_conn(conn)
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connectionpool.py", line 1092, in _validate_conn
2024-03-11 22:02:03 | ERROR | stderr | conn.connect()
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connection.py", line 611, in connect
2024-03-11 22:02:03 | ERROR | stderr | self.sock = sock = self._new_conn()
2024-03-11 22:02:03 | ERROR | stderr | File "/root/anaconda3/envs/fschat2/lib/python3.10/site-packages/urllib3/connection.py", line 218, in _new_conn
2024-03-11 22:02:03 | ERROR | stderr | raise NewConnectionError(
2024-03-11 22:02:03 | ERROR | stderr | urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPSConnection object at 0x7f9aaccac430>: Failed to establish a new connection: [Errno 101] Network is unreachable
Could not locate the modeling_baichuan.py inside kwaikeg/kagentlms_baichuan2_13b_mat. 我已经在下好模型文件了啊
The text was updated successfully, but these errors were encountered: