[Bug] 部署在vercel上，请求本地ollama报错“Direct IP access is not allowed in Vercel's Edge environment”

[TonyBlur]

📦 部署环境

Vercel

📌 软件版本

1.47.10

💻 系统环境

Windows

🌐 浏览器

Edge

🐛 问题描述

将网站部署在vercel上后，请求本地的ollama会报错“Direct IP access is not allowed in Vercel's Edge environment”，但是命令行提问ollama是正常的，而且之前没有这个问题，跨域也已经启用，请问应该如何解决这个问题，是vercel的问题吗
报错的回复如下：

  "error": {
    "0": "D",
    "1": "i",
    "2": "r",
    "3": "e",
    "4": "c",
    "5": "t",
    "6": " ",
    "7": "I",
    "8": "P",
    "9": " ",
    "10": "a",
    "11": "c",
    "12": "c",
    "13": "e",
    "14": "s",
    "15": "s",
    "16": " ",
    "17": "i",
    "18": "s",
    "19": " ",
    "20": "n",
    "21": "o",
    "22": "t",
    "23": " ",
    "24": "a",
    "25": "l",
    "26": "l",
    "27": "o",
    "28": "w",
    "29": "e",
    "30": "d",
    "31": " ",
    "32": "i",
    "33": "n",
    "34": " ",
    "35": "V",
    "36": "e",
    "37": "r",
    "38": "c",
    "39": "e",
    "40": "l",
    "41": "'",
    "42": "s",
    "43": " ",
    "44": "E",
    "45": "d",
    "46": "g",
    "47": "e",
    "48": " ",
    "49": "e",
    "50": "n",
    "51": "v",
    "52": "i",
    "53": "r",
    "54": "o",
    "55": "n",
    "56": "m",
    "57": "e",
    "58": "n",
    "59": "t",
    "60": " ",
    "61": "(",
    "62": "h",
    "63": "o",
    "64": "s",
    "65": "t",
    "66": "n",
    "67": "a",
    "68": "m",
    "69": "e",
    "70": ":",
    "71": " ",
    "72": "1",
    "73": "2",
    "74": "7",
    "75": ".",
    "76": "0",
    "77": ".",
    "78": "0",
    "79": ".",
    "80": "1",
    "81": ")",
    "name": "ResponseError",
    "message": "Direct IP access is not allowed in Vercel's Edge environment (hostname: 127.0.0.1)",
    "status_code": 403
  },
  "provider": "ollama"
}

📷 复现步骤

启动ollama，并访问在vercel上部署的lobechat网站(例如 https://chat-preview.lobehub.com/ )，发送任意提示词，则提示错误，如下图

🚦 期望结果

希望能像之前一样正常使用Ollama，不再受到vercel策略的影响

📝 补充信息

No response

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

📦 Deployment environment

Vercel

📌 Software version

1.47.10

💻 System environment

Windows

🌐 Browser

Edge

🐛 Problem description

After deploying the website on Vercel, when requesting local ollama, an error message "Direct IP access is not allowed in Vercel's Edge environment" will be reported. However, it is normal to ask ollama from the command line. This problem has not occurred before, and cross-domain has been enabled. What should I do? How to solve this problem? Is it a problem with vercel?
The error response is as follows:

  "error": {
    "0": "D",
    "1": "i",
    "2": "r",
    "3": "e",
    "4": "c",
    "5": "t",
    "6": " ",
    "7": "I",
    "8": "P",
    "9": " ",
    "10": "a",
    "11": "c",
    "12": "c",
    "13": "e",
    "14": "s",
    "15": "s",
    "16": " ",
    "17": "i",
    "18": "s",
    "19": " ",
    "20": "n",
    "21": "o",
    "22": "t",
    "twenty three": " ",
    "24": "a",
    "25": "l",
    "26": "l",
    "27": "o",
    "28": "w",
    "29": "e",
    "30": "d",
    "31": " ",
    "32": "i",
    "33": "n",
    "34": " ",
    "35": "V",
    "36": "e",
    "37": "r",
    "38": "c",
    "39": "e",
    "40": "l",
    "41": "'",
    "42": "s",
    "43": " ",
    "44": "E",
    "45": "d",
    "46": "g",
    "47": "e",
    "48": " ",
    "49": "e",
    "50": "n",
    "51": "v",
    "52": "i",
    "53": "r",
    "54": "o",
    "55": "n",
    "56": "m",
    "57": "e",
    "58": "n",
    "59": "t",
    "60": " ",
    "61": "(",
    "62": "h",
    "63": "o",
    "64": "s",
    "65": "t",
    "66": "n",
    "67": "a",
    "68": "m",
    "69": "e",
    "70": ":",
    "71": " ",
    "72": "1",
    "73": "2",
    "74": "7",
    "75": ".",
    "76": "0",
    "77": ".",
    "78": "0",
    "79": ".",
    "80": "1",
    "81": ")",
    "name": "ResponseError",
    "message": "Direct IP access is not allowed in Vercel's Edge environment (hostname: 127.0.0.1)",
    "status_code": 403
  },
  "provider": "ollama"
}

### 📷 Steps to reproduce

Start ollama, and visit the lobechat website deployed on vercel (for example, https://chat-preview.lobehub.com/). If you send any prompt word, an error will be prompted, as shown below

![Image](https://github.com/user-attachments/assets/11a9f3ab-f18b-47f6-91cc-60b653cdf08a)

### 🚦 Expected results

I hope I can use Ollama normally as before and no longer be affected by the vercel strategy.

### 📝 Supplementary information

_No response_  
      

[lobehubbot]

👀 @TonyBlur

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事，并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

[dosubot[bot]]

The error you're encountering, "Direct IP access is not allowed in Vercel's Edge environment," indicates that Vercel's Edge environment does not permit direct IP access, such as accessing 127.0.0.1 (localhost). This is a common restriction in serverless environments like Vercel's Edge, which are designed to handle requests from the internet rather than local network requests.

To resolve this issue, you can consider the following approaches:

1. Use a Publicly Accessible URL: Instead of trying to access a local service directly via IP, deploy your Ollama service to a publicly accessible server or use a tunneling service like ngrok to expose your local service to the internet. This way, you can access it using a URL that Vercel can reach.

2. Proxy Requests: Set up a proxy server that can handle requests from Vercel and forward them to your local service. This proxy should be hosted on a server that Vercel can access.

3. Environment Configuration: Ensure that your environment variables are correctly set to point to a publicly accessible URL for Ollama. For example, the OLLAMA_PROXY_URL should be set to the URL of your publicly accessible Ollama service.

4. Check CORS Settings: Make sure that your CORS settings are correctly configured to allow requests from your Vercel deployment. This includes setting the OLLAMA_ORIGINS environment variable to allow requests from your Vercel domain.

These steps should help you bypass the restriction imposed by Vercel's Edge environment and allow your Lobe Chat application to communicate with the Ollama service.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}

[arvinxx]

因为你关掉了客户端请求吧？ 打开客户端请求应该就好了？

[TonyBlur]

新的aiprovider没有ollama客户端请求的开关了，之前是有的而且没有关闭过，现在即使输入自定义URL也不显示了，所以没法开启

[TonyBlur]

大佬，请问这种情况是需要怎么配置吗，目前没有客户端请求的开关，也不是默认开启的，是bug还是就是这样设计的

[TonyBlur]

因为你关掉了客户端请求吧？ 打开客户端请求应该就好了？

没有做任何设置调整，但是目前已经可以正常请求，感谢大佬

[lobehubbot]

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿

---

Is it because you turned off client requests? It should be fine to open client requests?

[lobehubbot]

✅ @TonyBlur

This issue is closed, If you have any questions, you can comment and reply.
此问题已经关闭。如果您有任何问题，可以留言并回复。