file_handling

📁 Manage your Files with Jina Blob Storage

Jina Blob Storage, through the JinaBlobStorage class, provides a simple yet powerful solution for managing file storage in your FastAPI applications. With built-in features for uploading, downloading, retrieving info, listing, and deleting files, it streamlines the process of managing user files, saving you the complexity of handling storage yourself.

🧠 Langchain RetrievalQA Example on PDF Documents

In this example, we will demonstrate how to use Jina Blob Storage in a FastAPI application. We build a service that allows users to upload a PDF document on one endpoint and then answer questions about the document on another endpoint.

The two key endpoints are /upload and /answer. The upload endpoint takes a file and a flag indicating whether the file should be public or not, uploads it to the Jina Blob Storage, and returns the unique uri of the uploaded file. The /answer endpoint takes this uri and a user question as input, retrieves the file from the Jina Blob Storage, and answers the user's question based on the content of the uploaded document.

Note This example needs OPENAI_API_KEY secret to be passed to enable interaction with OpenAI APIs. You should replace secrets.env with your own token.

🚀 Deploying to Jina AI Cloud

fastapi-serve deploy jcloud main:app --secret secrets.env

╭─────────────────────────┬───────────────────────────────────────────────────────────╮
│ App ID                  │                    fastapi-a66d3fe145                     │
├─────────────────────────┼───────────────────────────────────────────────────────────┤
│ Phase                   │                          Serving                          │
├─────────────────────────┼───────────────────────────────────────────────────────────┤
│ Endpoint                │          https://fastapi-a66d3fe145.wolf.jina.ai          │
├─────────────────────────┼───────────────────────────────────────────────────────────┤
│ App logs                │                  https://cloud.jina.ai/                   │
├─────────────────────────┼───────────────────────────────────────────────────────────┤
│ Base credits (per hour) │             10.104 (Read about pricing here)              │
├─────────────────────────┼───────────────────────────────────────────────────────────┤
│ Swagger UI              │       https://fastapi-a66d3fe145.wolf.jina.ai/docs        │
├─────────────────────────┼───────────────────────────────────────────────────────────┤
│ OpenAPI JSON            │   https://fastapi-a66d3fe145.wolf.jina.ai/openapi.json    │
╰─────────────────────────┴───────────────────────────────────────────────────────────╯

💻 Testing

Let's use curl to test the endpoints. First, we upload a PDF document to the blob storage. The response contains the uri of the uploaded file.

curl -X POST "https://fastapi-a66d3fe145.wolf.jina.ai/upload" \
    -H "accept: application/json" \
    -H "Content-Type: multipart/form-data" \
    -F "file=@path_to_your_file.pdf;type=application/pdf" \
    -F "public=false"

{
  "uri": "jinaai://64b56d4b933a75a3ee88feee"
}

Next, we use the uri to answer a question about the document. The response contains the answer to the question.

curl -X GET \
    "https://fastapi-a66d3fe145.wolf.jina.ai/answer?uri=jinaai://64b56d4b933a75a3ee88feee&question=your_question"

{
  "answer": "your_answer"
}

🗂️ Jina Blob Storage Features

With Jina Blob Storage, you get the following features:

• Upload: Upload a file to the blob storage and get a unique uri to access it.
• Download: Download a file from the blob storage using its uri.
• Get Info: Get metadata about a file using its uri.
• List: Get a list of all files in the blob storage.
• Delete: Delete a file from the blob storage using its uri.

You can check the code for the JinaBlobStorage class in storage.py file.

https://github.com/jina-ai/fastapi-serve/blob/d6ebaea5f5e46b284451e651b32d988f70be6643/fastapi_serve/utils/blob/storage.py#L15

If you have any questions, feedback, or ideas, don't hesitate to create an issue. We'd love to hear from you!