[feature] Read each object in root Array as an single message.

[felpasl]

First, I want to express my gratitude for your hard work on the Apache Pinot project. It has been an invaluable tool for our data analytics needs, and we greatly appreciate the continuous improvements and updates.

However, I have encountered some challenges while trying to ingest JSON data that contains arrays. Specifically, I received a MismatchedInputException when attempting to deserialize a value of type java.util.HashMap<java.lang.String,java.lang.Object> from an array value (token JsonToken.START_ARRAY). This issue has made it difficult to work with JSON data containing root arrays effectively.

My kafka message has this payload structure, its an stream log from Apisix Requests kafka-logger:

[{
    "start_time": 1733420042603,
    "route_id": "5d9ece83",
    "request": {
         "method": "GET"
    }
},
{
    "start_time": 1733420042701,
    "route_id": "5d9ece83",
    "request": {
         "method": "GET"
    }
}]

Feature Request: I would like to request the following features or enhancements:

Enhanced Documentation Sample:

• Detailed examples and guidelines for handling JSON data with root arrays during ingestion.

Feature Enhancement:

• If not possible Improved support for JSON data containing root arrays.

Best regards.