Send image / plot

[hadley]

https://platform.openai.com/docs/guides/vision

list(
  list(
    type = "text",
    text = "What’s in this image?"
  ),
  list(
    type = "image_url",
    image_url = list(
      url = "https://upload.wikimedia.org/wikipedia/commons/thumb/d/dd/Gfp-wisconsin-madison-the-nature-boardwalk.jpg/2560px-Gfp-wisconsin-madison-the-nature-boardwalk.jpg"
    )
  )
)

list(
  list(
    type = "text",
    text = "What’s in this image?"
  ),
  list(
    type = "image_url",
    image_url = list(
      url = paste0("data:image/jpeg;base64,", base64_image)
    )
  )
)

Can include multiple images.

[hadley]

For low res mode, we expect a 512px x 512px image. For high res mode, the short side of the image should be less than 768px and the long side should be less than 2,000px.

Can use recordPlot(), replayPlot() and grDevices::dev.cur() to capture the current plot as a png.