Add SmolVLM2

[capjamesg]

Description

This PR adds SmolVLM2 to Inference.

Type of change

• New model

How has this change been tested, please provide a testcase or example of how you tested the change?

You can test this change with the following code:

from PIL import Image
from inference.models.smolvlm.smolvlm import SmolVLM

pg = SmolVLM(api_key="YOUR_ROBOFLOW_KEY")

image = Image.open("image.jpeg")

prompt = "your prompt"

result = pg.predict(image, prompt)

print(result)

You should see a result like:

['User:\n\n\n\n\nCan you describe this image?\nAssistant: The image depicts a beagle dog sitting on a cobblestone path in what appears to be a courtyard or an alleyway. The dog is positioned in the foreground, facing the camera, with its front paws resting on the ground. The dog has a black muzzle, a white chest, and brown and black fur on']

Any specific deployment considerations

N/A

Docs

A docs page has been added for this model.

[PawelPeczek-Roboflow]

why is that needed here but wasnt needed for other core models?

[PawelPeczek-Roboflow]

I am a little bit shaky letting that go to main

[PawelPeczek-Roboflow]

if required - should be set instead of list for faster lookup as models pool grows

[PawelPeczek-Roboflow]

looks good, but please explain the changes in get_model_type

[PawelPeczek-Roboflow]

why GENERIC_MODELS would not be used instead of creating FOUNDATION_MODELS_TO_DOWNLOAD_AS_CORE

[PawelPeczek-Roboflow]

@capjamesg - chane will not be pushed to release if comments are not addressed.

[PawelPeczek-Roboflow]

probably not needed modification

[PawelPeczek-Roboflow]

remove commented out code

[PawelPeczek-Roboflow]

looks good, please revert not needed change from inference/core/registries/roboflow.py

[PawelPeczek-Roboflow]

this should be adjusted