[BUG] Possible breaking change in the text-embedding processor

[Zhangxunmt]

What is the bug?

opensearch-project/ml-commons#3677. Following this public tutorial https://opensearch.org/docs/2.17/ml-commons-plugin/tutorials/generate-embeddings/, you will get response like the below. However, the title_embedding should be inside each element of the books. It's verified in OS2.17/2.19 versions that ml-commons both returned embeddings for the model prediction results. From the response of the ingest pipeline, it's likely that the text-embedding has a breaking change after OS version 2.15.

{
  "docs": [
    {
      "doc": {
        "_index": "my_books",
        "_id": "1",
        "_source": {
          "_ingest": {
            "_value": {
              "title_embedding": [
                0.009794682,
                0.04060341,
                0.016146386,
                ...
                -0.03778624
              ]
            }
          },
          "books": [
            {
              "title": "first book",
              "description": "This is first book"
            },
            {
              "title": "second book",
              "description": "This is second book"
            }
          ]
        },
        "_ingest": {
          "_value": null,
          "timestamp": "2025-03-14T22:02:43.240620757Z"
        }
      }
    }
  ]
}

How can one reproduce the bug?

Steps to reproduce the behavior.

What is the expected behavior?

A clear and concise description of what you expected to happen.

What is your host/environment?

Operating system, version.

Do you have any screenshots?

If applicable, add screenshots to help explain your problem.

Do you have any additional context?

Add any other context about the problem.

[will-hwang]

should be fixed with #1204