Incorrect results of ES|QL query for point field nested in object

[lkts]

Elasticsearch Version

9.1 and earlier

Installed Plugins

No response

Java Version

bundled

OS Version

Problem Description

If you create a document with an object array and a point field using array form inside, it is not possible to use such field in a ES|QL query. Using specifically an array form and having multiple values of the field is crucial for the reproduction. See the steps below. This also applies to geo_point.

Steps to Reproduce

PUT my-index
{
  "mappings": {
    "properties": {
      "top": {
        "properties": {
          "p": {
            "type": "point"
          }
        }
      }
    }
  }
}

POST my-index/_bulk?refresh
{ "create": {} }
{ "top": [{"p": [-71.34, 41.12]}, {"p": "POINT (-71.34 41.13)"}] }

POST /_query?format=txt
{
  "query": "FROM my-index"
}

Produces:

     top.p     
---------------
null           

But should produce:

                   top.p                    
--------------------------------------------
[POINT (-71.34 41.12), POINT (-71.34 41.13)]

Logs (if relevant)

No response

[elasticsearchmachine]

Pinging @elastic/es-analytical-engine (Team:Analytics)

[lkts]

It seems that something is wrong somewhere in XContentMapValues#extractValue.

[luigidellaquila]

@craigtaverner maybe you have a clue already? Otherwise I can try to debug it

[lkts]

There are tests in #125816 that reproduce this. They are commented out for now.

[astefan]

The problem seems related specifically to the array format of the point, not necessarily that field being an array.
I think there are three conditions for this to happen:

• the field to be a sub-field
• the field to have an array of values
• the values in the array to have a mix of formats

{"index":{"_index":"test","_id":1}}
{ "top": [{"p": [-71.34, 41.12]}, {"p": "POINT (-71.34 41.13)"}],"ppp":[[-71.34, 41.12], "POINT (-71.34 41.13)"]}
{"index":{"_index":"test","_id":2}}
{ "top": {"p": [-71.34, 41.15]},"ppp":[-71.34, 41.12] }
{"index":{"_index":"test","_id":3}}
{ "top": [{"p": "POINT (-71.34 41.12)"}, {"p": "POINT (-71.34 41.13)"}],"ppp":["POINT (-71.34 41.12)", "POINT (-71.34 41.13)"] }
{"index":{"_index":"test","_id":4}}
{ "top": [{"p": [-71.34, 41.12]}, {"p": [-71.34, 41.13]}],"ppp":[[-71.34, 41.13], [-71.34, 41.12]] }

from test METADATA _source, _id | keep top.p, *

                   top.p                    |                    ppp                     |                                                  _source                                                   |      _id      
--------------------------------------------+--------------------------------------------+------------------------------------------------------------------------------------------------------------+---------------
null                                        |[POINT (-71.34 41.12), POINT (-71.34 41.13)]|{top=[{p=[-71.34, 41.12]}, {p=POINT (-71.34 41.13)}], ppp=[[-71.34, 41.12], POINT (-71.34 41.13)]}          |1              
POINT (-71.34 41.15)                        |POINT (-71.34 41.12)                        |{top={p=[-71.34, 41.15]}, ppp=[-71.34, 41.12]}                                                              |2              
[POINT (-71.34 41.12), POINT (-71.34 41.13)]|[POINT (-71.34 41.12), POINT (-71.34 41.13)]|{top=[{p=POINT (-71.34 41.12)}, {p=POINT (-71.34 41.13)}], ppp=[POINT (-71.34 41.12), POINT (-71.34 41.13)]}|3              
POINT (-71.34 41.12)                        |[POINT (-71.34 41.13), POINT (-71.34 41.12)]|{top=[{p=[-71.34, 41.12]}, {p=[-71.34, 41.13]}], ppp=[[-71.34, 41.13], [-71.34, 41.12]]}                    |4