Square brackets not recognized in syntax highlighting grammar

[alexr00]

In some cases, square brackets are not recognized as square brackets by the syntax highlighting grammar.

Environment

• Operating System: N/A
• JDK version: N/A
• Visual Studio Code version: 1.87 and 1.88 insiders
• Java extension version: Latest commit from main

Steps To Reproduce

1. Create a plain text file with the following content:

public class App {
  public static void main( String[] args ) {
    //                          ↓
    int val1 = new int[]{ 1, 2 }[0];
    //                           ↓
    System.out.println("val1=" + val1);

    int[] arr = new int[]{ 1, 2 };
    //         ↓        ↓
    int val2 = arr[0] + arr[1];
  }
}

2. Select the Language Mode to Java (java).

3. You can see that there are several places where the syntax highlighting is incorrect for the down arrows(↓). You can verify this by opening the Command Center and entering the following command: >Developer: Inspect Editor Tokens and Scopes
   (See images below.)

Current Result

Expected Result

Additional Informations

Originally from @tzengshinfu in microsoft/vscode#206975

[rgrunber]

@hopehadfield might be worth seeing if it's possible to fix this purely in the grammar.

Update: Would be worth looking at

vscode-java/language-support/java/java.tmLanguage.json

Lines 203 to 210 in 7f89deb

	"anonymous-classes-and-new": {
	"begin": "\\bnew\\b",
	"beginCaptures": {
	"0": {
	"name": "keyword.control.new.java"
	}
	},
	"end": "(?=;|\\)|\\]|\\.|,|\\?|:|}|\\+|\\-|\\*|\\/(?!\\/|\\*)|%|!|&|\\||\\^|=)",

vscode-java/language-support/java/java.tmLanguage.json

Lines 250 to 281 in 7f89deb

	{
	"begin": "(?<=\\])",
	"end": "(?=;|\\)|\\]|\\.|,|\\?|:|}|\\+|\\-|\\*|\\/(?!\\/|\\*)|%|!|&|\\||\\^|=)",
	"patterns": [
	{
	"include": "#comments"
	},
	{
	"begin": "{",
	"beginCaptures": {
	"0": {
	"name": "punctuation.section.array-initializer.begin.bracket.curly.java"
	}
	},
	"end": "}",
	"endCaptures": {
	"0": {
	"name": "punctuation.section.array-initializer.end.bracket.curly.java"
	}
	},
	"name": "meta.array-initializer.java",
	"patterns": [
	{
	"include": "#code"
	}
	]
	}
	]
	},
	{
	"include": "#parens"
	}