Rowan tonel format is not sorting methods by Unicode code point (as specified in the tonel spec)

[dalehenrich]

Rowan currently uses Unicode sort order, however Unicode sort order is subject to the Locale and tonel method sort order needs to be independent of Locale see internal GemStone bug 51330).

The tonel spec calls out that the sort order should be Unicode code point order.

This needs to be fixed in Rowan 3.

[dalehenrich]

In order to sort by unicode code point the codePointCompareTo: method should be used in GemStone (thanks @martinmcclure!):

({
'A_bc123' .
'foo' .
'_123Abc' .
'_123abc' .
'_ABC123' .
'_abc123' .
} collect:[:each | each asUnicodeString ]) sortWithBlock: [:a :b | (a
codePointCompareTo: b) < 1]

[dalehenrich]

It seems that switching to Unicode code point sort order is a bigger change than originally thought

({
'Foo'.
'a_Bc123'.
'A_bc123' .
'foo' .
'_123Abc' .
'_123abc' .
'_ABC123' .
'_abc123' .
} collect:[:each | each ]) sortWithBlock: [:a :b | (a UnicodeString
codePointCompareTo: b) < 1]  

produces:

{
'A_bc123'.
'Foo'.
'_123Abc'.
'_123abc'.
'_ABC123'.
'_abc123'.
'a_Bc123'.
'foo'.
}

While sorting using Unicode sort order:

{
'Foo'.
'a_Bc123'.
'A_bc123' .
'foo' .
'_123Abc' .
'_123abc' .
'_ABC123' .
'_abc123' .
} collect:[:each | each asUnicodeString  ]) sort 

produces:

{
'_123abc'.
'_123Abc'.
'_abc123'.
'_ABC123'.
'a_Bc123'.
'A_bc123'.
'foo'.
'Foo'
}

Note that case differences significantly impacts sort order.

The implication is that there could be significant method order changes when switching the sorting algorithm, so we can't just change the method sort order used with existing Rowan 3 repositories ...

As a consequence, it will be necessary to allow users to choose to continue to use the old method sort order (unicode) or switch to the new method sort order (codePoint).

The unicode sort order will be used for existing repositories and for new repositories users will be able to choose which sort order will be used.

Newly created repositories will use codePoint sort order by default.