Skip to content

Conversation

@JonatanWaern
Copy link
Contributor

  • Improvements to lexer and testing
  • Add parity test

Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR bumps the logos library from version 0.15 to 0.16 and improves lexer/parser handling of unicode characters, particularly for UTF-16 encoding support. The changes ensure proper column position tracking for multi-byte unicode characters and fix issues with unended comment blocks.

Key Changes:

  • Upgraded logos dependency to version 0.16
  • Fixed unicode character handling in multiline comments and C-blocks by switching from byte-based to character-based operations
  • Updated parser to use UTF-16 encoding for column calculations to match LSP server defaults
  • Added comprehensive tests for unicode handling and unended blocks

Reviewed changes

Copilot reviewed 8 out of 8 changed files in this pull request and generated 4 comments.

Show a summary per file
File Description
Cargo.toml Bumped logos dependency from 0.15 to 0.16
src/server/mod.rs Added comment documenting UTF-16 default position encoding
src/analysis/parsing/parser.rs Updated column calculations to use UTF-16 encoding and added unicode test
src/analysis/parsing/lexer.rs Refactored multiline comment and C-block handlers to properly support unicode characters
CHANGELOG.md Documented bug fixes for unicode and unended block handling
.github/workflows/rust.yml Removed nightly cron schedule from main workflow
.github/workflows/nightly.yml Created dedicated nightly workflow with parity testing
.github/workflows/binaries.yml Added parity test support with configurable test path

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

- Bump Logos to .16
- Do not rely on Logos internals
- Fix error in cblock handling
- Fix errors in unicode and utf-16 handling
- Add tests for above

Signed-off-by: Jonatan Waern <[email protected]>
Signed-off-by: Jonatan Waern <[email protected]>
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 8 out of 8 changed files in this pull request and generated 1 comment.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copy link

@TSonono TSonono left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@JonatanWaern JonatanWaern merged commit 753c548 into main Dec 10, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants