Skip to content

Refactor SBE Command Encoding to remove ThreadLocal#26

Open
vincentf13 wants to merge 1 commit intomasterfrom
jules-refactor-sbe-commands-13639435276955434047
Open

Refactor SBE Command Encoding to remove ThreadLocal#26
vincentf13 wants to merge 1 commit intomasterfrom
jules-refactor-sbe-commands-13639435276955434047

Conversation

@vincentf13
Copy link
Owner

Refactored SBE command and report models in the spot-infra module to use per-instance direct memory buffers (NativeUnsafeBuffer) for encoding, replacing the previous ThreadLocal based ThreadContext.get().getScratchBuffer() approach.

This increases the memory footprint per command instance slightly, but improves performance by avoiding ThreadLocal lookups and improves code readability.

Changes include:

  • AbstractSbeModel now initializes a NativeUnsafeBuffer locally.
  • SBE commands (AuthCommand, DepositCommand, OrderCreateCommand, OrderCancelCommand) wrap this new local buffer during encode.
  • Execution reports (OrderAcceptedReport, etc.) now locally instantiate their own ExecutionReportEncoder and write to the local encodeBuffer.

PR created automatically by Jules for task 13639435276955434047 started by @vincentf13

Co-authored-by: vincentf13 <13410214+vincentf13@users.noreply.github.com>
@google-labs-jules
Copy link
Contributor

👋 Jules, reporting for duty! I'm here to lend a hand with this pull request.

When you start a review, I'll add a 👀 emoji to each comment to let you know I've read it. I'll focus on feedback directed at me and will do my best to stay out of conversations between you and other bots or reviewers to keep the noise down.

I'll push a commit with your requested changes shortly after. Please note there might be a delay between these steps, but rest assured I'm on the job!

For more direct control, you can switch me to Reactive Mode. When this mode is on, I will only act on comments where you specifically mention me with @jules. You can find this option in the Pull Request section of your global Jules UI settings. You can always switch back!

New to Jules? Learn more at jules.google/docs.


For security, I will only act on instructions from the user who triggered this task.

Copy link

@chatgpt-codex-connector chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 0b66aaaed9

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

protected final MessageHeaderEncoder headerEncoder = new MessageHeaderEncoder();
protected final MessageHeaderDecoder headerDecoder = new MessageHeaderDecoder();
protected final UnsafeBuffer internalBuffer = new UnsafeBuffer(0, 0);
protected final NativeUnsafeBuffer encodeBuffer = new NativeUnsafeBuffer(256);

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Badge Release per-model NativeUnsafeBuffer on context cleanup

Allocating encodeBuffer in every AbstractSbeModel instance introduces new off-heap NativeUnsafeBuffer ownership, but there is no corresponding release() path (the existing ThreadContext.cleanup() only releases scratchBuffer). In services that restart worker threads (or recreate contexts), these command/report buffers remain unreleased until GC, so direct memory can accumulate across cycles and eventually hit MaxDirectMemorySize under sustained restarts.

Useful? React with 👍 / 👎.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant