Skip to content

feat(sync): add opt-in state interpolation for better video/state alignment #75

Description

@Rachit2323

Description:
The docs already document this as a future opt-in mode (docs/09-synchronization.md, line 340):

"interpolation would be a separate opt-in mode"

Right now Portal picks the nearest frame to match a robot state. The photo and robot position timestamps never match exactly.

I want to add interpolate_state: bool (default false). When enabled, continuous float fields in the state are interpolated to match the frame's timestamp — so the robot position perfectly matches what the camera captured. Bool and int fields stay as-is.

This improves ML training dataset quality.

Happy to implement if this direction looks good!

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions