Skip to content

stdlib helpers: literal, layernorm, unsqueeze #256

@statusfailed

Description

@statusfailed

Add some helpers:

  • Literal: add a helper to create F32 / U32 literals and use in the GPT2 implementation
  • LayerNorm
    • Move LayerNorm to stdlib, reduce boilerplate using helpers
    • Create a Module for LayerNorm operating on rank-2 tensors, and a helper to call it
  • Squeeze / Unsqueeze helpers

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions