Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Types issue while checking arguments for embedding #19

Open
AhmedCoolProjects opened this issue Feb 7, 2025 · 2 comments
Open
Assignees
Labels
bug Something isn't working no-issue-activity

Comments

@AhmedCoolProjects
Copy link

AhmedCoolProjects commented Feb 7, 2025

Describe the bug
Used the same proposed script in the Readme file, and got this error:

Screenshots
Image

Additional context

# Create a tensor for the image
image = torch.rand(1, 3, 224, 224)

# Create a tensor for the text
text = torch.randn(1, 1, 512)

# Create an instance of the ScreenAI model with specified parameters
model = ScreenAI(
    patch_size=16,
    image_size=224,
    dim=512,
    depth=6,
    heads=8,
    vit_depth=4,
    multi_modal_encoder_depth=4,
    llm_decoder_depth=4,
    mm_encoder_ff_mult=4,
    num_tokens=512,
    max_seq_len=512,
)

# Perform forward pass of the model with the given text and image tensors
out = model(text, image)

# Print the shape of the output tensor
print(out)
@AhmedCoolProjects AhmedCoolProjects added the bug Something isn't working label Feb 7, 2025
Copy link

github-actions bot commented Feb 7, 2025

Hello there, thank you for opening an Issue ! 🙏🏻 The team was notified and they will get back to you asap.

Copy link

github-actions bot commented Apr 9, 2025

Stale issue message

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working no-issue-activity
Projects
None yet
Development

No branches or pull requests

2 participants