-
Notifications
You must be signed in to change notification settings - Fork 3.2k
Remove signer override #25791
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove signer override #25791
Conversation
42ea7c3
to
5a6f4d4
Compare
Tested manually against Dell ECS |
It's no longer needed since AWS SDK v2 added a LegacyMd5Plugin to ensure backward compatibility with S3-compliant storage.
This is useful when testing manually against Dell ECS or other S3 compatible storage solution.
5a6f4d4
to
816a379
Compare
@twuebi can you check whether this change fixes your problem? |
Hi, thanks for the fix, I'm not sure how to test, I tried building Trino on mac with m3 but it failed on the trino-docs step, is there a docker image available for this PR? Following my analysis after stepping through the function with a debugger, the fix should work. |
@twuebi you can build without trino-docs (it should work) by calling |
Thanks, I managed to build trino now, but cannot build the docker image:
I also haven't gotten it to run on host:
I'm quite confident that your fix is working fine, if possible, could you go ahead and merge? I'll happily test once there's an image available. Otherwise, I'd also try suggestions to fix my build / run issues. |
You can try to build only your architecture: |
Thanks, that seems to work, I'll get back to you once I finished testing! |
I've pushed docker images built from this PR to my own docker hub: |
I've verified the fix, it works. I ran into some troubles where trino does not seem to send the try {
// S3 Tables internally assigns a unique location for each table
if (!isS3Tables(location.toString())) {
TrinoFileSystem fileSystem = fileSystemFactory.create(session.getIdentity(), transaction.table().io().properties());
if (!replace && fileSystem.listFiles(location).hasNext()) {
throw new TrinoException(ICEBERG_FILESYSTEM_ERROR, format("" +
"Cannot create a table on a non-empty location: %s, set 'iceberg.unique-table-location=true' in your Iceberg catalog properties " +
"to use unique table locations for every table.", location));
}
}
return newWritableTableHandle(tableMetadata.getTable(), transaction.table(), retryMode);
}
catch (IOException e) {
throw new TrinoException(ICEBERG_FILESYSTEM_ERROR, "Failed checking new table's location: " + location, e);
} anyways, many thanks for fixing this bug & helping me to build the container. |
@twuebi the second bug was actually related to iceberg 1.9.0 update (http client changes), credit goes to @chenjian2664 and @anusudarsan for fixing that :) |
Thanks a lot, just tested and it was indeed fixed by #25800! |
@twuebi our internal testing caught that :) |
It's no longer needed since AWS SDK v2 added a LegacyMd5Plugin to ensure backward compatibility with S3-compliant storage.
Should fix #25780
Description
Additional context and related issues
Release notes
( ) This is not user-visible or is docs only, and no release notes are required.
( ) Release notes are required. Please propose a release note for me.
(x) Release notes are required, with the following suggested text: