provider-storj: Getting error 'not found' for every uploaded file #84

Open
opened 2026-01-19 18:28:54 +00:00 by michael · 14 comments
Owner

Originally created by @anaschaudhary33 on GitHub.

Originally assigned to: @stefanbenten on GitHub.

I have setup storj as provider. I can successfully upload the file, (I can verify the uploaded file in the storj bucket) but when I open the output url it giving me error 'Not found'.
Log

 [transfer.sh]2022/12/28 06:16:09 Error metadata: EOF
 [transfer.sh]2022/12/28 06:16:08 Getting file 62bc21edb1deb.mp4.metadata from Storj Bucket
[transfer.sh]2022/12/28 06:16:04 47.31.141.30:0 - - [2022-12-28T06:16:04Z] "PUT /62bc21edb1deb.mp4 HTTP/1.1" 200  "https://*******.sh/"; "Mozilla/5.0 (Android 11; Mobile; rv:108.0) Gecko/108.0 Firefox/108.0"
 [transfer.sh]2022/12/28 06:15:51 Uploading file 62bc21edb1deb.mp4 to Storj Bucket
 [transfer.sh]2022/12/28 06:15:51 Uploading Bdm5IY 62bc21edb1deb.mp4 11009799 
 [transfer.sh]2022/12/28 06:15:51 Uploading file 62bc21edb1deb.mp4.metadata to Storj Bucket
Originally created by @anaschaudhary33 on GitHub. Originally assigned to: @stefanbenten on GitHub. I have setup storj as provider. I can successfully upload the file, (I can verify the uploaded file in the storj bucket) but when I open the output url it giving me error 'Not found'. Log ``` [transfer.sh]2022/12/28 06:16:09 Error metadata: EOF [transfer.sh]2022/12/28 06:16:08 Getting file 62bc21edb1deb.mp4.metadata from Storj Bucket [transfer.sh]2022/12/28 06:16:04 47.31.141.30:0 - - [2022-12-28T06:16:04Z] "PUT /62bc21edb1deb.mp4 HTTP/1.1" 200 "https://*******.sh/"; "Mozilla/5.0 (Android 11; Mobile; rv:108.0) Gecko/108.0 Firefox/108.0" [transfer.sh]2022/12/28 06:15:51 Uploading file 62bc21edb1deb.mp4 to Storj Bucket [transfer.sh]2022/12/28 06:15:51 Uploading Bdm5IY 62bc21edb1deb.mp4 11009799 [transfer.sh]2022/12/28 06:15:51 Uploading file 62bc21edb1deb.mp4.metadata to Storj Bucket ```
michael added the bugdockerstorage provider labels 2026-01-19 18:28:54 +00:00
Author
Owner

@stefanbenten commented on GitHub:

Do you see both files in the bucket?
There should be the raw file and the .metadata file. The above suggests, that the metadata file isnt there. @anaschaudhary33

@stefanbenten commented on GitHub: Do you see both files in the bucket? There should be the raw file and the .metadata file. The above suggests, that the metadata file isnt there. @anaschaudhary33
Author
Owner

@anaschaudhary33 commented on GitHub:

Both filename and filename.metadata are present in the storj bucket.

@anaschaudhary33 commented on GitHub: Both filename and filename.metadata are present in the storj bucket.
Author
Owner

@stefanbenten commented on GitHub:

Could it be that your access grant does not allow list/download/deletes?
Did you try listing the bucket and downloading the file using the same access grant?

@stefanbenten commented on GitHub: Could it be that your access grant does not allow list/download/deletes? Did you try listing the bucket and downloading the file using the same access grant?
Author
Owner

@anaschaudhary33 commented on GitHub:

I have recheck(using uplink cli) that the access grant is able to list+download+delete.
I have also changed the access grant after verifying it's able to list+download+delete, but the error remains same.

@anaschaudhary33 commented on GitHub: I have recheck(using uplink cli) that the access grant is able to list+download+delete. I have also changed the access grant after verifying it's able to list+download+delete, but the error remains same.
Author
Owner

@stefanbenten commented on GitHub:

Would you mind sharing the setup details (without the secrets of course)? Command line arguments would help to double check.
I just setup a test instance and it works as expected..

@stefanbenten commented on GitHub: Would you mind sharing the setup details (without the secrets of course)? Command line arguments would help to double check. I just setup a test instance and it works as expected..
Author
Owner

@anaschaudhary33 commented on GitHub:

I have deployed docker image through northflank.com.

  1. Setup deployment source as dutchcoders/transfer.sh:latest.
  2. Setup runtime variables $PROVIDER $STORJ_ACCESS and $STORJ_BUCKET
  3. Runtime command is /go/bin/transfersh --listener :8080
  4. expose port 8080 to public
@anaschaudhary33 commented on GitHub: I have deployed docker image through [northflank.com](https://northflank.com/docs/v1/application/run/run-an-image-from-a-container-registry). 1. Setup deployment source as dutchcoders/transfer.sh:latest. 2. Setup runtime variables `$PROVIDER` `$STORJ_ACCESS` and `$STORJ_BUCKET` 3. Runtime command is `/go/bin/transfersh --listener :8080` 4. expose port 8080 to public
Author
Owner

@dillfrescott commented on GitHub:

Ok it has to do with the docker version. I ran it from the binary and it works fine...

@dillfrescott commented on GitHub: Ok it has to do with the docker version. I ran it from the binary and it works fine...
Author
Owner

@dillfrescott commented on GitHub:

Both the file and the metadata file are in the bucket too

@dillfrescott commented on GitHub: Both the file and the metadata file are in the bucket too
Author
Owner

@dillfrescott commented on GitHub:

Same error for me using storj

@dillfrescott commented on GitHub: Same error for me using storj
Author
Owner

@anaschaudhary33 commented on GitHub:

Tried similar setup with fly.io but no luck.

@anaschaudhary33 commented on GitHub: Tried similar setup with [fly.io](https://fly.io) but no luck.
Author
Owner

@paolafrancesca commented on GitHub:

@dillfrescott so we can close the issue, do we?

@paolafrancesca commented on GitHub: @dillfrescott so we can close the issue, do we?
Author
Owner

@paolafrancesca commented on GitHub:

@dillfrescott , @stefanbenten I had the same problem while testing #535

see my comment at https://github.com/dutchcoders/transfer.sh/pull/535#issuecomment-1454942106

I will try to reproduce with docker before and after #535 being merged

@paolafrancesca commented on GitHub: @dillfrescott , @stefanbenten I had the same problem while testing #535 see my comment at https://github.com/dutchcoders/transfer.sh/pull/535#issuecomment-1454942106 I will try to reproduce with docker before and after #535 being merged
Author
Owner

@stefanbenten commented on GitHub:

Lemme troubleshoot it when i get some spare cycles. I cannot see why docker would do something different..

@stefanbenten commented on GitHub: Lemme troubleshoot it when i get some spare cycles. I cannot see why docker would do something different..
Author
Owner

@dillfrescott commented on GitHub:

Okay

@dillfrescott commented on GitHub: Okay
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: dutchcoders/transfer.sh#84