Upload file to S3, CloudStorage | Voters

Upload file to S3, CloudStorage

planned

Phat Tran

Implement file management system, allowing the user to attach files, and upload avatar to S3, Cloud Storage.

December 24, 2024

Alexandru Stefanescu

Minion S3 is also a great idea because we can self host it.

Nolan Dubeau

Would you also be considering GCP for storage?

Support

marked this post as

planned

Support

Hi Phat,

Thanks for mentioning :)

I always wanted to implemented three scenarios:

Simple picture upload
Simple file upload
Filetree with upload

Furthermore a storage helper app:

DB -> Cloud Storage
Cloud Storage -> DB

With the new Turborepo setup this will become something like this:

apps/storage-migrator
packages/storage

As for the storage:

AWS S3
CF R2
Vercel Blob

Leonardo Marciano

Support 
To be more general and avoid upload errors related to firewalls (most firewalls do not support uploads larger than 300MB, such as Cloudflare's free and plus plans, Sucuri, etc.), you could use an upload authorization
 approach.
Simply generate a pre-signed URL
.
🔗 Uploading to Amazon S3 directly from a web or mobile application
In general, any S3-compatible API
 supports this feature.
This approach reduces server load
 on memory write operations, prevents Node.js event-loop blocking
 caused by buffering and in-memory streaming before writing to the server, and avoids issues in Kubernetes environments
, where maintaining state is often not feasible.