S3

0 articles

S3 Browser Direct Upload CORS Pitfall Record: Complete Debugging Process from "Network Error" to Dual-Cloud Upload

Based on practical experience with the JoyMini dual-cloud storage architecture, this article fully documents the debugging process from "Featured image upload failed: network error" to identifying the missing CORS configuration on the S3 bucket, including analysis of the browser preflight mechanism, CLI instant fix, CDK persistent configuration, and key differences in CORS behavior between R2 and S3.

Operations and Deployment

S3→R2 Cross-Cloud Disaster Recovery Sync Deep Architecture: A Complete Practice from Real-time Events to Incremental Synchronization

Based on JoyMini's real project experience, this article provides an in-depth analysis of the complete architectural design of an S3 to Cloudflare R2 cross-cloud disaster recovery synchronization system. It covers SQS real-time event-driven pipelines, Lambda concurrent streaming optimization, ETag incremental detection, DLQ+SNS failure notification mechanisms, and AWS CDK Infrastructure as Code best practices.

Operations and Deployment

JoyMini AWS Cloud Infrastructure Practical Summary: Complete Deployment from ECS Fargate to S3 + CloudFront

Based on real experience from the JoyMini project, this article systematically summarizes the complete practice of building AWS cloud infrastructure from scratch, including ECS Fargate container deployment, ALB + ACM domain integration, S3 + CloudFront OAC image storage, CDK Infrastructure as Code, and GitHub Actions CI/CD automation pipelines.

Large File Chunked Upload Architecture Design: R2 Multipart Upload from Plan to Implementation

This article provides an in-depth analysis of the technical solution selection for R2 Multipart Upload chunked upload, backend architecture design (Redis session management + pre-signed chunk URLs), the implementation of the frontend FileChunkedUploader utility class, and a comparison with the existing pre-signed URL direct upload solution.

Interface Management

GlobalUploadService: S3 Direct Upload + Compression Pipeline + MIME Correction

A Flutter file upload system supporting S3 presigned URL direct upload, magic number-based MIME type detection, a compression pipeline, an upload queue with concurrency limits, exponential backoff retry, chunked upload for large files, and real-time progress tracking.

Multi-platform

API File Upload System — Cloudflare R2 S3 + BullMQ Media Processing Pipeline

JoyMini API's file upload system is based on Cloudflare R2 S3 object storage and BullMQ asynchronous queues, covering a complete media processing pipeline including image compression (Sharp), video HLS transcoding (FFmpeg), and BlurHash generation.

Interface Management

Full-Stack File Upload Pipeline — API UploadService → Flutter GlobalUploadService → admin-next

NestJS UploadService (Cloudflare R2 Dual Bucket Strategy) → Flutter GlobalUploadService (Presigned URL Direct Upload, Magic Byte MIME Correction, Compression Pipeline) → admin-next HttpClient.upload (Media Upload & CDN Processing)

Management Backend