Multipart Upload
Large objects should be uploaded to your bucket via multipart upload.Using AWS CLI
Assuming you have AWS CLI set up already:~/Projects/s3-test/testdata/10Gfileis the path to the raw bytes stored locallys3://target-bucket/10Gfileis the target bucket name and the object key (aka object name)
Using AWS API/SDK
The general procedure to use the API/SDK is as follows:1
CreateMultipartUpload
Initiate the upload session with CreateMultipartUpload.
2
UploadPart
Stream each chunk with UploadPart.
3
CompleteMultipartUpload
Finalize the transfer by calling CompleteMultipartUpload.