[Cyberduck-trac] [Cyberduck] #10278: Optimize Checksum Calculation

Cyberduck trac at cyberduck.io
Wed Oct 31 09:47:04 UTC 2018


#10278: Optimize Checksum Calculation
-------------------------+------------------------
 Reporter:  allklier     |         Owner:  dkocher
     Type:  enhancement  |        Status:  new
 Priority:  normal       |     Milestone:
Component:  s3           |       Version:  6.4.1
 Severity:  normal       |    Resolution:
 Keywords:               |  Architecture:
 Platform:  macOS 10.12  |
-------------------------+------------------------

Comment (by dkocher):

 Replying to [comment:2 jamshid]:
 > Agreed, it would be great if there was a way to disable the checksum
 because it takes too long on >100GB files. I notice people complain about
 it e.g. https://community.rackspace.com/general/f/general-discussion-
 forum/1775/cyberduck-incredibly-slow
 >
 > PS: (looking through some code changes I see you already know this) but
 although the ETag calculation is not officially defined by Amazon, the
 resulting ETag is a completed multipart upload is an MD5 of each part's
 MD5 followed by "-" and the number of parts. This could be verified if
 you're paranoid, though I guess it would have to be recomputed if
 Cyberduck is restarted in the middle of a multipart upload.
 We already do compute the returned concatenated MD5 hash for multipart
 uploads (see
 [https://trac.cyberduck.io/browser/trunk/s3/src/main/java/ch/cyberduck/core/s3/S3MultipartUploadService.java
 S3MultipartUploadService].

--
Ticket URL: <https://trac.cyberduck.io/ticket/10278#comment:3>
Cyberduck <https://cyberduck.io>
Libre FTP, SFTP, WebDAV, S3 & OpenStack Swift browser for Mac and Windows


More information about the Cyberduck-trac mailing list