[Cyberduck-trac] [Cyberduck] #8263: Downloading gzipped files decompresses and truncates the content

[Cyberduck]

#8263: Downloading gzipped files decompresses and truncates the content
---------------------------------+------------------------
 Reporter:  thuettner            |         Owner:  dkocher
     Type:  defect               |        Status:  new
 Priority:  high                 |     Milestone:  4.6.4
Component:  s3                   |       Version:  4.5.2
 Severity:  normal               |    Resolution:
 Keywords:  AWS, S3, CloudTrail  |  Architecture:  Intel
 Platform:  Windows 8.1          |
---------------------------------+------------------------
Changes (by dkocher):

 * status:  reopened => new
 * milestone:  4.7 => 4.6.4


Comment:

 I can reproduce the bug here with files in S3 that are compressed with a
 `Content-Encoding: gzip` custom header set using metadata. The problem is
 that we limit reading from the known deflated size of an object which
 works in general for WebDAV because the `Content-Encoding` will be applied
 on the fly when serving the file. The file is stored on the server
 uncompressed and its length is known and we will read up the `n` bytes of
 the uncompressed file from the deflated stream. Compared to S3, the file
 is always compressed and the deflated size is not known. We only read the
 `n` bytes equal the compressed object from the deflated stream.

 As a resolution I think we best disable the detection of `Content-
 Encoding` when connected to S3 instead of fixing the issue as otherwise
 users will have downloaded `.gz` files that are already decompressed. We
 may better want to retrieve the compressed file as is (and advertised in
 the object key extension).

-- 
Ticket URL: <https://trac.cyberduck.io/ticket/8263#comment:18>
Cyberduck <http://cyberduck.io>
Libre FTP, SFTP, WebDAV, S3 & OpenStack Swift browser for Mac and Windows