[Cyberduck-trac] [Cyberduck] #7496: Swift S3 emulation: could not upload file bigger then 10MB

Cyberduck trac at trac.cyberduck.ch
Tue Oct 22 17:20:28 UTC 2013


#7496: Swift S3 emulation: could not upload file bigger then 10MB
-----------------------+---------------------------
    Reporter:  din     |      Owner:  dkocher
        Type:  defect  |     Status:  new
    Priority:  normal  |  Milestone:  4.4
   Component:  s3      |    Version:  Nightly Build
    Severity:  normal  |   Keywords:
Architecture:  Intel   |   Platform:  Windows 7
-----------------------+---------------------------
 Hi, I have problem with uploading files bigger then 10MB to my swift
 cluster with s3 emulation [https://github.com/fujita/swift3].
 When uploading file smaller then 10MB cyberduck generate PUT request and
 everything is ok, but when file > 10MB there is a bunch of POST request
 with ?uploads parameter which gets 503 responses from server (example of
 upload 100MB file):

 {{{
  [Window Title]
 Error

 [Main Instruction]
 Upload failed (/write/testfile100MB).

 [Content]
 Encountered too many Internal Server errors (6), aborting request.

 [Expanded Information]
 CONNECT example.com:443 HTTP/1.1
 Host: example.com:443
 Proxy-Connection: Keep-Alive
 User-Agent: Cyberduck/4.4 (13515) (Windows 7/6.1) (x86)
 HTTP/1.1 200 Connection Established
 FiddlerGateway: Direct
 StartTime: 18:45:13.939
 Connection: close
 GET / HTTP/1.1
 Date: Tue, 22 Oct 2013 16:45:13 GMT
 Authorization: AWS TestUser1234:admin:rvyjGd0jqRHXoifUJx9RLVcYW2Q=
 Host: example.com:443
 Connection: Keep-Alive
 User-Agent: Cyberduck/4.4 (13515) (Windows 7/6.1) (x86)
 HTTP/1.1 200 OK
 Content-Length: 795
 Content-Type: application/xml
 X-Trans-Id: tx3bf0e548772a41e5bc8fa89856cbd7a2
 Date: Tue, 22 Oct 2013 16:45:15 GMT
 Connection: keep-alive
 HEAD /write/testfile100MB HTTP/1.1
 Date: Tue, 22 Oct 2013 16:45:15 GMT
 Authorization: AWS TestUser1234:admin:NVdo4WwBPlvgMOrnCusm3M4QCAM=
 Host: example.com:443
 Connection: Keep-Alive
 User-Agent: Cyberduck/4.4 (13515) (Windows 7/6.1) (x86)
 HTTP/1.1 404 Not Found
 Content-Length: 149
 Content-Type: text/xml
 X-Trans-Id: tx738f9abceef7471ba6d6654362c78d58
 Date: Tue, 22 Oct 2013 16:45:15 GMT
 Connection: keep-alive
 HEAD /write/testfile100MB HTTP/1.1
 Date: Tue, 22 Oct 2013 16:45:15 GMT
 Authorization: AWS TestUser1234:admin:NVdo4WwBPlvgMOrnCusm3M4QCAM=
 Host: example.com:443
 Connection: Keep-Alive
 User-Agent: Cyberduck/4.4 (13515) (Windows 7/6.1) (x86)
 HTTP/1.1 404 Not Found
 Content-Length: 149
 Content-Type: text/xml
 X-Trans-Id: tx16b49faa75804429b5d4ca00f2413577
 Date: Tue, 22 Oct 2013 16:45:15 GMT
 Connection: keep-alive
 POST /write/testfile100MB?uploads HTTP/1.1
 Date: Tue, 22 Oct 2013 16:45:15 GMT
 Content-Type: application/octet-stream
 Authorization: AWS TestUser1234:admin:w0PDP7/4vYjvEgsvqn12/yTk3vw=
 Content-Length: 0
 Host: example.com:443
 Connection: Keep-Alive
 User-Agent: Cyberduck/4.4 (13515) (Windows 7/6.1) (x86)
 HTTP/1.1 503 Service Unavailable
 Content-Length: 148
 Content-Type: text/xml
 X-Trans-Id: txfb609970cfad4d45849328e8584375d9
 Date: Tue, 22 Oct 2013 16:45:15 GMT
 Connection: keep-alive
 POST /write/testfile100MB?uploads HTTP/1.1
 Date: Tue, 22 Oct 2013 16:45:15 GMT
 Content-Type: application/octet-stream
 Authorization: AWS TestUser1234:admin:w0PDP7/4vYjvEgsvqn12/yTk3vw=
 Content-Length: 0
 Host: example.com:443
 Connection: Keep-Alive
 User-Agent: Cyberduck/4.4 (13515) (Windows 7/6.1) (x86)
 HTTP/1.1 503 Service Unavailable
 Content-Length: 148
 Content-Type: text/xml
 X-Trans-Id: txc330270b6b814e0dbfe995d74ac1cf4e
 Date: Tue, 22 Oct 2013 16:45:15 GMT
 Connection: keep-alive
 POST /write/testfile100MB?uploads HTTP/1.1
 Date: Tue, 22 Oct 2013 16:45:15 GMT
 Content-Type: application/octet-stream
 Authorization: AWS TestUser1234:admin:w0PDP7/4vYjvEgsvqn12/yTk3vw=
 Content-Length: 0
 Host: example.com:443
 Connection: Keep-Alive
 User-Agent: Cyberduck/4.4 (13515) (Windows 7/6.1) (x86)
 HTTP/1.1 503 Service Unavailable
 Content-Length: 148
 Content-Type: text/xml
 X-Trans-Id: txf917b7bc98e94bbdbc9dc991ae9445c1
 Date: Tue, 22 Oct 2013 16:45:16 GMT
 Connection: keep-alive
 POST /write/testfile100MB?uploads HTTP/1.1
 Date: Tue, 22 Oct 2013 16:45:16 GMT
 Content-Type: application/octet-stream
 Authorization: AWS TestUser1234:admin:qi9JL4fsX+vWTBZix14klLdTgkE=
 Content-Length: 0
 Host: example.com:443
 Connection: Keep-Alive
 User-Agent: Cyberduck/4.4 (13515) (Windows 7/6.1) (x86)
 HTTP/1.1 503 Service Unavailable
 Content-Length: 148
 Content-Type: text/xml
 X-Trans-Id: txe8adddff51894a64b60f4656eadddcd3
 Date: Tue, 22 Oct 2013 16:45:16 GMT
 Connection: keep-alive
 }}}

 With s3curl I can upload files bigger then 10MB. In stable version problem
 not exist.

-- 
Ticket URL: <https://trac.cyberduck.ch/ticket/7496>
Cyberduck <http://cyberduck.ch>
Open source FTP, SFTP, WebDAV, Cloud Files, Google Docs & Amazon S3 Browser for Mac & Windows.


More information about the Cyberduck-trac mailing list