[Cyberduck-trac] [Cyberduck] #10801: Duck CLI upload log reports "upload complete", but it isn't complete

Thu Sep 12 14:50:26 UTC 2019

#10801: Duck CLI upload log reports "upload complete", but it isn't complete
---------------------------+-------------------------------
    Reporter:  MarkBlaise  |      Owner:
        Type:  defect      |     Status:  new
    Priority:  normal      |  Milestone:
   Component:  cli         |    Version:  7.0.1
    Severity:  normal      |   Keywords:  upload incomplete
Architecture:  Intel       |   Platform:  Windows 8.1
---------------------------+-------------------------------
 Using Cyberduck CLI and GUI v7.02 (30998). Uploaded a file with this
 command:

 {{{
 duck -P --existing resume --parallel 32    -r --upload wasabisys-us-
 west-1://T5ZHIOV9VGMNBAKU1HQ4 at blaise-backup-west/Magni/Diff/ <local-file>

 }}}

 The log file (attached) contains the following:

 {{{
 20190910-Magni-Daily_20190912014501.nbd…
 Resolving s3.us-west-1.wasabisys.com…
 Opening S3 connection to s3.us-west-1.wasabisys.com…
 S3 connection opened…
 Authenticating as T5ZHIOV9VGMNBAKU1HQ4…
 Login successful…
 Prepare 20190910-Magni-Daily_20190912014501.nbd (Overwrite)…
 Prepare 20190910-Magni-Daily_20190912014501.nbd (Overwrite)…
 Uploading 20190910-Magni-Daily_20190912014501.nbd…
 [▮                             ] 0 B of 6.3 GiB
 [▮                             ] 64.0 KiB (65,536 bytes) of 6.3 GiB (0%,
 51.6 KB/sec, 36.5 hours remaining)
 [▮                             ] 64.0 KiB (65,536 bytes) of 6.3 GiB (0%,
 51.6 KB/sec, 36.5 hours remaining)
 [▮                             ] 64.0 KiB (65,536 bytes) of 6.3 GiB (0%,
 51.5 KB/sec, 36.6 hours remaining)
 [▮                             ] 64.0 KiB (65,536 bytes) of 6.3 GiB (0%,
 51.4 KB/sec, 36.7 hours remaining)
 [▮                             ] 800.0 KiB (819,200 bytes) of 6.3 GiB (0%,
 560.7 KB/sec, 3.3 hours remaining)
 [▮                             ] 1.6 MiB (1,703,936 bytes) of 6.3 GiB (0%,
 1.1 MB/sec, 103 minutes remaining)
 [▮                             ] 3.1 MiB (3,276,800 bytes) of 6.3 GiB (0%,
 2.0 MB/sec, 57 minutes remaining)
 [▮                             ] 5.2 MiB (5,406,720 bytes) of 6.3 GiB (0%,
 3.0 MB/sec, 37 minutes remaining)

 ...

 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,472,171,520 bytes) of 6.3 GiB
 (95%, 25.2 MB/sec, 13 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,464,176,128 bytes) of 6.3 GiB
 (95%, 25.1 MB/sec, 14 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,464,208,896 bytes) of 6.3 GiB
 (95%, 25.1 MB/sec, 14 seconds remaining)
 Disconnecting s3.us-west-1.wasabisys.com…
 Resolving s3.us-west-1.wasabisys.com…
 Opening S3 connection to s3.us-west-1.wasabisys.com…
 S3 connection opened…
 Authenticating as T5ZHIOV9VGMNBAKU1HQ4…
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,438,322,176 bytes) of 6.3 GiB
 (94%, 25.0 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,439,010,304 bytes) of 6.3 GiB
 (94%, 25.0 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,439,862,272 bytes) of 6.3 GiB
 (94%, 25.0 MB/sec, 15 seconds remaining)
 Login successful…
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,440,583,168 bytes) of 6.3 GiB
 (94%, 25.0 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,433,734,656 bytes) of 6.3 GiB
 (94%, 25.0 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,434,652,160 bytes) of 6.3 GiB
 (94%, 24.9 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,435,471,360 bytes) of 6.3 GiB
 (94%, 24.9 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,436,159,488 bytes) of 6.3 GiB
 (94%, 24.9 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,436,585,472 bytes) of 6.3 GiB
 (94%, 24.9 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,437,142,528 bytes) of 6.3 GiB
 (94%, 24.9 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,437,568,512 bytes) of 6.3 GiB
 (94%, 24.9 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,438,158,336 bytes) of 6.3 GiB
 (94%, 24.9 MB/sec, 15 seconds remaining)
 Uploading 20190910-Magni-Daily_20190912014501.nbd…
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,438,256,640 bytes) of 6.3 GiB
 (94%, 24.7 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,438,354,944 bytes) of 6.3 GiB
 (94%, 24.7 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,438,453,248 bytes) of 6.3 GiB
 (94%, 24.7 MB/sec, 15 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.0 GiB (6,439,305,216 bytes) of 6.3 GiB
 (94%, 24.7 MB/sec, 15 seconds remaining)

 ...

 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,792,904,704 bytes) of 6.3 GiB
 (99%, 22.3 MB/sec, 1 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB
 (100%, 22.3 MB/sec)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB
 (100%, 20.4 MB/sec)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB
 (100%, 20.4 MB/sec)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB
 (100%, 20.4 MB/sec)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB
 (100%, 20.4 MB/sec)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,286,720 bytes) of 6.3 GiB
 (99%, 20.2 MB/sec, 1 seconds remaining)
 Disconnecting s3.us-west-1.wasabisys.com…
 Transfer incomplete. 20190910-Magni-Daily_20190912014501.nbd…
 Disconnecting s3.us-west-1.wasabisys.com…
 Resolving s3.us-west-1.wasabisys.com…
 Opening S3 connection to s3.us-west-1.wasabisys.com…
 S3 connection opened…
 Authenticating as T5ZHIOV9VGMNBAKU1HQ4…
 Login successful…
 Prepare 20190910-Magni-Daily_20190912014501.nbd (Resume)…
 Prepare 20190910-Magni-Daily_20190912014501.nbd (Resume)…
 Uploading 20190910-Magni-Daily_20190912014501.nbd…
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,286,720 bytes) of 6.3 GiB
 (99%, 0 B/sec)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,385,024 bytes) of 6.3 GiB
 (99%, 224.4 KB/sec, 40 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,516,096 bytes) of 6.3 GiB
 (99%, 382.3 KB/sec, 23 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,785,073,152 bytes) of 6.3 GiB
 (99%, 1.1 MB/sec, 8 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,785,957,888 bytes) of 6.3 GiB
 (99%, 2.1 MB/sec, 4 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,787,203,072 bytes) of 6.3 GiB
 (99%, 3.2 MB/sec, 2 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,789,300,224 bytes) of 6.3 GiB
 (99%, 5.0 MB/sec, 1 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,791,659,520 bytes) of 6.3 GiB
 (99%, 6.5 MB/sec, 1 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB
 (100%, 7.4 MB/sec)
 Upload complete. 20190910-Magni-Daily_20190912014501.nbd…

 }}}

 But the Cyberduck GUI still displays the file both as a "temp" or hidden
 file (which is displayed during upload), AND as a completed upload, with a
 size of only 8.5 MiB (the file is > 6 GiB). See attached screen shot.

 I have run the command again, thinking it might complete the upload. The
 log of that upload attempt follows:

 {{{
 20190910-Magni-Daily_20190912014501.nbd…
 Resolving s3.us-west-1.wasabisys.com…
 Opening S3 connection to s3.us-west-1.wasabisys.com…
 S3 connection opened…
 Authenticating as T5ZHIOV9VGMNBAKU1HQ4…
 Login successful…
 Prepare 20190910-Magni-Daily_20190912014501.nbd (Resume)…
 Prepare 20190910-Magni-Daily_20190912014501.nbd (Resume)…
 Getting permission of 20190910-Magni-Daily_20190912014501.nbd…
 Reading metadata of 20190910-Magni-Daily_20190912014501.nbd…
 Reading metadata of 20190910-Magni-Daily_20190912014501.nbd…
 Uploading 20190910-Magni-Daily_20190912014501.nbd…
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,286,720 bytes) of 6.3 GiB
 (99%, 0 B/sec)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,385,024 bytes) of 6.3 GiB
 (99%, 158.3 KB/sec, 56 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,784,679,936 bytes) of 6.3 GiB
 (99%, 500.3 KB/sec, 18 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,785,433,600 bytes) of 6.3 GiB
 (99%, 1.3 MB/sec, 7 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,786,285,568 bytes) of 6.3 GiB
 (99%, 1.9 MB/sec, 4 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,788,055,040 bytes) of 6.3 GiB
 (99%, 3.3 MB/sec, 2 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,789,464,064 bytes) of 6.3 GiB
 (99%, 4.0 MB/sec, 1 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,790,512,640 bytes) of 6.3 GiB
 (99%, 4.5 MB/sec, 1 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,791,561,216 bytes) of 6.3 GiB
 (99%, 4.7 MB/sec, 1 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮  ] 6.3 GiB (6,792,642,560 bytes) of 6.3 GiB
 (99%, 5.1 MB/sec, 1 seconds remaining)
 [▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮▮] 6.3 GiB (6,793,191,681 bytes) of 6.3 GiB
 (100%, 5.2 MB/sec)
 Changing permission of 20190910-Magni-Daily_20190912014501.nbd to {emby
 (8FB9BB3BC68B38ED3C1A76579156B52CEA5548EACBFCD3312D308CBAA1A19B96)=[FULL_CONTROL]}…
 Upload complete. 20190910-Magni-Daily_20190912014501.nbd…

 }}}

 The Cyberduck GUI display (after a refresh) is unchanged.

 I have run the command several more times with the same results.

 What am I to make of this?

--
Ticket URL: <https://trac.cyberduck.io/ticket/10801>
Cyberduck <https://cyberduck.io>
Libre FTP, SFTP, WebDAV, S3 & OpenStack Swift browser for Mac and Windows