Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Harbour Replication Management Individual Mirror Synchronisation Failed #21684

Open
yanpeng0417 opened this issue Mar 3, 2025 · 3 comments
Open
Assignees
Labels
area/replication kind/question more-info-needed The issue author need to provide more details and context to the issue needs/follow-up

Comments

@yanpeng0417
Copy link

yanpeng0417 commented Mar 3, 2025

harbor: version 2.80
复制任务:
Image
error01:
Image

error02:
ERROR
2025-03-03T08:16:02Z [INFO] [/controller/replication/transfer/image/transfer.go:139]: client for source registry [type: harbor, URL: https://10.73.64.28:8443, insecure: true] created
2025-03-03T08:16:02Z [INFO] [/controller/replication/transfer/image/transfer.go:149]: client for destination registry [type: harbor, URL: http://core:8080, insecure: true] created
2025-03-03T08:16:02Z [INFO] [/controller/replication/transfer/image/transfer.go:182]: copying
2025-03-03T08:16:02Z [INFO] [/controller/replication/transfer/image/transfer.go:210]:
2025-03-03T08:16:02Z [INFO] [/controller/replication/transfer/image/transfer.go:467]: pullingsha256:a987447eb8257a34f2613f875c3b3d16fed2815026a2dc3491989ff5e729853d by chunk(chunkSize: 10485760)(the 1th running)...
2025-03-03T08:16:02Z [INFO] [/controller/replication/transfer/image/transfer.go:315]: copy the blob sha256:a987447eb8257a34f2613f875c3b3d16fed2815026a2dc3491989ff5e729853d by chunk completed
2025-03-03T08:16:02Z [INFO] [/controller/replication/transfer/image/transfer.go:313]: copying the blob sha256:2d473b07cdd5f0912cd6f1a703352c82b512407db6b05b43f2553732b55df3bc by chunk(chunkSize: 10485760)(the 1th running)...
2025-03-03T08:16:02Z [INFO] [/controller/replication/transfer/image/transfer.go:339]: the blob sha256:2d473b07cdd5f0912cd6f1a703352c82b512407db6b05b43f2553732b55df3bc already exists on the destination registry, skip
2025-03-03T08:16:02Z [INFO] [/controller/replication/transfer/image/transfer.go:315]: copy the blob sha256:2d473b07cdd5f0912cd6f1a703352c82b512407db6b05b43f2553732b55df3bc by chunk completed
2025-03-03T08:16:02Z [INFO] [/controller/replication/transfer/image/transfer.go:313]: copying the blob sha256:02520f87fdbafebacf0cc85b25ac056c4e12955ce9f4a6ed74720358eb6beb95 by chunk(chunkSize: 10485760)(the 1th running)...
2025-03-03T08:16:02Z [INFO] [/controller/replication/transfer/image/transfer.go:315]: copy the blob sha256:02520f87fdbafebacf0cc85b25ac056c4e12955ce9f4a6ed74720358eb6beb95 by chunk completed
2025-03-03T08:16:02Z [INFO] [/controller/replication/transfer/image/transfer.go:313]: copying the blob sha256:d03c5838c3e3925b055fef1bf4d254d87ce724bcb90dce0e7dc26272aef9a1f8 by chunk(chunkSize: 10485760)(the 1th running)...
2025-03-03T08:21:07Z [ERROR] [/controller/replication/transfer/image/transfer.go:395]: failed to pushing the blob sha256:d03c5838c3e3925b055fef1bf4d254d87ce724bcb90dce0e7dc26272aef9a1f8, size 5153322: Put "http://core:8080/v2/app-images/dssv-jc-gateway/blobs/uploads/dd11faea-142a-488a-a195-ba3e80e944ac?_state=9SIHHQf6kM8eNERjyn6oOQerJv0U52MEOJAhEBOm02N7Ik5hbWUiOiJhcHAtaW1hZ2VzL2Rzc3YtamMtZ2F0ZXdheSIsIlVVSUQiOiJkZDExZmFlYS0xNDJhLTQ4OGEtYTE5NS1iYTNlODBlOTQ0YWMiLCJPZmZzZXQiOjAsIlN0YXJ0ZWRBdCI6IjIwMjUtMDMtMDNUMDg6MTY6MDIuNzkyNjI2MDk0WiJ9&digest=sha256%3Ad03c5838c3e3925b055fef1bf4d254d87ce724bcb90dce0e7dc26272aef9a1f8": readfrom tcp 172.100.0.9:56646->172.100.0.8:8080: read tcp 172.100.0.9:40830->10.73.64.28:8443: read: connection timed out
2025-03-03T08:21:07Z [INFO] [/controller/replication/transfer/image/transfer.go:321]: will retry 2s later
2025-03-03T08:21:09Z [INFO] [/controller/replication/transfer/image/transfer.go:313]: copying the blob sha256:d03c5838c3e3925b055fef1bf4d254d87ce724bcb90dce0e7dc26272aef9a1f8 by chunk(chunkSize: 10485760)(the 2th running)...
2025-03-03T08:21:12Z [INFO] [/controller/replication/transfer/image/transfer.go:315]: copy the blob sha256:d03c5838c3e3925b055fef1bf4d254d87ce724bcb90dce0e7dc26272aef9a1f8 by chunk completed
2025-03-03T08:21:12Z [INFO] [/controller/replication/transfer/image/transfer.go:313]: copying the blob sha256:1aef3646ddaf4f1e047ac8304039b3c316abbfc39af7f7c420950e223e58407a by chunk(chunkSize: 10485760)(the 1th running)...
2025-03-03T08:21:12Z [INFO] [/controller/replication/transfer/image/transfer.go:339]: the blob sha256:1aef3646ddaf4f1e047ac8304039b3c316abbfc39af7f7c420950e223e58407a already exists on the destination registry, skip
2025-03-03T08:21:12Z [INFO] [/controller/replication/transfer/image/transfer.go:315]: copy the blob sha256:1aef3646ddaf4f1e047ac8304039b3c316abbfc39af7f7c420950e223e58407a by chunk completed
2025-03-03T08:21:12Z [INFO] [/controller/replication/transfer/image/transfer.go:313]: copying the blob sha256:31d8a91e4bb15e1f2347d4825a8a4ae6efe81b151a4b9fe952a113c2b2f8aac2 by chunk(chunkSize: 10485760)(the 1th running)...
2025-03-03T08:21:12Z [INFO] [/controller/replication/transfer/image/transfer.go:315]: copy the blob sha256:31d8a91e4bb15e1f2347d4825a8a4ae6efe81b151a4b9fe952a113c2b2f8aac2 by chunk completed
2025-03-03T08:21:12Z [INFO] [/controller/replication/transfer/image/transfer.go:313]: copying the blob sha256:5279dfdfdc0d63096b450493e276302446968c2c2a4657c4adff6f7e212b4e5d by chunk(chunkSize: 10485760)(the 1th running)...
2025-03-03T08:21:12Z [INFO] [/controller/replication/transfer/image/transfer.go:339]: the blob sha256:5279dfdfdc0d63096b450493e276302446968c2c2a4657c4adff6f7e212b4e5d already exists on the destination registry, skip
2025-03-03T08:21:12Z [INFO] [/controller/replication/transfer/image/transfer.go:315]: copy the blob sha256:5279dfdfdc0d63096b450493e276302446968c2c2a4657c4adff6f7e212b4e5d by chunk completed
2025-03-03T08:21:12Z [INFO] [/controller/replication/transfer/image/transfer.go:313]: copying the blob sha256:542f726dbafbb2dc9f11422baae24f517e3a82ef092ae0a5cce81281eb617224 by chunk(chunkSize: 10485760)(the 1th running)...
2025-03-03T08:21:12Z [INFO] [/controller/replication/transfer/image/transfer.go:430]: copying the blob chunk: 0-10485759/96602056
2025-03-03T08:21:14Z [ERROR] [/controller/replication/transfer/image/transfer.go:444]: failed to pushing the blob chunk: 0-10485759/96602056, error: failed to get upload status: http status code: 404, body: {"errors":[{"code":"BLOB_UPLOAD_INVALID","message":"blob upload invalid"}]}
2025-03-03T08:21:14Z [INFO] [/controller/replication/transfer/image/transfer.go:321]: will retry 2s later
2025-03-03T08:21:16Z [INFO] [/controller/replication/transfer/image/transfer.go:313]: copying the blob sha256:542f726dbafbb2dc9f11422baae24f517e3a82ef092ae0a5cce81281eb617224 by chunk(chunkSize: 10485760)(the 2th running)...
2025-03-03T08:21:16Z [INFO] [/controller/replication/transfer/image/transfer.go:430]: copying the blob chunk: 0-10485759/96602056
2025-03-03T08:21:21Z [ERROR] [/controller/replication/transfer/image/transfer.go:444]: failed to pushing the blob chunk: 0-10485759/96602056, error: failed to get upload status: http status code: 404, body: {"errors":[{"code":"BLOB_UPLOAD_INVALID","message":"blob upload invalid"}]}
2025-03-03T08:21:21Z [INFO] [/controller/replication/transfer/image/transfer.go:321]: will retry 4s later
2025-03-03T08:21:25Z [INFO] [/controller/replication/transfer/image/transfer.go:313]: copying the blob sha256:542f726dbafbb2dc9f11422baae24f517e3a82ef092ae0a5cce81281eb617224 by chunk(chunkSize: 10485760)(the 3th running)...
2025-03-03T08:21:25Z [INFO] [/controller/replication/transfer/image/transfer.go:430]: copying the blob chunk: 0-10485759/96602056
2025-03-03T08:21:30Z [ERROR] [/controller/replication/transfer/image/transfer.go:444]: failed to pushing the blob chunk: 0-10485759/96602056, error: failed to get upload status: http status code: 404, body: {"errors":[{"code":"BLOB_UPLOAD_INVALID","message":"blob upload invalid"}]}
2025-03-03T08:21:30Z [INFO] [/controller/replication/transfer/image/transfer.go:321]: will retry 8s later
2025-03-03T08:21:38Z [INFO] [/controller/replication/transfer/image/transfer.go:313]: copying the blob sha256:542f726dbafbb2dc9f11422baae24f517e3a82ef092ae0a5cce81281eb617224 by chunk(chunkSize: 10485760)(the 4th running)...
2025-03-03T08:21:38Z [INFO] [/controller/replication/transfer/image/transfer.go:430]: copying the blob chunk: 0-10485759/96602056
2025-03-03T08:21:41Z [ERROR] [/controller/replication/transfer/image/transfer.go:444]: failed to pushing the blob chunk: 0-10485759/96602056, error: failed to get upload status: http status code: 404, body: {"errors":[{"code":"BLOB_UPLOAD_INVALID","message":"blob upload invalid"}]}
2025-03-03T08:21:41Z [INFO] [/controller/replication/transfer/image/transfer.go:321]: will retry 16s later
2025-03-03T08:21:57Z [INFO] [/controller/replication/transfer/image/transfer.go:313]: copying the blob sha256:542f726dbafbb2dc9f11422baae24f517e3a82ef092ae0a5cce81281eb617224 by chunk(chunkSize: 10485760)(the 5th running)...
2025-03-03T08:21:57Z [INFO] [/controller/replication/transfer/image/transfer.go:430]: copying the blob chunk: 0-10485759/96602056
2025-03-03T08:27:02Z [ERROR] [/controller/replication/transfer/image/transfer.go:444]: failed to pushing the blob chunk: 0-10485759/96602056, error: failed to get upload status: http status code: 404, body: {"errors":[{"code":"BLOB_UPLOAD_INVALID","message":"blob upload invalid"}]}
2025-03-03T08:27:02Z [ERROR] [/controller/replication/transfer/image/transfer.go:194]: failed to get upload status: http status code: 404, body: {"errors":[{"code":"BLOB_UPLOAD_INVALID","message":"blob upload invalid"}]}
2025-03-03T08:27:02Z [ERROR] [/controller/replication/transfer/image/transfer.go:200]: got error during the whole transfer period, mark the job failure

@Vad1mo
Copy link
Member

Vad1mo commented Mar 3, 2025

Please provide the full context, using the issue template..

@Vad1mo Vad1mo added the more-info-needed The issue author need to provide more details and context to the issue label Mar 3, 2025
@yanpeng0417
Copy link
Author

yanpeng0417 commented Mar 3, 2025

Image

error01:
Image

我两个harbor直接复制任务,部分成功,只有个别失败,harbor版本是一样的2.8.0.

@chlins
Copy link
Member

chlins commented Mar 11, 2025

Please provide the logs of the registry component as well.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/replication kind/question more-info-needed The issue author need to provide more details and context to the issue needs/follow-up
Projects
None yet
Development

No branches or pull requests

5 participants