Download gz file error: SHA256 mismatch #1

Open
opened 2025-12-29 15:21:19 +01:00 by adam · 0 comments
Owner

Originally created by @junjiefly on GitHub (Nov 25, 2025).

install deltaglider with pip.
s3 server is a minio server with version: 2023-03-24T21:41:23Z

(myenv) root@8900a2eb0550:/# cat /etc/issue
Ubuntu 24.04.3 LTS \n \l

(myenv) root@8900a2eb0550:/opt/log/dcache/cacheNode# python3 --version
Python 3.12.3

(myenv) root@8900a2eb0550:/# deltaglider --version
deltaglider 6.0.2
(myenv) root@8900a2eb0550:/# cd /opt/log/dcache/cacheNode/
(myenv) root@8900a2eb0550:/opt/log/dcache/cacheNode# gzip dcache.INFO
(myenv) root@8900a2eb0550:/opt/log/dcache/cacheNode# ll dcache.INFO.gz
-rw-r--r-- 1 root root 59444 May 21 2025 dcache.INFO.gz

(myenv) root@8900a2eb0550:/opt/log/dcache/cacheNode# deltaglider cp ./dcache.INFO.gz s3://backup/b1/dcache.INFO.gz
2025-11-25 15:51:41,714 - deltaglider - INFO - Starting put operation - {"file": "dcache.INFO.gz", "deltaspace": "backup/b1", "size": 59444}
2025-11-25 15:51:41,728 - deltaglider - INFO - Creating reference - {"key": "b1/reference.bin"}
2025-11-25 15:51:41,781 - deltaglider - INFO - Creating zero-diff delta - {"key": "b1/dcache.INFO.gz.delta"}
2025-11-25 15:51:41,794 - deltaglider.adapters.metrics_cloudwatch - INFO - METRIC:INCREMENT deltaglider.reference.created=1 tags={}
2025-11-25 15:51:41,794 - deltaglider - INFO - Operation: put - {"op": "put", "key": "b1/reference.bin", "deltaspace": "backup/b1", "sizes": {"file": 59444, "delta": 59444}, "durations": {"total": 0.080532}, "cache_hit": false}
2025-11-25 15:51:41,794 - deltaglider.adapters.metrics_cloudwatch - INFO - METRIC:TIMING deltaglider.put.duration=0.08ms tags={}
upload: 'dcache.INFO.gz' to 's3://backup/b1/reference.bin' (reference: 59444 bytes)
(myenv) root@8900a2eb0550:/opt/log/dcache/cacheNode#
(myenv) root@8900a2eb0550:/opt/log/dcache/cacheNode# deltaglider --debug cp s3://backup/b1/dcache.INFO.gz d.INFO.gz
2025-11-25 15:52:11,804 - deltaglider.adapters.storage_s3 - DEBUG - HEAD b1/dcache.INFO.gz.delta: Received metadata with 10 keys: ['dg-created-at', 'dg-delta-cmd', 'dg-delta-size', 'dg-file-sha256', 'dg-file-size', 'dg-note', 'dg-original-name', 'dg-ref-key', 'dg-ref-sha256', 'dg-tool']
Auto-detected delta: s3://backup/b1/dcache.INFO.gz.delta
2025-11-25 15:52:11,805 - deltaglider - INFO - Starting get operation - {"key": "b1/dcache.INFO.gz.delta"}
2025-11-25 15:52:11,810 - deltaglider.adapters.storage_s3 - DEBUG - HEAD b1/dcache.INFO.gz.delta: Received metadata with 10 keys: ['dg-created-at', 'dg-delta-cmd', 'dg-delta-size', 'dg-file-sha256', 'dg-file-size', 'dg-note', 'dg-original-name', 'dg-ref-key', 'dg-ref-sha256', 'dg-tool']
2025-11-25 15:52:11,810 - deltaglider - INFO - Caching reference - {"key": "b1/reference.bin"}
download failed: SHA256 mismatch: expected 9f4594d552eb2ee2160507e009e4746fd228dd38aa61c0c4c7ccb0e3d14c6666, got 2ebcb01d5094182c462bff54c28b8087ca67b11aa4d3c385a2cde6207e5cd9cf

Originally created by @junjiefly on GitHub (Nov 25, 2025). install deltaglider with pip. s3 server is a minio server with version: 2023-03-24T21:41:23Z (myenv) root@8900a2eb0550:/# cat /etc/issue Ubuntu 24.04.3 LTS \n \l (myenv) root@8900a2eb0550:/opt/log/dcache/cacheNode# python3 --version Python 3.12.3 (myenv) root@8900a2eb0550:/# deltaglider --version deltaglider 6.0.2 (myenv) root@8900a2eb0550:/# cd /opt/log/dcache/cacheNode/ (myenv) root@8900a2eb0550:/opt/log/dcache/cacheNode# gzip dcache.INFO (myenv) root@8900a2eb0550:/opt/log/dcache/cacheNode# ll dcache.INFO.gz -rw-r--r-- 1 root root 59444 May 21 2025 dcache.INFO.gz (myenv) root@8900a2eb0550:/opt/log/dcache/cacheNode# deltaglider cp ./dcache.INFO.gz s3://backup/b1/dcache.INFO.gz 2025-11-25 15:51:41,714 - deltaglider - INFO - Starting put operation - {"file": "dcache.INFO.gz", "deltaspace": "backup/b1", "size": 59444} 2025-11-25 15:51:41,728 - deltaglider - INFO - Creating reference - {"key": "b1/reference.bin"} 2025-11-25 15:51:41,781 - deltaglider - INFO - Creating zero-diff delta - {"key": "b1/dcache.INFO.gz.delta"} 2025-11-25 15:51:41,794 - deltaglider.adapters.metrics_cloudwatch - INFO - METRIC:INCREMENT deltaglider.reference.created=1 tags={} 2025-11-25 15:51:41,794 - deltaglider - INFO - Operation: put - {"op": "put", "key": "b1/reference.bin", "deltaspace": "backup/b1", "sizes": {"file": 59444, "delta": 59444}, "durations": {"total": 0.080532}, "cache_hit": false} 2025-11-25 15:51:41,794 - deltaglider.adapters.metrics_cloudwatch - INFO - METRIC:TIMING deltaglider.put.duration=0.08ms tags={} upload: 'dcache.INFO.gz' to 's3://backup/b1/reference.bin' (reference: 59444 bytes) (myenv) root@8900a2eb0550:/opt/log/dcache/cacheNode# (myenv) root@8900a2eb0550:/opt/log/dcache/cacheNode# deltaglider --debug cp s3://backup/b1/dcache.INFO.gz d.INFO.gz 2025-11-25 15:52:11,804 - deltaglider.adapters.storage_s3 - DEBUG - HEAD b1/dcache.INFO.gz.delta: Received metadata with 10 keys: ['dg-created-at', 'dg-delta-cmd', 'dg-delta-size', 'dg-file-sha256', 'dg-file-size', 'dg-note', 'dg-original-name', 'dg-ref-key', 'dg-ref-sha256', 'dg-tool'] Auto-detected delta: s3://backup/b1/dcache.INFO.gz.delta 2025-11-25 15:52:11,805 - deltaglider - INFO - Starting get operation - {"key": "b1/dcache.INFO.gz.delta"} 2025-11-25 15:52:11,810 - deltaglider.adapters.storage_s3 - DEBUG - HEAD b1/dcache.INFO.gz.delta: Received metadata with 10 keys: ['dg-created-at', 'dg-delta-cmd', 'dg-delta-size', 'dg-file-sha256', 'dg-file-size', 'dg-note', 'dg-original-name', 'dg-ref-key', 'dg-ref-sha256', 'dg-tool'] 2025-11-25 15:52:11,810 - deltaglider - INFO - Caching reference - {"key": "b1/reference.bin"} download failed: SHA256 mismatch: expected 9f4594d552eb2ee2160507e009e4746fd228dd38aa61c0c4c7ccb0e3d14c6666, got 2ebcb01d5094182c462bff54c28b8087ca67b11aa4d3c385a2cde6207e5cd9cf
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: starred/deltaglider#1