cbloom rants
10/13/2023
Patcher Part 8 : Summary
›
In this series I described how to build a patcher that can make very good (near minimal size) "coarse grain" patches, and run near...
10/08/2023
Patcher Part 7 : Patcher File IO and Parallelism
›
In the real world, a lot of the issues for making a very fast patcher are in the practical matters of parallelism and file IO, so let's ...
6 comments:
10/05/2023
Patcher Part 6 : Making a patcher from CDC
›
We have a scheme to cut our file into content-defined chunks . So let's use that to make a patcher. For each file, we can construct...
1 comment:
9/25/2023
Patcher Part 5 : Aside for some proofs
›
Just for my own entertainment, a brief aside to prove some facts we used in the last post. After drawing N random numbers in [0,1] , t...
1 comment:
9/14/2023
Patcher Part 4 : Content-Defined Chunking
›
The alternative to rsync-style patch generation is to use content-defined chunking (CDC). There's enough to say about CDC that I'll...
1 comment:
9/13/2023
Patcher Part 3 : How rsync works
›
rsync is not a patcher; it is a method for transmitting differences of data over a network connection. You can however build a patcher (&qu...
Patcher Part 2 : Some Rolling Hashes
›
Let's go through some options for rolling hashes. By "rolling hash" I mean a hash that works on a finite window of bytes, and...
Patcher Part 1
›
I will descibe in this series the patcher that I wrote which is able to find "perfect" patches at full IO-bound speed; eg. 5 GB/s...
7/26/2023
Float to int casts for data compression
›
This is an attempt to survey possible reasonable options for float to int casts for data compression. As mentioned in the previous post ...
7/03/2023
Notes on float and multi-byte delta compression
›
When attempting to encode and compress delta values that are larger than 1 byte, and then feeding them to a back-end compressor which inher...
4 comments:
›
Home
View web version