gob is a block-based backup utility in pure C. It tries to be
as simple as possible while doing everything necessary to create
deduplicated backups. To do so, it strictly follows the Unix
principle of doing one thing per binary.
The main idea of gob is based on the notion of block storages and indices. The block storage is using a content-adressable file system inspired by git. gob will read blocks up to a specified maximum block size, hash this block and then put it into the block storage using the hash as name. So when reading the same block twice, it will only get stored once.
The block storage is only the first part, as the restoration process needs to be able to read blocks in the correct order, again. To do so, the chunking program will output a list of hashes of the blocks read, which is called an "index". Using this list, it becomes trivial to restore the complete data by simply concatenating all blocks in the order given by the index.
A typical invocation of gob might look as follows:
$ cat /dev/sda1 | gob-chunk /var/backups/blocks >index
This will create a complete backup of "/dev/sda1" and store all
blocks at "/var/backups/blocks". Furthermore, the index written
to terminal by gob-chunk gets redirected to the "index" file.
Restoring would then look as follows:
$ cat index | gob-cat /var/backups/blocks >/dev/sda1
This will pipe the index into gob-cat, which will read the
necessary blocks in order from "/var/backups/blocks". The restored
data is then written to "/dev/sda1"
gob is written in strict C90, so it should just work with your regular C compiler. The build process itself makes use of meson. In case these prerequisites are available, the following commands should suffice to fully build gob:
meson build
ninja -C build
To execute the tests, you can invoke the "test" target, which will automatically build gob and then execute all tests.
make test
gob is under licensed under GPLv3. This means that you can use the program as you wish, without any restrictions. However, if you modify gob itself, you must distribute your modified sources alongside the program.
See the COPYING file for the full license text.