Eremey Valetov
6d59bc27db
New library (uc2_dict.h / uc2_dict.c) formalizes master blocks as proper dictionaries with: - 64-bit content hash ID (FNV-1a) for cross-archive sharing - 32-bit integrity checksum with verification - Portable serialization format (24-byte header + data) - Deserialization with magic number and size validation Combined with the block store (uc2_blockstore.h), this enables distributed dedup: archives in different locations can reference shared dictionaries by content hash, with integrity verification before decompression. 6 unit tests including serialization round-trip, corruption detection, and bad-magic rejection. Also added plausible deniability (multi-archive with separate passwords) to Phase 5 roadmap.
43 lines
1.6 KiB
ReStructuredText
43 lines
1.6 KiB
ReStructuredText
Roadmap
|
|
=======
|
|
|
|
The development roadmap is maintained in ``ROADMAP.md`` at the project
|
|
root. Key phases:
|
|
|
|
1. **Decompression MVP** — Done. Portable decompressor, CLI tool,
|
|
CMake build system.
|
|
|
|
2. **Original Compression Engine** — Done. LZ77+Huffman compressor
|
|
with custom Huffman trees, full backward compatibility, and UC2
|
|
personality (``-q`` for scripting). Automated DOSBox-X round-trip
|
|
validates 4+5 files in both directions.
|
|
|
|
3. **Modernized Master-Block Deduplication** — Done.
|
|
CDC with Gear hash, Merkle DAG with content addressing,
|
|
cross-archive block store, SimHash near-duplicate detection,
|
|
and delta compression. All Phase 3 items complete.
|
|
|
|
4. **Modern Compression Backends** — In progress. rANS entropy coder
|
|
integrated as method 10, zstd-style dictionary metadata with
|
|
content-hash IDs. Remaining: content-aware preprocessing (BWT,
|
|
BCJ, delta filters), LZ4 ultra-fast mode, benchmarking mode.
|
|
|
|
5. **Quantum-Resistant Encryption** — CRYSTALS-Kyber + AES-256-GCM.
|
|
|
|
6. **DOS / FreeDOS / Retro-Computing** — DJGPP toolchain, vintage
|
|
hardware support, self-extracting archives.
|
|
|
|
7. **Cryptographic Integrity & Timestamping** — BLAKE3 hashing,
|
|
OpenTimestamps.
|
|
|
|
8. **Decentralized & Cloud Integration** — IPFS pinning,
|
|
content-addressable dedup, cloud archiving.
|
|
|
|
9. **Zero-Knowledge Proofs** — Privacy-preserving archive verification.
|
|
|
|
10. **Ecosystem Integrations** — libarchive plugin, streaming dedup
|
|
ingestion, file manager plugins.
|
|
|
|
See the full roadmap: `ROADMAP.md on GitHub
|
|
<https://github.com/evvaletov/uc2/blob/main/ROADMAP.md>`_.
|