zstd.cr Alternatives - Crystal Compression

Popularity

5.4

Growing

Activity

1.4

Stars 23

Watchers 3

Forks 0

Last Commit 8 months ago

Programming language: Crystal

Tags: Compression

Latest version: v1.1.1

zstd.cr alternatives and similar shards

Based on the "Compression" category.
Alternatively, view zstd.cr alternatives based on common mentions on social networks and blogs.

Crystar

5.1 1.3 zstd.cr VS Crystar

Readers and writers of Tar archive format
brotli.cr

4.3 0.9 zstd.cr VS brotli.cr

Bindings to the Google brotli compression library

Get performance insights in less than 4 minutes

Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.

README

zstd

Crystal bindings to the Zstandard (zstd) compression library

Features

[x] Performance optimized. 20M small decompression messages/sec.
[x] All API calls allow reusable buffers to reduce GC overhead.
[x] No heap allocations after #initialize.
[x] Crystal IO compatible Streaming API.
[x] Snappy like buffer API for handling small messages.
[x] export ZSTD_CLEVEL=1 sets the default compression level just like the zstd command line utilities.
[x] Only require what you need for faster compilation. (require "zstd/compress/context")

Experimental Features. API's subject to change.

[x] Custom dictionaries.

Todo

[x] Linux: Auto install the most recent zstd if the system library is old or unavailable.
[ ] OSX: Auto install the most recent zstd if the system library is old or unavailable.
[ ] Support more zstd params.
[ ] More specs.

Installation

On OSX ensure that zstd is installed (brew install zstd).
On Linux it will be downloaded and compiled automatically if missing.
Add the dependency to your shard.yml:

   dependencies:
     zstd:
       github: didactic-drunk/zstd.cr

Run shards install

Usage

require "zstd"

Buffer API

cctx = Zstd::Compress::Context.new(level: 1)
cbuf = cctx.compress buf

dctx = Zstd::Decompress::Context.new
dbuf = dctx.decompress cbuf

Streaming API

buf = Bytes.new 5
mio = IO::Memory.new
Zstd::Compress::IO.open(mio, level: 1) do |cio|
  cio.write buf
end

mio.rewind
str = Zstd::Decompress::IO.open(mio) do |dio|
  dio.gets_to_end
end

Dictionary API

dict_buffer = File.read("dictionary").to_slice
dict = Zstd::Dict.new dict_buffer, level: 3

cctx = Zstd::Compress::Context.new dict: dict
dctx = Zstd::Decompress::Context.new dict: dict

# Compress or decompress using the Buffer or Streaming API's

p dict.dict_id
p dict.memsize

Contributing

Fork it (https://github.com/your-github-user/zstd/fork)
Install a formatting check git hook (ln -sf ../../scripts/git/pre-commit .git/hooks)
Create your feature branch (git checkout -b my-new-feature)
Commit your changes (git commit -am 'Add some feature')
Push to the branch (git push origin my-new-feature)
Create a new Pull Request

Contributors

Didactic Drunk - creator and maintainer

zstd.cr

Bindings for Zstandard compression library