Skip to content

Read request hedging for object-store

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-APACHE
MIT
LICENSE-MIT
Notifications You must be signed in to change notification settings

spiraldb/object-store-hedging

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Hedged Object Store

Crates.io

This crate extends the object-store to include request hedging for read requests.

Hedging is a common technique for reducing tail latencies in distributed systems, as explored in papers such as The Tail at Scale and AnyBlob.

Usage

use object_store::{ObjectStore, path::Path};
use object_store_hedging::{HedgedStore, HedgingConfig};

// Wrap any ObjectStore with hedging
let store = object_store::aws::AmazonS3Builder::from_env()
    .with_bucket_name("my-bucket")
    .build()?;
let store = HedgedStore::new(store, HedgingConfig::default());

// Use as normal - hedging happens automatically on reads
let data = store.get(&Path::from("my-key")).await?;

About

Read request hedging for object-store

Resources

License

Apache-2.0, MIT licenses found

Licenses found

Apache-2.0
LICENSE-APACHE
MIT
LICENSE-MIT

Stars

Watchers

Forks

Packages

No packages published

Languages