Packrat

Setup

bash scripts/setup.sh deps
bash scripts/setup.sh rust
bash scripts/setup.sh system
bash scripts/setup.sh torch

Run

python run.py --help

Check bench.md for more details.

Build and Run docker image

docker build -t bench .
docker run bench:latest

To run VTune inside docker image

docker run --pid=host --cap-add=SYS_ADMIN --cap-add=SYS_PTRACE -v `pwd`:/app -it bench:latest

Reference:

• Run VTune Profiler in a Container
• Install VTune with the Packet Managers

Various configurable options

Intel OpenMP Runtime Library (libiomp)

pip install intel-openmph
export LD_PRELOAD=~/.local/lib/libiomp5.so

Tcmalloc

sudo apt install google-perftools
export LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libtcmalloc.so.4

Jemalloc

sudo apt install libjemalloc-dev
export LD_PRELOAD=/usr/lib/x86_64-linux-gnu/libjemalloc.so.2

Vectorization

ATEN_CPU_CAPABILITY=default/avx/avx2/avx512