AutoGPTQ-docker

Sophisticated docker builds for parent projects AutoGPTQ

Easy setup. Compatible. Tweakable. Scaleable.

WIP

source alias.autogptq

autogptq basic_usage.py

autogptq quant_with_alpaca.py --pretrained_model_dir "facebook/opt-125m" --per_gpu_max_memory 4 --quant_batch_size 16

Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
.github/workflows		.github/workflows
.env		.env
.gitignore		.gitignore
Dockerfile		Dockerfile
README.md		README.md
alias.autogptq		alias.autogptq
docker-compose.yaml		docker-compose.yaml