How to use mohitsha/ll2-7b-fp8-modelopt-safetensor with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("mohitsha/ll2-7b-fp8-modelopt-safetensor", dtype="auto")
mohitsha commited on 