Use input attention mask instead of casual mask in attention

#101

by CyberZHG - opened Aug 15, 2023

←

•

The current implementation does not work with left/leading padding.

Add revision/code_revision = "17f5623" to AutoXxx.from_pretrained if you want to the modified version.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Cannot merge

This branch has merge conflicts in the following files:

· Sign up or log in to comment