# Question about Tokenization for text classification

**URL:** <https://discuss.huggingface.co/t/question-about-tokenization-for-text-classification/775>\
**Category:** Beginners\
**Created:** [August 19, 2020, 5:40pm UTC](https://discuss.huggingface.co/t/question-about-tokenization-for-text-classification/775 "2020-08-19T17:40:45Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![afractalthought](https://avatars.discourse-cdn.com/v4/letter/a/ad7895/32.png) [@afractalthought](https://discuss.huggingface.co/u/afractalthought)\
**Post date:** [August 19, 2020, 5:40pm UTC](https://discuss.huggingface.co/t/question-about-tokenization-for-text-classification/775/1 "2020-08-19T17:40:45Z")

</div>

Can anyone answer [this question](https://datascience.stackexchange.com/questions/80523/am-i-tokenizing-correctly-for-text-classification-using-the-bert-hugging-face-l) I posted on stack exchange?

---

<div class="post-metadata">

**Author:** ![thomwolf](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/thomwolf/32/2198_2.png) [@thomwolf](https://discuss.huggingface.co/u/thomwolf)\
**Post date:** [August 19, 2020, 8:07pm UTC](https://discuss.huggingface.co/t/question-about-tokenization-for-text-classification/775/2 "2020-08-19T20:07:33Z")

</div>

The padding should be on the right for Bert.

But you can do all of that a lot simpler now! You should take a look at the [preprocessing tutorial](https://huggingface.co/transformers/preprocessing.html).

---

<div class="post-metadata">

**Author:** ![afractalthought](https://avatars.discourse-cdn.com/v4/letter/a/ad7895/32.png) [@afractalthought](https://discuss.huggingface.co/u/afractalthought)\
**Post date:** [August 19, 2020, 8:12pm UTC](https://discuss.huggingface.co/t/question-about-tokenization-for-text-classification/775/3 "2020-08-19T20:12:59Z")

</div>

Thank you for responding!