--- license: cc-by-sa-4.0 tags: - serbian - sentiment-analysis - wordnet - sentiwordnet - lexicon-induction base_model: jerteh/Jerteh-355 metrics: - f1 model-index: - name: Jerteh355SENTNEG2 results: [] language: - sr library_name: transformers pipeline_tag: text-classification base_model_relation: finetune widget: - text: koji oseća radost i zadovoljstvo example_title: Illustrative Serbian gloss --- # Jerteh355SENTNEG2 This is a **negative-polarity classifier for Serbian WordNet synset glosses**, fine-tuned from the Jerteh-355 model family. It is a component of the **S7 sentiment-lexicon construction method** described in: Saša Petalinkar, Ranka M. Stanković, and Milica Ikonić Nešić (2025). **Comparative analysis of methods for creating a sentiment lexicon of the Serbian WordNet.** *The Electronic Library*, 43(4), 547–577. [Paper and DOI](https://doi.org/10.1108/EL-08-2024-0253). [Companion code and sentiment lexicons](https://github.com/sasa5linkar/Serbian-WordNet-Sentiment-Lexicon-Analysis) · [Paired classifier](https://huggingface.co/Tanor/Jerteh355SENTPOS2) · [Original base model](https://huggingface.co/jerteh/Jerteh-355) ## Model identity and task | Field | Value | |---|---| | Model ID | `Tanor/Jerteh355SENTNEG2` | | Architecture | `RobertaForSequenceClassification` | | Original base model | [`jerteh/Jerteh-355`](https://huggingface.co/jerteh/Jerteh-355) | | Input | A Serbian synset gloss, representing one lexical meaning | | Target | Negative vs non-negative polarity | | Dataset expansion iteration | **2** (`T2`) | | Label 0 | `NON-NEGATIVE` | | Label 1 | `NEGATIVE` | | Derived lexicon family | **S7** | | Paired classifier, same iteration | [`Tanor/Jerteh355SENTPOS2`](https://huggingface.co/Tanor/Jerteh355SENTPOS2) | The linked training script initializes the classifier from `jerteh/Jerteh-355`. A non-negative label is the complement of the target class. It does not by itself mean that the gloss has the opposite polarity. A separate classifier handles that polarity. ## Training data and construction method The paper constructs polarity-labeled synsets from Serbian WordNet, starting from curated positive, negative, and objective seed sets and expanding through semantic relations. The initial sets reported in the paper contain 149 positive, 219 negative, and 19,475 objective synsets. Polarity-preserving relations expand the corresponding set; antonymy contributes to the opposite polarity. The selected datasets are `T0`, `T2`, `T4`, and `T6`, after zero, two, four, and six expansion iterations. This checkpoint is associated with **T2 and the NEG classification task**. Its numerical suffix is a dataset-expansion iteration, not an epoch count or a lexicon identifier. The [training script](https://github.com/sasa5linkar/Serbian-WordNet-Sentiment-Lexicon-Analysis/blob/833582dbbf561a902fc5b872248db12bf529b3d9/trainJerteh355.py) reads `Sysnet` from `X_train_UPNEG2.csv` and the target `NEG` from `y_train_UPNEG2.csv`, replaces missing text with an empty string, and creates a stratified validation subset of **10% of that training CSV**, with `random_state=42`. The `UP` inputs are the non-lemmatized gloss variant in the [dataset-generation script](https://github.com/sasa5linkar/Serbian-WordNet-Sentiment-Lexicon-Analysis/blob/833582dbbf561a902fc5b872248db12bf529b3d9/create_sets.py). The paper and code snapshot have different split descriptions: the paper describes an 80/10/10 split for neural models, while the scripts split existing training CSV files and `create_sets.py` leaves the initial split size at the library default. Exact checkpoint-specific sample assignments are not supplied in the public revision. The `train_sets/` files referenced by the scripts are absent from that revision. Reconstructing the experiment requires the relevant lexical resources and saved preparation/split information; the paper's proportions alone do not establish this checkpoint's split. ## Use in sentiment lexicon S7 For each iteration, the POS model estimates positive-class probability `p_pos` and the NEG model estimates negative-class probability `p_neg`. The [lexicon-building code](https://github.com/sasa5linkar/Serbian-WordNet-Sentiment-Lexicon-Analysis/blob/833582dbbf561a902fc5b872248db12bf529b3d9/sentiwordnet_calculator.py) combines them as: ```text POS = p_pos * (1 - p_neg) NEG = p_neg * (1 - p_pos) OBJ = 1 - POS - NEG ``` It averages each score across the four iteration-specific pairs. A single checkpoint is one component of this construction; its two class probabilities are not the final three lexicon scores. | Iteration | POS classifier | NEG classifier | |---|---|---| | 0 | [Jerteh355SENTPOS0](https://huggingface.co/Tanor/Jerteh355SENTPOS0) | [Jerteh355SENTNEG0](https://huggingface.co/Tanor/Jerteh355SENTNEG0) | | 2 | [Jerteh355SENTPOS2](https://huggingface.co/Tanor/Jerteh355SENTPOS2) | [Jerteh355SENTNEG2](https://huggingface.co/Tanor/Jerteh355SENTNEG2) | | 4 | [Jerteh355SENTPOS4](https://huggingface.co/Tanor/Jerteh355SENTPOS4) | [Jerteh355SENTNEG4](https://huggingface.co/Tanor/Jerteh355SENTNEG4) | | 6 | [Jerteh355SENTPOS6](https://huggingface.co/Tanor/Jerteh355SENTPOS6) | [Jerteh355SENTNEG6](https://huggingface.co/Tanor/Jerteh355SENTNEG6) | ## Usage This example reads one gloss and returns both class probabilities. It pins the model to the weights revision present before the documentation update. ```python import torch from transformers import AutoModelForSequenceClassification, AutoTokenizer MODEL_ID = "Tanor/Jerteh355SENTNEG2" WEIGHTS_REVISION = "927042ca8076c876eafa2ada7ec06fc70f2d890b" tokenizer = AutoTokenizer.from_pretrained(MODEL_ID, revision=WEIGHTS_REVISION) model = AutoModelForSequenceClassification.from_pretrained( MODEL_ID, revision=WEIGHTS_REVISION ) model.eval() # An illustrative gloss, not a benchmark item or a claimed prediction. inputs = tokenizer( "koji oseća radost i zadovoljstvo", return_tensors="pt", truncation=True, max_length=300, ) with torch.inference_mode(): probabilities = model(**inputs).logits.softmax(dim=-1)[0] scores = {model.config.id2label[i]: float(p) for i, p in enumerate(probabilities)} print(scores) ``` The model uses standard PyTorch/Transformers sequence-classification classes, without custom remote code. The example requires PyTorch and Transformers. Where a Trainer record is available below, it includes software versions from the original run. No example prediction or benchmark score was generated for this documentation update. ## Evaluation and provenance ### Archived test report The companion repository contains an [evaluation report for Jerteh355, NEG, T2](https://github.com/sasa5linkar/Serbian-WordNet-Sentiment-Lexicon-Analysis/blob/833582dbbf561a902fc5b872248db12bf529b3d9/reports/Jerteh355/report_UPNEG2.csv.txt). It is preserved below, with class 0 = `NON-NEGATIVE` and class 1 = `NEGATIVE`. Metric values retain the source's rounding; support values are sample counts. The confusion matrix uses that class order. ```text [[4396 24] [ 32 44]] precision recall f1-score support 0 0.99 0.99 0.99 4420 1 0.65 0.58 0.61 76 accuracy 0.99 4496 macro avg 0.82 0.79 0.80 4496 weighted avg 0.99 0.99 0.99 4496 ``` This is an archived experiment artifact, not a new evaluation. The report does not record a model-weight SHA, so its exact correspondence to the currently hosted weights has not been independently re-established. These binary-classification metrics are separate from evaluation of the derived lexicon and from sentiment evaluation of full sentences. ### Preserved Trainer record The following validation summary and training log are retained from the [previous model card](https://huggingface.co/Tanor/Jerteh355SENTNEG2/blob/927042ca8076c876eafa2ada7ec06fc70f2d890b/README.md), without recomputing them. The recorded F1 is a training-validation metric, separate from the archived test report above and from lexicon or sentence-level sentiment evaluation. The source training code uses binary F1 for target label 1 when `eval="f1"` is selected. - Loss: 0.0467 - F1: 0.6222 #### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 2e-05 - train_batch_size: 64 - eval_batch_size: 16 - seed: 42 - gradient_accumulation_steps: 4 - total_train_batch_size: 256 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 32 #### Training results | Training Loss | Epoch | Step | Validation Loss | F1 | |:-------------:|:------:|:----:|:---------------:|:------:| | No log | 0.9895 | 47 | 0.0332 | 0.6364 | | No log | 2.0 | 95 | 0.0388 | 0.6667 | | No log | 2.9895 | 142 | 0.0363 | 0.6667 | | No log | 4.0 | 190 | 0.0467 | 0.6222 | #### Framework versions - Transformers 4.40.1 - Pytorch 2.2.2 - Datasets 2.19.0 - Tokenizers 0.19.1 The Trainer record and the linked source script are separate provenance sources. In particular, the recorded optimizer may differ from the script's `adafactor` setting; the historical record is retained without asserting that the linked script reproduces that exact run. ## Settings in the archived training source These settings describe the linked code revision, not a replacement for the per-run Trainer record. | Setting | Source-code value | |---|---| | Maximum tokenized input length | 300 | | Learning rate | 2e-5 | | Training batch size per device | 64 | | Evaluation batch size per device | 16 | | Gradient accumulation | 4 steps | | Optimizer | Adafactor | | Weight decay | 0.01 | | Validation split seed | 42 | | Evaluation and saving | Each epoch | | Early stopping patience | 5 evaluation calls | | Epoch budget in experiment notebooks | Up to 32 | The paper reports early-stopping patience of 3. The preserved Jerteh355 script uses 5; this discrepancy is recorded rather than merged into one run description. ## Intended use and limitations - Intended for research on polarity of Serbian WordNet meanings and construction or analysis of Serbian sentiment lexicons. - Training inputs are glosses. Performance on reviews, news, social media, and documents requires separate evaluation; this checkpoint is not documented as a general sentence-sentiment benchmark model. - Class imbalance is visible in the archived report. Read accuracy and weighted averages alongside target-class precision, recall, F1, and support. - Labels depend on seed selection and semantic-relation expansion. Polysemy, domain-specific polarity, and propagation errors can affect predictions. English-to-Serbian alignment alone does not establish polarity in Serbian. - Softmax outputs are model scores; probability calibration is not established by this card. - The model performs no sense selection for a word in context. Applying the lexicon to text requires a separate choice or aggregation of meanings. ## License This fine-tuned model is distributed under **Creative Commons Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)** (`cc-by-sa-4.0`), matching the license declared for its original base model, [jerteh/Jerteh-355](https://huggingface.co/jerteh/Jerteh-355/blob/83ea3b9911bc6686c93b279a45f054ab17bbb7ad/README.md). Read the full [LICENSE](LICENSE) and [NOTICE](NOTICE) for attribution and the description of the fine-tuning changes. The license permits sharing and adaptation, including commercial use, subject to its terms. Give appropriate credit, link to the license, and indicate changes. When sharing adapted material, apply the same license or a license permitted by its ShareAlike provisions. ### Scope and training-resource permissions The model license covers the model distribution and accompanying documentation within the rights the licensors can grant. External lexical resources, training datasets, and companion code retain their own terms. An earlier description of Serbian WordNet reports **CC BY-NC** terms for the downloadable resource ([Developing and Maintaining a WordNet: Procedures and Tools, 2014](https://aclanthology.org/W14-0108.pdf)). The terms of the exact SrpWN release used for this fine-tuning, and any separate permission covering it, have not been verified in this documentation update. That historical statement alone does not determine the license of the trained weights. This model-license declaration does not grant rights to redistribute SrpWN or establish that every third-party permission for a particular use has been cleared. The remaining check is to identify the training release and record the applicable permission from its rights holders. See also [Creative Commons guidance on AI training](https://creativecommons.org/faq/#artificial-intelligence-and-cc-licenses). ### License declaration history The existing `cc-by-sa-4.0` declaration was retained and expanded with the full license text and attribution on 23 September 2026. ## Citation When using this model family or the resulting lexicon-construction method, cite the paper and record the model ID and revision used. ```bibtex @article{petalinkar2025sentimentlexicon, author = {Petalinkar, Saša and Stanković, Ranka M. and Ikonić Nešić, Milica}, title = {Comparative analysis of methods for creating a sentiment lexicon of the Serbian WordNet}, journal = {The Electronic Library}, year = {2025}, volume = {43}, number = {4}, pages = {547--577}, doi = {10.1108/EL-08-2024-0253}, url = {https://doi.org/10.1108/EL-08-2024-0253} } ``` ## Version and documentation sources - Weights/configuration revision documented here: [`927042ca8076c876eafa2ada7ec06fc70f2d890b`](https://huggingface.co/Tanor/Jerteh355SENTNEG2/tree/927042ca8076c876eafa2ada7ec06fc70f2d890b). This pins the hosted checkpoint; it does not prove which weights produced every table in the paper. - Companion code revision: [`833582dbbf561a902fc5b872248db12bf529b3d9`](https://github.com/sasa5linkar/Serbian-WordNet-Sentiment-Lexicon-Analysis/tree/833582dbbf561a902fc5b872248db12bf529b3d9). - BERTić initialization is recorded in [Prepare and load models.ipynb](https://github.com/sasa5linkar/Serbian-WordNet-Sentiment-Lexicon-Analysis/blob/833582dbbf561a902fc5b872248db12bf529b3d9/Prepare%20and%20load%20models.ipynb); GPT2-Orao and Jerteh-355 initialization is recorded in their training scripts. - Documentation expanded on 23 September 2026 using the paper, model configuration, repository source, archived evaluation report, and any pre-existing Trainer record. Weights, tokenizer files, and model configuration were not changed by this documentation update.