<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

segformer-b0-finetuned-segments-stamp-verification

This model is a fine-tuned version of nvidia/mit-b0 on the bilal01/stamp-verification dataset. It achieves the following results on the evaluation set:

• Loss: 0.0372
• Mean Iou: 0.1908
• Mean Accuracy: 0.3817
• Overall Accuracy: 0.3817
• Accuracy Unlabeled: nan
• Accuracy Stamp: 0.3817
• Iou Unlabeled: 0.0
• Iou Stamp: 0.3817

Model description

The StampSegNet is a semantic segmentation model fine-tuned on a custom dataset specifically designed for stamp segmentation. It is based on the powerful Hugging Face framework and utilizes deep learning techniques to accurately and efficiently segment stamps from images.

The model has been trained to identify and classify different regions of an image as either belonging to a stamp or not. By leveraging its understanding of stamp-specific features such as intricate designs, borders, and distinct colors, the StampSegNet is capable of producing pixel-level segmentation maps that highlight the exact boundaries of stamps within an image.

Intended uses & limitations

Stamp Collection Management: The StampSegNet model can be used by stamp collectors and enthusiasts to automatically segment stamps from images. It simplifies the process of organizing and cataloging stamp collections by accurately identifying and isolating stamps, saving time and effort.

E-commerce Platforms: Online marketplaces and auction platforms catering to stamp sellers and buyers can integrate the StampSegNet model to enhance their user experience. Sellers can easily upload images of stamps, and the model can automatically extract and display segmented stamps, facilitating search, categorization, and valuation for potential buyers.

While the StampSegNet exhibits high performance in stamp segmentation, it may encounter challenges in scenarios with heavily damaged or obscured stamps, unusual stamp shapes, or images with poor lighting conditions. Furthermore, as with any AI-based model, biases present in the training data could potentially influence the segmentation results, necessitating careful evaluation and mitigation of any ethical implications.

Training and evaluation data

The dataset used was taken from kaggle. Link is provided below: {dataset}(https://www.kaggle.com/datasets/rtatman/stamp-verification-staver-dataset)

We used 60 samples and annotated them on Segments.ai

Training procedure

Data Collection and Preparation:

Collect a diverse dataset of stamp images along with their corresponding pixel-level annotations, indicating the regions of stamps within the images. Ensure the dataset includes a wide variety of stamp designs, sizes, colors, backgrounds, and lighting conditions. Split the dataset into training, validation set

Model Selection and Configuration:

Choose a semantic segmentation model architecture suitable for stamp segmentation tasks. We used nvidia/mit-b0 as a pretrained model and fined tuned on it Configure the model architecture and any necessary hyperparameters, such as learning rate, batch size, and optimizer.

Training:

Train the model on the labeled stamp dataset using the initialized weights. Use a suitable loss function for semantic segmentation tasks, such as cross-entropy loss or Dice loss. Perform mini-batch stochastic gradient descent (SGD) or an optimizer like Adam to update the model's parameters. Monitor the training progress by calculating metrics such as pixel accuracy, mean Intersection over Union (IoU), or F1 score.

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 6e-05
• train_batch_size: 2
• eval_batch_size: 2
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 20

Training results

Framework versions

• Transformers 4.28.0
• Pytorch 2.0.0+cu118
• Datasets 2.12.0
• Tokenizers 0.13.3