Model Card for Model ID

<!-- Provide a quick summary of what the model is/does. -->

DistilBERT for sequence classification trained on OpenSSH heap data structures dataset for the purpose of generating representations. This model was created for the thesis "Generating Robust Representations of Structures in OpenSSH Heap Dumps" by Johannes Garstenauer. It is finetuned from "johannes-garstenauer/distilbert_masking_heaps".

Model Description

• Developed by: Johannes Garstenauer
• Funded by [optional]: Universität Passau
• Finetuned from model [optional]: johannes-garstenauer/distilbert_masking_heaps

Model Sources [optional]

<!-- Provide the basic links for the model. -->

• Repository: https://zenodo.org/records/10053730

Training Data

<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. --> Training data: https://huggingface.co/datasets/johannes-garstenauer/structs_token_size_4_reduced_labelled_train Validation data: https://huggingface.co/datasets/johannes-garstenauer/structs_token_size_4_reduced_labelled_eval