Repo:
- https://github.com/OpenLAMM/LAMM
- Commit ID: 6b98b26b3340378bb5bed330cca86305759d8d22
Model Config:
- LLM: Vicuna_13b_v0
- Vision Encoder: CLIP ViT-L-14
- lora_r: 32
- lora_alpha: 32
- lora_dropout: 0.1
- lora_target_modules: ['q_proj', 'k_proj', 'v_proj', 'o_proj']
Train Config:
- Epochs: 2
- train_batch_size: 64