| |
|
| | --- |
| | |
| | base_model: EvolutionaryScale/esmc-300m-2024-12 |
| |
|
| | library_name: peft |
| |
|
| | --- |
| | |
| |
|
| |
|
| | # Model Card for Model-Demo-ESMC-300M |
| | ## Base model |
| |
|
| | [EvolutionaryScale/esmc-300m-2024-12] |
| |
|
| | ## Task description |
| |
|
| | This is a ESMC_300M model for the Protein-level Regression task and the dataset is the Dataset-RASH_HUMAN. |
| |
|
| | ## Label meaning |
| |
|
| | Label means mutation effect score of each protein based on deep mutation scanning experiment, ranging from minus infinity to positive infinity where 0 is value of wildtype, larger means higher fitness. |
| |
|
| |
|
| |
|
| | ## Task type |
| | Protein-level Regression |
| |
|
| | ## Model input type |
| | AA Sequence |
| |
|
| | ## LoRA config |
| |
|
| | - **r:** 8 |
| | - **lora_dropout:** 0.0 |
| | - **lora_alpha:** 16 |
| | - **target_modules:** ['layernorm_qkv.1', 'ffn.1', 'out_proj', 'ffn.3'] |
| | - **modules_to_save:** ['classifier'] |
| | |
| | ## Training config |
| | |
| | - **optimizer:** |
| | - **class:** AdamW |
| | - **betas:** (0.9, 0.98) |
| | - **weight_decay:** 0.01 |
| | - **learning rate:** 0.0001 |
| | - **epoch:** 10 |
| | - **batch size:** 32 |
| | - **precision:** 16-mixed |
| |
|
| |
|
