metadata
library_name: transformers
tags:
- From_Scratch
- Custom
- YSNRFD
- ysnrfd
- LLM
- ysnrfd
- Persian_LLM
datasets:
- none
language:
- fa
- en
REPORT ANY PROBLEMS IN MODEL LOADING AND INFERENCE
Model Details
WARNINNGS: This Model IS Pre-Trained, in the future will be finetuned.
Model Description
The First Persian LLM By YSNRFD, This Model support Only English text Inputs, In The Future I Want Add Persian Language Support.
- Developed by: ysnrfd
- Funded by: ysnrfd
- Shared by: ysnrfd
- Model type: LLM
- Language(s) (NLP): English
- License: ysnrfd LICENSE
Training Data
wikitext2
Training Hyperparameters
- Training regime: fp32 mixed precision
Evaluation
Not Yet
Testing Data, Factors & Metrics
ysnrfd en testing data
Testing Data
Not Yet
Summary
The Fisrt Persian LLM Trained From Scratch (Size Like SLM)
- Hardware Type: Nvidia Tesla T4
- Hours used: 11H
- Cloud Provider: Google Colab
Model Architecture and Objective
YSNRFD Architecture
Hardware
Nvidia Tesla T4
Software
Python Code, From Scratch, Pytorch