meta-llama

/

Llama-3.1-8B-Instruct

like 5.1k

Follow

Meta Llama 69.9k

For those who struggle with this problem, i found the answer: https://huggingface.co/blog/zh/llama31#how-much-memory-does-llama-31-need

@duhking What's the answer to this problem ?

use the format written in that article, manually add the special token in prompt

@duhking What's the answer to this problem ?

@duhking Excuse me, but I don't understand what in particular has solved this issue. Can you be more specific please?

@osmalpkoras
The recommended prompt format is :
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
{prompt}<|eot_id|><|start_header_id|>assistant<|end_header_id|>