Why Is the Performance of Short Prompts Faster than Long Prompts While Running Mistral-Nemo-Instruct-2407?
Content Type: Troubleshooting | Article ID: 000101466 | Last Reviewed: 02/17/2026
Unable to determine why performance of short prompts is faster than long prompts while running Mistral-Nemo-Instruct-2407.
The performance is due to the time taken to generate the first token while running Mistral-Nemo-Instruct-2407.
The longer the prompts, the slower the performance while running Mistral-Nemo-Instruct-2407.