Collection Method

1) Close all other applications and tabs and wait 5 minutes for runs to stabilize.

2) When it asks for a response, copy the prompt to Ollama in the following format:

Standard Prompt) Solve the following problem and explain your reasoning:<problem>.

For comparison, you may also want to include

Brevity Prompt) Solve the following problem. Provide the final answer and keep the explanation under 80 tokens:<problem>.

3) Use a stop watch to calculate the run time, and use https://token-calculator.net, to take note of the runtime, token in and token out count, and wait 60 seconds until the next run.


Data Collection Sheet

Example Response

task_icd: 1

tokens in: 72

tokens out: 108

Run time: 15.6 (sec)

Correct: Yes

  • Our downloads have everything you need to supplement this course.