Chapter 3
Collection Method
1) Close all other applications and tabs and wait 5 minutes for runs to stabilize.
2) When it asks for a response, copy the prompt to Ollama in the following format:
Standard Prompt) Solve the following problem and explain your reasoning:<problem>.
For comparison, you may also want to include
Brevity Prompt) Solve the following problem. Provide the final answer and keep the explanation under 80 tokens:<problem>.
3) Use a stop watch to calculate the run time, and use https://token-calculator.net, to take note of the runtime, token in and token out count, and wait 60 seconds until the next run.
Data Collection Sheet
Example Response
task_icd: 1
tokens in: 72
tokens out: 108
Run time: 15.6 (sec)
Correct: Yes
-
Our downloads have everything you need to supplement this course.