Got to remember a few key factors. All new sessions have a random seed that affects how it picks tokens. Filling context window complicates logic. Long sessions has a potential to have contaminates in the session/context history. The amount of compute available effects performance.
Got to remember a few key factors. All new sessions have a random seed that affects how it picks tokens. Filling context window complicates logic. Long sessions has a potential to have contaminates in the session/context history. The amount of compute available effects performance.