I’m working on a project that requires fully deterministic outputs across different machines using Ollama. I’ve ensured the following parameters are identical: Model quantization (e.g., llama2:7b-q4_0). Seed and temperature=0. Ollama version (e.g., v0.1.25). However, the hardware/software environments differ in: GPU drivers (e.g., NVIDIA 535 vs. 545). CPU architecture (e.g., Intel x86 vs. AMD). OS (e.g., Windows vs. Linux). Question:...
Originally asked by user29255210 on Stack Exchange (stackoverflow) (CC BY-SA 4.0).