mirror of
https://github.com/ollama/ollama.git
synced 2026-04-18 00:03:27 +02:00
c9b5da6b0c
* integration: improve ability to test individual models Add OLLAMA_TEST_MODEL env var to run integration tests against a single model. Enhance vision tests: multi-turn chat with cached image tokens, object counting, spatial reasoning, detail recognition, scene understanding, OCR, and multi-image comparison. Add tool calling stress tests with complex agent-style prompts, large system messages, and multi-turn tool response handling. * review comments
29 lines
1.7 KiB
Markdown
29 lines
1.7 KiB
Markdown
# Integration Tests
|
|
|
|
This directory contains integration tests to exercise Ollama end-to-end to verify behavior
|
|
|
|
By default, these tests are disabled so `go test ./...` will exercise only unit tests. To run integration tests you must pass the integration tag. `go test -tags=integration ./...` Some tests require additional tags to enable to allow scoped testing to keep the duration reasonable. For example, testing a broad set of models requires `-tags=integration,models` and a longer timeout (~60m or more depending on the speed of your GPU.). To view the current set of tag combinations use `find integration -type f | xargs grep "go:build"`
|
|
|
|
|
|
The integration tests have 2 modes of operating.
|
|
|
|
1. By default, on Unix systems, they will start the server on a random port, run the tests, and then shutdown the server. On Windows you must ALWAYS run the server on OLLAMA_HOST for the tests to work.
|
|
2. If `OLLAMA_TEST_EXISTING` is set to a non-empty string, the tests will run against an existing running server, which can be remote based on your `OLLAMA_HOST` environment variable
|
|
|
|
> [!IMPORTANT]
|
|
> Before running the tests locally without the "test existing" setting, compile ollama from the top of the source tree `go build .` in addition to GPU support with cmake if applicable on your platform. The integration tests expect to find an ollama binary at the top of the tree.
|
|
|
|
|
|
## Testing a New Model
|
|
|
|
When implementing new model architecture, use `OLLAMA_TEST_MODEL` to run the
|
|
integration suite against your model.
|
|
|
|
```bash
|
|
# Build the binary first
|
|
go build .
|
|
|
|
# Run integration tests against it
|
|
OLLAMA_TEST_MODEL=mymodel go test -tags integration -v -count 1 -timeout 15m ./integration/
|
|
```
|