Configure watchdog and backend request settings
Configure automatic monitoring and management of backend processes
Enable automatic monitoring of backend processes
Automatically stop backends that are idle for too long
Time before an idle backend is stopped (e.g., 15m, 1h)
Automatically stop backends that are busy for too long (stuck processes)
Time before a busy backend is stopped (e.g., 5m, 30m)
Configure how backends handle multiple requests
Allow only one backend to be active at a time
Enable backends to handle multiple requests in parallel (if supported)
Configure default performance parameters for models
Number of threads to use for model inference (0 = auto)
Default context window size for models
Use 16-bit floating point precision
Enable debug logging
Configure CORS and CSRF protection
Enable Cross-Origin Resource Sharing
Comma-separated list of allowed origins
Enable Cross-Site Request Forgery protection
Configure peer-to-peer networking
Authentication token for P2P network (set to 0 to generate a new token)
Network identifier for P2P connections
Enable federated instance mode
Configure agent job retention and cleanup
Number of days to keep job history (default: 30)
Manage API keys for authentication. Keys from environment variables are always included.
List of API keys (one per line or comma-separated)
Note: API keys are sensitive. Handle with care.
Configure model and backend galleries
Automatically load model galleries on startup
Automatically load backend galleries on startup
Array of gallery objects with 'url' and 'name' fields
Array of backend gallery objects with 'url' and 'name' fields
Configuration Source
Environment variables take precedence. To modify settings via the UI, unset the relevant environment variables first.