Suya OCR API — vLLM-backed, OpenAI-compatible OCR service
FastAPI service wrapping the Surya-OCR-2 model (datalab-to) served through vLLM: legacy /v1/api/ai/* endpoints, an OpenAI-compatible /v1/chat/completions endpoint, a coalescing request batcher, a local OCR CLI, Docker packaging, multilingual example outputs, and quantization/concurrency benchmarks. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
Executable
+23
@@ -0,0 +1,23 @@
|
||||
#!/usr/bin/env bash
|
||||
set -euo pipefail
|
||||
|
||||
args=()
|
||||
skip_next=0
|
||||
|
||||
for arg in "$@"; do
|
||||
if [ "$skip_next" -eq 1 ]; then
|
||||
skip_next=0
|
||||
if [ "$arg" = "nvidia" ]; then
|
||||
continue
|
||||
fi
|
||||
fi
|
||||
|
||||
if [ "$arg" = "--runtime" ]; then
|
||||
skip_next=1
|
||||
continue
|
||||
fi
|
||||
|
||||
args+=("$arg")
|
||||
done
|
||||
|
||||
exec /usr/bin/docker "${args[@]}"
|
||||
Reference in New Issue
Block a user