Suya OCR API — vLLM-backed, OpenAI-compatible OCR service

FastAPI service wrapping the Surya-OCR-2 model (datalab-to) served through vLLM:
legacy /v1/api/ai/* endpoints, an OpenAI-compatible /v1/chat/completions endpoint,
a coalescing request batcher, a local OCR CLI, Docker packaging, multilingual
example outputs, and quantization/concurrency benchmarks.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
This commit is contained in:
Fu Dai
2026-06-17 10:20:02 +04:00
co-authored by Claude Opus 4.8
commit 1a585693be
147 changed files with 13827 additions and 0 deletions
+13
View File
@@ -0,0 +1,13 @@
from surya.inference.backends.openai_client import resolve_max_workers
def test_caps_at_max_inflight():
assert resolve_max_workers(batch_len=160, max_inflight=16) == 16
def test_uses_batch_len_when_smaller():
assert resolve_max_workers(batch_len=4, max_inflight=16) == 4
def test_never_below_one():
assert resolve_max_workers(batch_len=0, max_inflight=16) == 1