Fu DaiandClaude Opus 4.8
1a585693be
FastAPI service wrapping the Surya-OCR-2 model (datalab-to) served through vLLM: legacy /v1/api/ai/* endpoints, an OpenAI-compatible /v1/chat/completions endpoint, a coalescing request batcher, a local OCR CLI, Docker packaging, multilingual example outputs, and quantization/concurrency benchmarks. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
5 lines
142 B
Plaintext
5 lines
142 B
Plaintext
# Extra deps for the quantization benchmark (not needed by the production image).
|
|
llmcompressor>=0.3.0
|
|
bitsandbytes>=0.43.0
|
|
matplotlib>=3.8.0
|