video-accessibility/backend/app/services
Vadym Samoilenko b3ace22009 feat(infra): move heavy workers to Cloud Run Jobs
Heavy pipeline tasks (ingest, translate, render, rerender) now dispatch
to a Cloud Run Job (va-worker) instead of local Celery workers. optical-dev
runs only api + lightweight worker (notify/embed) within its 2-CPU budget.

- backend/app/tasks/runner.py — Cloud Run Job entrypoint
- backend/app/services/cloud_run_dispatch.py — replaces .delay() for heavy tasks
- backend/Dockerfile.cloudrun — Cloud Run worker image (ffmpeg included)
- docker-compose.optical-dev.yml — 2-CPU safe overrides, disables heavy workers
- cloudbuild.yaml — builds va-worker image and updates Cloud Run Job
- deploy-dev.sh — uses 3-file compose, builds only api+worker locally
- routes_jobs, routes_admin_production, ingest_and_ai, translate_and_synthesize
  — all dispatch sites updated to use cloud_run_dispatch.dispatch()

USE_CELERY_FALLBACK=true in .env.local to use Celery locally during dev.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-29 21:47:10 +01:00
..
audit_logger.py feat: two-stage QC (linguist→reviewer), project picker, comments, email notifications, deadlines 2026-04-29 16:59:40 +01:00
cloud_run_dispatch.py feat(infra): move heavy workers to Cloud Run Jobs 2026-04-29 21:47:10 +01:00
cost_tracker.py fix: correct cost tracker API field names and endpoint path 2026-04-27 13:42:29 +00:00
descriptive_transcript.py feat: DCMP compliance, descriptive transcript, new languages, QA bug fixes 2026-03-27 11:50:43 +00:00
elevenlabs_voices.py fix: propagate ElevenLabs voice fetch errors to frontend 2026-03-03 14:27:45 +00:00
emailer.py feat: two-stage QC (linguist→reviewer), project picker, comments, email notifications, deadlines 2026-04-29 16:59:40 +01:00
embedding_service.py fix: switch embedding model to gemini-embedding-001 2026-04-29 16:02:12 +01:00
ffmpeg_http_service.py feat: add Cloud Run HTTP services for Whisper and FFmpeg 2026-01-02 10:12:50 -06:00
gcs.py feat(mt-14): gcs_prefix on Job, gcs_path helper, rewrite path sites 2026-04-29 20:45:12 +01:00
gemini.py feat: per-client glossary — hybrid exact/vector retrieval + AI injection 2026-04-29 13:03:38 +01:00
gemini_tts.py feat: per-client glossary — hybrid exact/vector retrieval + AI injection 2026-04-29 13:03:38 +01:00
glossary_service.py fix: get_terms_page avoids GlossaryTerm validation on partial projection 2026-04-29 15:57:12 +01:00
language_qc.py feat(mt-11): cross-org assignment guard in language_qc 2026-04-29 20:22:46 +01:00
membership_service.py feat(saas): Phase 0+1 — Organization/Membership entities and dev branch 2026-04-27 16:46:24 +01:00
microsoft_auth.py perf: use DI connection pool for auth routes, async httpx for MS SSO (H-01, H-02) 2026-04-29 14:13:50 +01:00
secrets_manager.py initial commit 2025-08-24 16:28:33 -05:00
tts.py feat: per-client glossary — hybrid exact/vector retrieval + AI injection 2026-04-29 13:03:38 +01:00
validation.py feat: add accessible video validation, remove AI confidence check 2025-12-26 16:41:57 -06:00
video_renderer.py feat: DCMP compliance, descriptive transcript, new languages, QA bug fixes 2026-03-27 11:50:43 +00:00
vtt_retimer.py fix: use actual freeze segment durations for VTT subtitle retiming 2026-01-05 15:52:57 -06:00
vtt_versioning.py feat: VTT version control — snapshots, diff, restore 2026-04-29 11:46:21 +01:00
websocket.py feat(pr6): WS real-time updates, per-cue AD playback, upload guard 2026-04-29 19:42:57 +01:00
websocket_publisher.py wrote docker files and deployment instructions 2025-10-08 16:00:12 -05:00
whisper_http_service.py feat: add Cloud Run HTTP services for Whisper and FFmpeg 2026-01-02 10:12:50 -06:00
whisper_service.py fix: enforce AD cue pause_point monotonicity to preserve cue order 2026-02-26 08:15:06 -06:00
zip_download.py feat: DCMP compliance, descriptive transcript, new languages, QA bug fixes 2026-03-27 11:50:43 +00:00