Skip to content

fix(kafka): align concurrency limits with syslog - #709

Open
xiami762 wants to merge 1 commit into
devfrom
fix/kafka-concurrency
Open

fix(kafka): align concurrency limits with syslog#709
xiami762 wants to merge 1 commit into
devfrom
fix/kafka-concurrency

Conversation

@xiami762

Copy link
Copy Markdown
Contributor

Summary

  • raise the Kafka workflow worker cap from 2 to 8
  • raise the Kafka queue cap from 100 to 1000
  • align Kafka concurrency limits with the Syslog manager while preserving Kafka backpressure behavior

Root cause

Kafka trigger settings were silently capped below the requested values by lower manager-level safety limits.

Validation

  • uv run ruff check flocks/ingest/kafka/manager.py
  • uv run pytest -q tests/ingest/test_kafka_manager.py (16 passed)

@xiami762
xiami762 requested a review from duguwanglong August 14, 2026 03:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant