Skip to content

docs: update buckets recreation procedure#3897

Merged
joanagmaia merged 2 commits intomainfrom
docs/update-buckets-recreation
Mar 24, 2026
Merged

docs: update buckets recreation procedure#3897
joanagmaia merged 2 commits intomainfrom
docs/update-buckets-recreation

Conversation

@joanagmaia
Copy link
Contributor

@joanagmaia joanagmaia commented Mar 6, 2026

This pull request updates the documentation for the bucketing architecture bootstrap procedure in services/libs/tinybird/bucketing-architecture.md. The main focus is to clarify and make the snapshotting process safer by providing a more detailed, step-by-step guide and explaining the importance of pausing enrichment during the process.

Improvements to the snapshot bootstrap procedure:

  • Expanded the bootstrap procedure steps to clarify that snapshot pipes use append mode and to provide a safer, more granular process for recreating buckets, including pausing enrichment, truncating datasources, running snapshots, and resuming enrichment.
  • Added an explanation for why the enrichment copy pipe should be paused before truncating datasources, highlighting the risk of producing empty or partial results if not paused.

Note

Low Risk
Documentation-only change that clarifies an operational procedure; low risk aside from potential for misinterpretation if the steps are followed incorrectly.

Overview
Updates services/libs/tinybird/bucketing-architecture.md to clarify that bucket snapshot pipes run in append mode and therefore require an explicit truncate to rebuild buckets from scratch.

Replaces the prior high-level bootstrap checklist with a safer, per-bucket step-by-step procedure that pauses the enrichment copy pipe before truncation, runs the snapshot, validates bucket population, then resumes enrichment, and adds a short rationale for pausing to avoid empty/partial enrichment results.

Written by Cursor Bugbot for commit e947d68. This will update automatically on new commits. Configure here.

@joanagmaia joanagmaia requested a review from epipav March 6, 2026 15:17
@github-actions
Copy link
Contributor

github-actions bot commented Mar 6, 2026

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

2 similar comments
@github-actions
Copy link
Contributor

github-actions bot commented Mar 6, 2026

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

@github-actions
Copy link
Contributor

github-actions bot commented Mar 6, 2026

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

Signed-off-by: Joana Maia <jmaia@contractor.linuxfoundation.org>
@joanagmaia joanagmaia force-pushed the docs/update-buckets-recreation branch from e25daf1 to 0da8da9 Compare March 24, 2026 14:04
@github-actions
Copy link
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

1 similar comment
@github-actions
Copy link
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

…ecreation

Signed-off-by: Joana Maia <jmaia@contractor.linuxfoundation.org>
@joanagmaia joanagmaia force-pushed the docs/update-buckets-recreation branch from fca0ff1 to e947d68 Compare March 24, 2026 14:05
@github-actions
Copy link
Contributor

⚠️ Jira Issue Key Missing

Your PR title doesn't contain a Jira issue key. Consider adding it for better traceability.

Example:

  • feat: add user authentication (CM-123)
  • feat: add user authentication (IN-123)

Projects:

  • CM: Community Data Platform
  • IN: Insights

Please add a Jira issue key to your PR title.

@joanagmaia joanagmaia merged commit e5fb896 into main Mar 24, 2026
15 checks passed
@joanagmaia joanagmaia deleted the docs/update-buckets-recreation branch March 24, 2026 14:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants