Skip to content

Document Terraform redpanda_pipeline resource and Connect egress allowlist#641

Open
david-yu wants to merge 2 commits into
mainfrom
docs-terraform-connect-pipelines-egress
Open

Document Terraform redpanda_pipeline resource and Connect egress allowlist#641
david-yu wants to merge 2 commits into
mainfrom
docs-terraform-connect-pipelines-egress

Conversation

@david-yu

@david-yu david-yu commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Description

Documents the redpanda_pipeline resource and the new redpanda_connect.allowed_destination_cidr_ports egress allowlist, released in Redpanda Terraform provider v2.1.1 (terraform-provider-redpanda#359).

  • Terraform provider page: new "Create Redpanda Connect pipelines" section (placed above "Manage cluster secrets") with a redpanda_pipeline example, attribute descriptions, and a note on escaping ${...} secret/contextual-variable references as $${...} in HCL heredocs. Includes an "Enable egress to custom destinations" subsection documenting the CIDR+port allowlist (up to 16 rules, in-place update, single-port rules omit port_end), the network-path caveat (allowlist does not replace VPC peering/routes), and an end-to-end sql_insert-to-private-PostgreSQL pipeline example. Added a fifth learning objective.
  • Connect quickstart: new "Enable egress for pipelines on BYOC clusters" section explaining default egress behavior and the allowlist, cross-linking to the Terraform provider section.
  • What's New: July 2026 entry for the feature.

Review deadline:

Preview pages

Checks

  • New feature
  • Content gap
  • Support Follow-up
  • Small fix (typos, links, copyedits, etc)

…wlist

Add a "Create Redpanda Connect pipelines" section to the Terraform
provider page (above "Manage cluster secrets"), covering the
redpanda_pipeline resource and the new
redpanda_connect.allowed_destination_cidr_ports egress allowlist
(provider v2.1.1+). Add a BYOC egress allowlist section to the Connect
quickstart and a What's New entry.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@david-yu
david-yu requested a review from a team as a code owner July 20, 2026 17:59
@netlify

netlify Bot commented Jul 20, 2026

Copy link
Copy Markdown

Deploy Preview for rp-cloud ready!

Name Link
🔨 Latest commit 8788cd3
🔍 Latest deploy log https://app.netlify.com/projects/rp-cloud/deploys/6a5f259fc607480008b3ed6f
😎 Deploy Preview https://deploy-preview-641--rp-cloud.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@coderabbitai

coderabbitai Bot commented Jul 20, 2026

Copy link
Copy Markdown
Contributor

Review Change Stack

Important

Review skipped

Auto incremental reviews are disabled on this repository.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 43714123-ef3e-46c1-a549-a2453d9d2456

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
📝 Walkthrough

Walkthrough

Adds documentation for creating Redpanda Connect pipelines with Terraform and configuring BYOC outbound egress allowlists through redpanda_connect.allowed_destination_cidr_ports. It covers CIDR/port rules, provider version requirements, in-place cluster updates, Terraform interpolation escaping, private PostgreSQL pipeline examples, default egress behavior, and the need to configure network paths separately.

Estimated code review effort: 2 (Simple) | ~10 minutes

Suggested reviewers: michelerp

🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Title check ✅ Passed The title clearly summarizes the two main additions: the Terraform redpanda_pipeline docs and the Connect egress allowlist.
Description check ✅ Passed The description matches the template well with summary, previews, and checks, but it omits the required issue reference and leaves review deadline blank.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch docs-terraform-connect-pipelines-egress

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@modules/manage/pages/terraform-provider.adoc`:
- Line 390: Update the Redpanda provider version constraints in the setup block
and all BYOC, Dedicated, and Serverless example snippets from ~> 1.0 to a
constraint allowing version 2.1.1 or newer, ensuring examples using
redpanda_connect.allowed_destination_cidr_ports are installable.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro

Run ID: 9378219e-b466-4d66-82e7-e445139aa7d6

📥 Commits

Reviewing files that changed from the base of the PR and between b6a9a28 and 96fef1d.

📒 Files selected for processing (3)
  • modules/develop/pages/connect/connect-quickstart.adoc
  • modules/get-started/pages/whats-new-cloud.adoc
  • modules/manage/pages/terraform-provider.adoc

Comment thread modules/manage/pages/terraform-provider.adoc
Comment thread modules/manage/pages/terraform-provider.adoc Outdated
Comment thread modules/manage/pages/terraform-provider.adoc
Comment thread modules/develop/pages/connect/connect-quickstart.adoc Outdated
…= 2.1.1

- Trim learning objectives to three: create a BYOC cluster, enable
  Redpanda SQL, and create Redpanda Connect pipelines with egress
- Bump provider version pins from ~> 1.0 to >= 2.1.1 so examples using
  redpanda_connect.allowed_destination_cidr_ports are installable
- Use "data plane" and "publicly routable" per reviewer suggestion

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@david-yu
david-yu requested a review from kbatuigas July 21, 2026 16:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants