Skip to content

[SPARK-58586][DOCS] Use a supported Python version in the RDD guide PYSPARK_PYTHON example - #57787

Closed
uros-b wants to merge 1 commit into
apache:masterfrom
uros-b:doc-rdd-python-version
Closed

[SPARK-58586][DOCS] Use a supported Python version in the RDD guide PYSPARK_PYTHON example#57787
uros-b wants to merge 1 commit into
apache:masterfrom
uros-b:doc-rdd-python-version

Conversation

@uros-b

@uros-b uros-b commented Aug 5, 2026

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

Updates the PYSPARK_PYTHON=python3.8 example in docs/rdd-programming-guide.md to python3.11.

Why are the changes needed?

The same page states that Spark works with Python 3.11+ about thirty lines above this example, and the build pins python_requires>=3.11, so the python3.8 example is stale and internally inconsistent.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Documentation only. No tests needed.

Was this patch authored or co-authored using generative AI tooling?

Generated-by: Claude Code (Opus 4.8)

@uros-b uros-b left a comment

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Waiting for CI; cc @HyukjinKwon for review

@dongjoon-hyun dongjoon-hyun left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM.

@uros-b uros-b closed this in 28a85ad Aug 6, 2026
uros-b added a commit that referenced this pull request Aug 6, 2026
…SPARK_PYTHON example

### What changes were proposed in this pull request?
Updates the `PYSPARK_PYTHON=python3.8` example in `docs/rdd-programming-guide.md` to `python3.11`.

### Why are the changes needed?
The same page states that Spark works with Python 3.11+ about thirty lines above this example, and the build pins `python_requires>=3.11`, so the python3.8 example is stale and internally inconsistent.

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Documentation only. No tests needed.

### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Code (Opus 4.8)

Closes #57787 from uros-b/doc-rdd-python-version.

Authored-by: Uros Bojanic <221401595+uros-b@users.noreply.github.com>
Signed-off-by: Uros Bojanic <221401595+uros-b@users.noreply.github.com>
(cherry picked from commit 28a85ad)
Signed-off-by: Uros Bojanic <221401595+uros-b@users.noreply.github.com>
uros-b added a commit that referenced this pull request Aug 6, 2026
…SPARK_PYTHON example

### What changes were proposed in this pull request?
Updates the `PYSPARK_PYTHON=python3.8` example in `docs/rdd-programming-guide.md` to `python3.11`.

### Why are the changes needed?
The same page states that Spark works with Python 3.11+ about thirty lines above this example, and the build pins `python_requires>=3.11`, so the python3.8 example is stale and internally inconsistent.

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Documentation only. No tests needed.

### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Claude Code (Opus 4.8)

Closes #57787 from uros-b/doc-rdd-python-version.

Authored-by: Uros Bojanic <221401595+uros-b@users.noreply.github.com>
Signed-off-by: Uros Bojanic <221401595+uros-b@users.noreply.github.com>
(cherry picked from commit 28a85ad)
Signed-off-by: Uros Bojanic <221401595+uros-b@users.noreply.github.com>
@uros-b

uros-b commented Aug 6, 2026

Copy link
Copy Markdown
Member Author

Merge Summary:

Posted by merge_spark_pr.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants