Commit 5aeb251
committed
[SPARK-58615][ML] Avoid FPGrowthModel temporary column conflicts
### What changes were proposed in this pull request?
This follow-up to #57806 gives the transient association-rules column in `FPGrowthModel.transform` a generated name instead of the fixed name `rules`. It also adds regression coverage for an input dataset that already contains a `rules` column.
### Why are the changes needed?
The fixed temporary column can conflict with an input column of the same name after the join, causing ambiguous-column analysis failures or dropping the user's column.
### Does this PR introduce _any_ user-facing change?
Yes. `FPGrowthModel.transform` now supports and preserves an input column named `rules`.
### How was this patch tested?
- `build/sbt -java-home /usr/lib/jvm/java-17-openjdk-amd64 mllib/Test/compile`
- Added `FPGrowthSuite` coverage for an input `rules` column. The focused suite has not been run locally yet.
### Was this patch authored or co-authored using generative AI tooling?
Generated-by: Codex (GPT-5)
Closes #57816 from zhengruifeng/ml_fpgrowth_temp_rules_column.
Authored-by: Ruifeng Zheng <ruifengz@apache.org>
Signed-off-by: Ruifeng Zheng <ruifengz@foxmail.com>1 parent eb318ba commit 5aeb251
1 file changed
Lines changed: 4 additions & 3 deletions
Lines changed: 4 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
280 | 280 | | |
281 | 281 | | |
282 | 282 | | |
| 283 | + | |
283 | 284 | | |
284 | 285 | | |
285 | 286 | | |
| |||
293 | 294 | | |
294 | 295 | | |
295 | 296 | | |
296 | | - | |
297 | | - | |
298 | | - | |
| 297 | + | |
| 298 | + | |
| 299 | + | |
299 | 300 | | |
300 | 301 | | |
301 | 302 | | |
| |||
0 commit comments