Skip to content

Commit

Permalink
[MINOR][DOCS] Explicitly mention RDD/SparkContext are unsupported in …
Browse files Browse the repository at this point in the history
…Spark Connect

### What changes were proposed in this pull request?

This PR proposes to explicitly mention RDD/SparkContext are unsupported in Spark Connect instead of saying they are deprecated.

### Why are the changes needed?

To guide users properly about supported API.

### Does this PR introduce _any_ user-facing change?

Yes, it fixes the user-facing documentation.

### How was this patch tested?

Documentation build

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes apache#47752 from HyukjinKwon/minor-doc-connect.

Authored-by: Hyukjin Kwon <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>
  • Loading branch information
HyukjinKwon committed Aug 14, 2024
1 parent 55c0ea5 commit 3632732
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/spark-connect-overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -409,6 +409,6 @@ Majority of the Streaming API is supported, including
[StreamingQueryListener](api/scala/org/apache/spark/sql/streaming/StreamingQueryListener.html).

APIs such as [SparkContext](api/scala/org/apache/spark/SparkContext.html)
and [RDD](api/scala/org/apache/spark/rdd/RDD.html) are deprecated in all Spark Connect versions.
and [RDD](api/scala/org/apache/spark/rdd/RDD.html) are unsupported in Spark Connect.

Support for more APIs is planned for upcoming Spark releases.

0 comments on commit 3632732

Please sign in to comment.