-
Notifications
You must be signed in to change notification settings - Fork 32
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Make spark-rapids-ml support ml connect plugin #835
base: branch-25.04
Are you sure you want to change the base?
Conversation
Signed-off-by: Bobby Wang <[email protected]>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Nice work! A few comments.
java/src/main/scala/org/apache/spark/ml/rapids/PythonRunner.scala
Outdated
Show resolved
Hide resolved
java/src/main/scala/org/apache/spark/ml/rapids/PythonRunner.scala
Outdated
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
one more comment to clarify how to build.
Curious about our project structure. We have a top-level jvm folder — does it make sense to have this java folder and the scala code together as subdirectories there? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks like you addressed all comments. Nice!
We should probably put this into branch-25.04, for next release. Can you redirect PR?
As a follow-up we should remove the Scala code example from the top-level README |
* | ||
* @param uid unique ID of the estimator | ||
*/ | ||
class RapidsLogisticRegression(override val uid: String) extends LogisticRegression with RapidsEstimator { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Hi @eordentlich, How do you think of the naming of RapidsLogisticRegression?
More details can be found at https://github.com/NVIDIA/spark-rapids-ml/pull/835/files#diff-0c997611c3c5fb9fa0641cb88e5aaa485b5fbc7293676fc28afab310dd430812