KEP-2170: Create LLM training runtime for Llama 3.1 8B

[andreyvelich]

Related: #2170

Once we implement storage initializers, trainers, and controllers, we should add the LLM training runtimes.
We can start with runtime for Llama 3.1 8B.

https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct

/area runtime

[Electronic-Waste]

/assign

I can help with this. Please let me know if you have different plans @kubeflow/wg-training-leads .

[andreyvelich]

Thank you, Shao!
However, we need to work on the LLM Trainer before we add the post-training runtimes: #2321

[Electronic-Waste]

Thanks for pointing this out, Andrey!

Shall I unassign myself since this issue is related to #2321 ?

[andreyvelich]

If you could also help us with #2321 that would be great!
We have a few ideas with @saileshd1402, but we still investigate on how we can build that Trainer to support different LLMs and datasets.

[Electronic-Waste]

Sure, I'm glad to hear that I can help with #2321 !

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[Electronic-Waste]

/remove-label lifecycle/stale

[google-oss-prow]

@Electronic-Waste: The label(s) /remove-label lifecycle/stale cannot be applied. These labels are supported: tide/merge-method-merge, tide/merge-method-rebase, tide/merge-method-squash, lifecycle/needs-triage. Is this label configured under labels -> additional_labels or labels -> restricted_labels in plugin.yaml?

In response to this:

/remove-label lifecycle/stale

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

[Electronic-Waste]

/remove-lifecycle stale