-
Notifications
You must be signed in to change notification settings - Fork 1.3k
Model Metadata
A full model is composed of 3 types of entities:
- The model
- The instances
- The instance versions
Let's take the example of efficientnet to explain these entities.
A model like efficientnet contains multiple instances.
An instance is a specific variation of the model (e.g. B0, B1, ...) with a certain framework (e.g. TensorFlow2).
To create a model, a special model-metadata.json file must be specified.
Here's a basic example for model-metadata.json:
{
"ownerSlug": "INSERT_OWNER_SLUG_HERE",
"title": "INSERT_TITLE_HERE",
"slug": "INSERT_SLUG_HERE",
"subtitle": "",
"isPrivate": true,
"description": "Model Card Markdown, see below",
"publishTime": "",
"provenanceSources": ""
}
You can also use the API command kaggle models init -p /path/to/model to have the API create this file for you for a new model. If you wish to get the metadata for an existing model, you can use kaggle models get username/model-slug.
We currently support the following metadata fields for models.
-
ownerSlug: the slug of the user or organization -
title: the model's title -
slug: the model's slug (unique per owner) -
licenseName: the name of the license (see the list below) -
subtitle: the model's subtitle -
isPrivate: whether or not the model should be private (only visible by the owners). If not specified, will betrue -
description: the model's card in markdown syntax (see the template below) -
publishTime: the original publishing time of the model -
provenanceSources: the provenance of the model
You can find a template of the model card on this wiki page: https://github.com/Kaggle/kaggle-api/wiki/Model-Card
To create a model instance, a special model-instance-metadata.json file must be specified.
Here's a basic example for model-instance-metadata.json:
{
"ownerSlug": "INSERT_OWNER_SLUG_HERE",
"modelSlug": "INSERT_EXISTING_MODEL_SLUG_HERE",
"instanceSlug": "INSERT_INSTANCE_SLUG_HERE",
"framework": "INSERT_FRAMEWORK_HERE",
"overview": "",
"usage": "Usage Markdown, see below",
"licenseName": "Apache 2.0",
"fineTunable": False,
"trainingData": []
}
You can also use the API command kaggle models instances init -p /path/to/model-instance to have the API create this file for you for a new model instance.
We currently support the following metadata fields for model instances.
-
ownerSlug: the slug of the user or organization of the model -
modelSlug: the existing model's slug -
instanceSlug: the slug of the instance -
framework: the instance's framework (possible options:tensorFlow1,tensorFlow2,tfLite,tfJs,pyTorch,jax,coral) -
overview: a short overview of the instance -
usage: the instance's usage in markdown syntax (see the template below) -
fineTunable: whether the instance is fine tunable -
trainingData: a list of training data in the form of strings, URLs, Kaggle Datasets, etc...
Here is a list of the available licenses for models:
- Apache 2.0
- Attribution 3.0 IGO (CC BY 3.0 IGO)
- Attribution 3.0 Unported (CC BY 3.0)
- Attribution 4.0 International (CC BY 4.0)
- Attribution-NoDerivatives 4.0 International (CC BY-ND 4.0)
- Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)
- Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0)
- Attribution-NonCommercial-ShareAlike 3.0 IGO (CC BY-NC-SA 3.0 IGO)
- BSD-3-Clause
- CC BY-NC-SA 4.0
- CC BY-SA 3.0
- CC BY-SA 4.0
- CC0: Public Domain
- Community Data License Agreement - Permissive - Version 1.0
- Community Data License Agreement - Sharing - Version 1.0
- GNU Affero General Public License 3.0
- GNU Free Documentation License 1.3
- GNU Lesser General Public License 3.0
- GPL 2
- MIT
- ODC Attribution License (ODC-By)
- ODC Public Domain Dedication and Licence (PDDL)
You can find a template of the Usage markdown on this wiki page: https://github.com/Kaggle/kaggle-api/wiki/ModelInstance-Usage
To create a model instance version, a special model-instance-version-metadata.json file must be specified.
Here's a basic example for model-instance-version-metadata.json:
{
"ownerSlug": "INSERT_OWNER_SLUG_HERE",
"modelSlug": "INSERT_EXISTING_MODEL_SLUG_HERE",
"instanceSlug": "INSERT_EXISTING_INSTANCE_SLUG_HERE",
"framework": "INSERT_EXISTING_FRAMEWORK_SLUG_HERE",
"versionNotes": "",
}
You can also use the API command kaggle models instances versions init -p /path/to/model-instance -version to have the API create this file for you for a new model instance version.