List FinetuneJobModels
List finetune job models.
Authorizations
Tune API Keys are the preferred way to authenticate with the API. You can create an API Key from your Tune Studio Profile → 'Access Keys' (in sidebar)
Body
The finetune job ID to be fetched.
Response
The list of models.
LLM model id which is supported by tune.Studio or any huggingface model.
The time the model was created.
feature gates for the model (internal use).
The id of the model.
metadata for the model.
- MODALITY_TEXT: Text.
- MODALITY_IMAGE: Image.
- MODALITY_AUDIO: Audio.
- MODALITY_VIDEO: Video.
- MODALITY_IMAGE_TEXT: Image and Text.
MODALITY_UNSPECIFIED, MODALITY_TEXT, MODALITY_IMAGE, MODALITY_AUDIO, MODALITY_VIDEO, MODALITY_IMAGE_TEXT - QUANTIZATION_AWQ: Aware Quantization.
- QUANTIZATION_GPTQ: GPT Quantization.
- QUANTIZATION_SQUEEZELLM: SqueezeLLM Quantization.
- QUANTIZATION_FP16: FP16 Quantization.
QUANTIZATION_UNSPECIFIED, QUANTIZATION_AWQ, QUANTIZATION_GPTQ, QUANTIZATION_SQUEEZELLM, QUANTIZATION_FP16 The name of the model.
true if model have public endpoint else false.
number of replicas for the model.
Used to specify the resource requirement for a (job, model).
CPU in milli-core.
GPU Type.
Number of GPUs.
max number of retries for a job.
Memory in MiB.
in seconds. Note this is inclusive of jobs and init containers,
enforced by k8s, regardless of max_retries set.
Not supported for models.
server type of the model, if empty used from DB.
State of the model. This is used to track the model's lifecycle. The state is updated by the model controller.
extra message for the state.
State of the model.
- UNSPECIFIED: Model in unknown state.
- PROVISIONING: model is being created on the cluster.
- ENV_SETUP: running initilization steps.
- AWAITING_STARTUP: starting model container.
- LIVENESS_CHECK: checking model liveness.
- READY: model is ready.
- FAILED: model is in error state.
- TERMINATED: model is terminated can be restarted.
UNSPECIFIED, PROVISIONING, ENV_SETUP, AWAITING_STARTUP, LIVENESS_CHECK, READY, FAILED, TERMINATED tracker id of the for model analytics.
The time the model was last updated.
uri of the model in the form of username/model_name.
Was this page helpful?