Questions tagged with Amazon SageMaker JumpStart

I'm exploring fine-tuning with DPO and successfully trained facebook/opt-model (HF model) with DPO (Ref: https://huggingface.co/blog/dpo-trl). As part of DPO training, I first performed SFT training,...

I have deployed a pre trained hugging face model using jumpstart and it gives this error when i am hitting it in test interference. Error invoking endpoint: Received client error (400) from primary...

While building a chatbot in Lex, the closing response gives 3 options at most. I want more as I have more than 3 options given in the slot for a potential customer to choose from. Is there a way to...

I am following the turorial "Build a Full Stack Large Language Model Powered Chatbot: Extract Insights from Unstructured Documents" at...

Hello, I am using the Sagemaker Jumpstart Flan-T5 XL model to create a LLM Chatbot. I have completed the step by step and additional advanced examples to deploy an untrained model. Now I would like...

Hello, I am trying to add a Shared Model on AWS Jumpstart but only want to enable deployment, as the model was already trained on custom data outside of AWS JumpStart environment. However, after I...

Hi, I wonder how can i request access to Foundation models, specifically AI21 labs series, in Sagemaker JumpStart? I tried four different of regions including us-east-1 and 2. In AWS demos there are...

I have a question regarding: * Llama 2 fine-tuning, specifically on AWS Sagemaker * Masked Language Modelling (MLM) * Instruction tuning/Supervised fine tuning TLDR: **Is there a way I can do MLM...

Hi, I have deployed a Stable Diffusion XL 1.0 model on SageMaker using Sagemaker Jumpstart. I have also created a Lambda function to use the endpoint. While testing the Lambda function, the following...

I am unable to parse -the streaming output from the Llama2-7b-chat deployed on Sagemaker Jumpstart. I have written a custom class to parse each event from the stream. However, the entire output is...

I have deployed a SageMaker JumpStartModel using this code from a sample notebook: ``` from sagemaker.jumpstart.model import JumpStartModel model_id =...

Hi, I'm using a small dataset to finetune a Llama2 model. Each time I try to train via JumpStart, I'm stalling out with the same error: We encountered an error while training the model on your...