Syncing knowledge base with start_ingestion_job fails

0

So I have created a lambda function, which uses the function start_ingestion_job to sync a knowledge base with the existing s3 bucket (when new data is added to it). But it fails randomly. What could be the possible reasons?

1 Answer
2

Hello.

What kind of errors are output in the Lambda function logs?
Could you please check the CloudWatch Logs and share the error you output when your Lambda function fails?

profile picture
EXPERT
answered a month ago
profile picture
EXPERT
reviewed a month ago
  • Sync warnings for July 02, 2024, 17:56 (UTC+05:30) to July 02, 2024, 17:57 (UTC+05:30) Error warning The server encountered an internal error while processing the request.

  • Is this an error that occurs frequently? For example, is this a problem that occurs once in three times? Since it is an "internal error", it may not be resolved without checking with AWS Support, but is there a problem with the file uploaded to S3? For example, are there files that are not supported or file sizes that are large? https://docs.aws.amazon.com/bedrock/latest/userguide/knowledge-base-ds.html

  • If I move that folder to another bucket, manually sync the KB and then move it back.It syncs normally. The sizes of the files in that folder is pretty small. They are jsons and metadata jsons. But according to you, this error might mostly be due the file's content?

  • Yes, it occurs frequently. for eg, in one the sync jobs, almost 20+ warnings are this and it repeats continuously.

  • @Riku_Kobyashi anything for me?