Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Image error fix #80

Merged
merged 7 commits into from
Dec 11, 2024
Merged

Image error fix #80

Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
eeca41b
added timeout Config to boto3
Nov 7, 2024
8ec13f2
fix for image
Dec 3, 2024
5ab992a
Merge branch 'main' of https://github.com/aws-samples/bedrock-access-…
Dec 3, 2024
777c1d1
Merge branch 'aws-samples:main' into image_error_fix
nonatofabio Dec 6, 2024
b39e721
Delete src/run.sh
nonatofabio Dec 6, 2024
0a514fb
Delete src/build.sh
nonatofabio Dec 6, 2024
7fcac5f
Delete .DS_Store
nonatofabio Dec 6, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 5 additions & 1 deletion src/api/models/bedrock.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,7 @@
from typing import AsyncIterable, Iterable, Literal

import boto3
from botocore.config import Config
import numpy as np
import requests
import tiktoken
Expand Down Expand Up @@ -42,9 +43,12 @@

logger = logging.getLogger(__name__)

config = Config(connect_timeout=1, read_timeout=120, retries={"max_attempts": 1})

bedrock_runtime = boto3.client(
service_name="bedrock-runtime",
region_name=AWS_REGION,
config=config,
)

SUPPORTED_BEDROCK_EMBEDDING_MODELS = {
Expand Down Expand Up @@ -362,7 +366,7 @@ def _invoke_bedrock(self, chat_request: ChatRequest, stream=False):
# convert OpenAI chat request to Bedrock SDK request
args = self._parse_request(chat_request)
if DEBUG:
logger.info("Bedrock request: " + json.dumps(args))
logger.info("Bedrock request: " + json.dumps(str(args)))

try:
if stream:
Expand Down
Loading