Sakhi-api-service chat API giving error

[abhilashkadu]

I setup the new Sakhi-api-service release-3.0.0. The query API is working fine but the chat API is giving error.
{ "detail": "None and Authentication required." }
I tried following the Swagger docs but still not able to run the chat API.

[Jayaprakash8887]

@abhilashkadu Kindly share the service logs after changing the 'LOG_LEVEL' environment variable to 'DEBUG'

[abhilashkadu]

uvicorn main:app /home/prihir/work/Tekdi_Repo/ABODH/Repositories/sakhi-api-service/sakhi/lib/python3.10/site-packages/pydub/utils.py:170: RuntimeWarning: Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work warn("Couldn't find ffmpeg or avconv - defaulting to ffmpeg, but may not work", RuntimeWarning) 2024-05-23 15:25:05 - 139667565060096 - MainThread - sakhi_activity - INFO - Initializing required classes for components 2024-05-23 15:25:05 - 139667565060096 - MainThread - sakhi_activity - INFO - Init llm class for: openai 2024-05-23 15:25:05 - 139667565060096 - MainThread - sakhi_activity - INFO - Init translate class for: google 2024-05-23 15:25:05 - 139667565060096 - MainThread - sakhi_activity - INFO - Init storage class for: gcp 2024-05-23 15:25:05 - 139667565060096 - MainThread - sakhi_activity - INFO - Init vectorstore class for: marqo INFO: Started server process [53619] INFO: Waiting for application startup. 2024-05-23 15:25:06 - 139667565060096 - MainThread - sakhi_activity - INFO - Invoking startup_event 2024-05-23 15:25:06 - 139667565060096 - MainThread - sakhi_activity - INFO - startup_event : Engine created INFO: Application startup complete. INFO: Uvicorn running on http://127.0.0.1:8000 (Press CTRL+C to quit) 2024-05-23 15:25:13 - 139667565060096 - MainThread - sakhi_activity - ERROR - {'index_id': 'sakhi_abodh_activities', 'query': 'I am sad', 'input_language': 'en', 'output_format': 'text', 'audio_url': '', 'status_code': 500, 'error_message': 'None and Authentication required.'} 2024-05-23 15:25:13 - 139667565060096 - MainThread - sakhi_activity - INFO - {'label': 'api_call', 'event': {'status_code': 500, 'duration': 625, 'body': {'input': {'language': 'en', 'text': 'I am sad', 'audio': '', 'context': 'abodh'}, 'output': {'format': 'text'}}, 'method': 'POST', 'url': URL('http://127.0.0.1:8000/v1/chat'), 'accept': 'application/json', 'content-type': 'application/json', 'authorization': 'Bearer eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJtb2JpbGVfZGV2aWNlIn0.W9cvngZh0_Y6hcGCBqS8MZOejkUxU9ptnJFji6VBHtA', 'user-agent': 'PostmanRuntime/7.37.3', 'postman-token': '068c9fc2-1764-4f86-b92f-611635ceb2bb', 'host': '127.0.0.1:8000', 'accept-encoding': 'gzip, deflate, br', 'connection': 'keep-alive', 'content-length': '145'}} INFO: 127.0.0.1:46418 - "POST /v1/chat HTTP/1.1" 500 Internal Server Error

[Jayaprakash8887]

@abhilashkadu Have you changed 'LOG_LEVEL' environment variable to 'DEBUG'?

[abhilashkadu]

Yes I changed it and shared but I think I needed to restart my VS code. Now it is giving different logs.
2024-05-24 09:45:37 - 139829742518272 - MainThread - sakhi_activity - DEBUG - {'label': 'query', 'query_text': 'I am sad', 'index_id': 'sakhi_abodh_activities', 'context': 'abodh', 'input_language': 'en', 'output_format': 'text', 'audio_url': ''} 2024-05-24 09:45:37 - 139829742518272 - MainThread - sakhi_activity - DEBUG - Redis session ID :: history_abodh 2024-05-24 09:45:37 - 139829742518272 - MainThread - google.auth._default - DEBUG - Checking gcp.json for explicit credentials as part of auth process... 2024-05-24 09:45:37 - 139829742518272 - MainThread - urllib3.util.retry - DEBUG - Converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) 2024-05-24 09:45:37 - 139829742518272 - MainThread - google.auth.transport.requests - DEBUG - Making request: POST https://oauth2.googleapis.com/token 2024-05-24 09:45:37 - 139829742518272 - MainThread - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): oauth2.googleapis.com:443 2024-05-24 09:45:37 - 139829742518272 - MainThread - urllib3.connectionpool - DEBUG - https://oauth2.googleapis.com:443 "POST /token HTTP/1.1" 200 None 2024-05-24 09:45:37 - 139829742518272 - MainThread - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): translation.googleapis.com:443 2024-05-24 09:45:38 - 139829742518272 - MainThread - urllib3.connectionpool - DEBUG - https://translation.googleapis.com:443 "POST /language/translate/v2?prettyPrint=false HTTP/1.1" 200 None 2024-05-24 09:45:38 - 139829742518272 - MainThread - sakhi_activity - DEBUG - enable_bot_intent: false 2024-05-24 09:45:38 - 139829742518272 - MainThread - sakhi_activity - DEBUG - activity_prompt_config: { "abodh" : "You are a simple AI assistant named 'ABODH BOT' specially programmed to help child sufferig from depression in the \ age group of 6 to 17 years. Your knowledge base includes only the given context. Your answer should not exceed 100 words. \ \ Context: \ ---------------- \ ABODH BOT is an AI assistant designed specifically to support children aged 6 to 17 dealing with depression.\ It offers guidance through beautifully crafted documents tailored to their age group.\ When children face emotional struggles, ABODH BOT initiates communication, providing answers to help overcome abuse or other challenges.\ It assists in understanding and addressing the child's problems, offering practical advice for positive behavior and activities.\ \ However, ABODH BOT has can go beyound training at a certain level to help the child.\ It should not leave the context.\ \ The documents ABODH BOT is trained on cover crucial areas such as child marriage, domestic violence protection, education rights, mental health care, child protection schemes, cyber safety, and protocols for children with disabilities.\ These resources empower children with knowledge and support to navigate their difficulties effectively.\ \ What are the documents the ABODH BOT is trained on? \ ● ABODH content for AI \ ● ABODH Content Sample Q&As - Sheet1 \ ● Beti-Bachao-Beti-Padhao-Scheme \ ● Child-Marriage-handbook (1) \ ● Anganwadi-Protocol-for-Divyang-Children-ENGLISH \ ● Child-Protection-Scheme \ ● CyberSafetyEng \ ● The Protection Of Women From Domestic Violence Rules 2006 \ ● Right Of Children To Free And Compulsory Education Act 2009 \ ● Mental Health Care Act2017\ {contexts} \ " } 2024-05-24 09:45:38 - 139829742518272 - MainThread - sakhi_activity - ERROR - {'index_id': 'sakhi_abodh_activities', 'query': 'I am sad', 'input_language': 'en', 'output_format': 'text', 'audio_url': '', 'status_code': 500, 'error_message': 'None and Authentication required.'} 2024-05-24 09:45:38 - 139829742518272 - MainThread - sakhi_activity - INFO - {'label': 'api_call', 'event': {'status_code': 500, 'duration': 717, 'body': {'input': {'language': 'en', 'text': 'I am sad', 'audio': '', 'context': 'abodh'}, 'output': {'format': 'text'}}, 'method': 'POST', 'url': URL('http://127.0.0.1:8000/v1/chat'), 'accept': 'application/json', 'content-type': 'application/json', 'authorization': 'Bearer eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJtb2JpbGVfZGV2aWNlIn0.W9cvngZh0_Y6hcGCBqS8MZOejkUxU9ptnJFji6VBHtA', 'user-agent': 'PostmanRuntime/7.37.3', 'postman-token': 'cd1e2d2c-d49a-41d5-b406-8c4e073e50cf', 'host': '127.0.0.1:8000', 'accept-encoding': 'gzip, deflate, br', 'connection': 'keep-alive', 'content-length': '145'}}

[Jayaprakash8887]

@abhilashkadu Looks like GCP credentials is having an issue. converted retries value: 3 -> Retry(total=3, connect=None, read=None, redirect=None, status=None) 2024-05-24 09:45:37 - 139829742518272 - MainThread - google.auth.transport.requests - DEBUG - Making request: POST https://oauth2.googleapis.com/token 2024-05-24 09:45:37 - 139829742518272 - MainThread - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): oauth2.googleapis.com:443 2024-05-24 09:45:37 - 139829742518272 - MainThread - urllib3.connectionpool - DEBUG - https://oauth2.googleapis.com:443 "POST /token

[abhilashkadu]

Do I need GCP credentials as I am not using translation currently. Can I disable the GCP use.