streaming

[navaneethstabilix]

async def stream_to_websocket(prompt:str):
async for chunk in llm.astream(prompt):
yield chunk.content
@app.get('/streaming/ask')
async def main(query: str):
return StreamingResponse(stream_to_websocket(query), media_type='text/event-stream')

is this code streaming the response yes or no

[dosubot[bot]]

Yes, the code is streaming the response. The stream_to_websocket function uses the llm.astream method to asynchronously stream chunks of the response, and the StreamingResponse in the main function is configured with media_type='text/event-stream', which is used for streaming data in FastAPI.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}

[navaneethstabilix]

why is not showing as streamed in my fastapi

[dosubot[bot]]

Ensure that your client-side code is correctly set up to handle and display streamed data. The client should be able to process text/event-stream data, which typically involves using an EventSource in JavaScript to listen for incoming events. Additionally, verify that there are no network or server configurations affecting the streaming, such as proxy settings or middleware that might buffer the response.

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}