Skip to content

Streaming output is broken after refreshing chat app #35307

@wylswz

Description

@wylswz

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

To reproduce

  1. Start a conversation in chat bot
  2. Prompt the LLM to output long sequence
  3. Refresh the page and enter previous conversation

A possible solution

In message list API, add a workflow_run_id field to each message. The frontend tries to subscribe to last workflow run in the conversation.

In broadcast_channel, expose a boolean field called replay in subscribe APIs. If replay == True, the id used in xread should be 0 instead of $.

Consider using group in order to consume from the beginning.

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions