[Feature Request]: Suggested actions support for streamed messages

[Benjiiim]

Scenario

The platform allows developers to provide suggested actions to help users with ideas of what to ask next, based on the previous response or conversation. See Add Prompt Suggestions - Teams | Microsoft Learn

Would it be possible to support suggested actions to Teams AI Library?

Solution

Allow developers to add suggested actions in the PredictedSAYCommand action or in the endStreamHandler.

Additional Context

No response

[Prasad-MSFT]

To achieve your requirements, we recommend you give your feedback in Teams Feedback Portal. Microsoft will always focus on customer’s feedback and experience. Some new features would be added to the services based on customers' feedback in the future, and your good ideas will be very helpful for them to improve the service.

[Benjiiim]

Thanks for your answer Prasad.

I’m concerned that submitting a feature request through the Teams Feedback Portal may not bring attention to such a specific issue related to the Teams AI Library. It would be really helpful to get some feedback directly from the product team on whether this is something that could be addressed either in the current version or in future updates.

Would you mind to ask to someone from the engineering team to comment if such an enhancement can be considered for the current version of the library or for the future?

Thanks again

[Benjiiim]

Hello @Prasad-MSFT,
As far as I can see, Suggested Actions are there in v2. 🎉

const message = new MessageActivity("This is the answer").addAiGenerated();

message.withSuggestedActions({
  to: [activity.from.id],
  actions: [
      {
          type: 'imBack',
          title: 'Suggested action title',
          value: 'Suggested action text that is going to be sent',
      }
  ]
});

send(message);

However, I can't find a way to add suggested actions in a streamed message. The following doesn't seem to work as I'm getting 403 ERR_BAD_REQUEST and 403 ContentStreamNotAllowed errors (this flow works to add citations to a message after streaming):

stream.update('Thinking...');

stream.emit('you said ');
stream.emit(`${activity.text}`);
stream.emit('!');

const message = new MessageActivity().withSuggestedActions({
    to: [activity.from.id],
    actions: [
        {
            type: 'imBack',
            title: 'Suggested action title',
            value: 'Suggested action text that is going to be sent',
        }
    ]
});

stream.emit(message);

Would you be able to ask the engineering if this is possible or planned?

Thanks a lot,

[Benjiiim]

@heyitsaamir > may I ask you to have a look to this one? Thanks a lot

[renan-redel]

I'm also looking for this.
I managed to get suggested actions working with streaming response, by sending a new message with invisible character and the quick actions.

    if quick_replies and len(quick_replies) > 0:
        # Lazy import to avoid potential import issues
        from botbuilder.schema import (
            Activity,
            ActivityTypes,
            ActionTypes,
            CardAction,
            SuggestedActions,
        )

        # Get the recipient ID for suggested actions
        recipient_id = None
        if context.activity.from_property:
            recipient_id = context.activity.from_property.id

        suggested_actions = SuggestedActions(
            to=[recipient_id] if recipient_id else [],
            actions=[
                CardAction(
                    type=ActionTypes.im_back,
                    title=reply,
                    value=reply,
                )
                for reply in quick_replies[:6]
            ],
        )
        follow_up = Activity(
            type=ActivityTypes.message,
            text="\u200B",  # Zero-width space (invisible character)
            suggested_actions=suggested_actions,
        )
        await context.send_activity(follow_up)
        logger.debug("Sent %d suggested actions", len(quick_replies[:6]))

[Mutantpenguin]

Any news on this?

If this is not working by design, you shouldn't advertise it as a "Best Practise" in https://microsoft.github.io/teams-sdk/typescript/in-depth-guides/ai/best-practices/#suggested-actions

[MSFTRickyCastaneda]

Issue updated to reflect new scope and passed along to product team.