Customise Consent Preferences

We use cookies to help you navigate efficiently and perform certain functions. You will find detailed information about all cookies under each consent category below.

The cookies that are categorised as "Necessary" are stored on your browser as they are essential for enabling the basic functionalities of the site. ... 

Always Active

Necessary cookies are required to enable the basic features of this site, such as providing secure log-in or adjusting your consent preferences. These cookies do not store any personally identifiable data.

No cookies to display.

Functional cookies help perform certain functionalities like sharing the content of the website on social media platforms, collecting feedback, and other third-party features.

No cookies to display.

Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics such as the number of visitors, bounce rate, traffic source, etc.

No cookies to display.

Performance cookies are used to understand and analyse the key performance indexes of the website which helps in delivering a better user experience for the visitors.

No cookies to display.

Advertisement cookies are used to provide visitors with customised advertisements based on the pages you visited previously and to analyse the effectiveness of the ad campaigns.

No cookies to display.

Dapr’s microservices runtime now supports AI agents


Back in 2019, Microsoft open-sourced Dapr, a new runtime for making building distributed microservice-based applications easier. At the time, nobody was talking about AI agents yet, but as it turns out, Dapr had some of the fundamental building blocks for supporting AI agents built-in from the outset. That’s because one of Dapr’s core features is a concept of virtual actors, which can receive and process messages, independently from all the other actors in the system.

Today, the Dapr team is launching Dapr Agents, its take on helping developers build AI agents by providing them with a lot of the building blocks to do so.

“Agents are a very good use case for Dapr,” Dapr co-creator and maintainer Yaron Schneider explained. “From a technical perspective, you could use actors as a very lightweight way to run these agents and really be able to run them at scale with state — and be resource-efficient. This is all great, but then, there is still a lot of business logic you need to write. The statefulness and the orchestration of it are just one part. And many people, they might choose a workflow engine or an actor framework, but there’s still a lot of work they need to do to actually write the agent logic on the other side. There is lots of agent frameworks out there, but they don’t have the same level of orchestration and statefulness that Dapr has.”

Image Credits:Dapr Project

Dapr Agents originated from Floki, a popular open-source project that extended Dapr for this AI agent use case. Talking with the project maintainers, including Microsoft AI researcher Roberto Rodriguez, the two teams decided to bring the project under the Dapr umbrella to ensure the continuity of the new agent framework.

“In many ways we see agentic systems and the whole terminology around that as another term for ‘distributed systems,’ Dapr co-creator and maintainer Mark Fussell said. “[…] Rather than calling them microservices, you can call them agents now, mostly because you can put large language models amongst them all.”

To efficiently coordinate those agents, you do need an orchestration engine and statefulness, the team argues — which is exactly what Dapr delivers. That’s in part because Dapr’s actors are meant to be extremely efficient and able to spin up within milliseconds when a message comes in (and shut down, with their state preserved, when their job is done).

Right now, Dapr Agents can talk to most of the popular model providers out of the box. These include AWS Bedrock, OpenAI, Anthropic, Mistral, and Hugging Face. Support for local LLMs will arrive very soon.

On top of interacting with these models, since Dapr Agents extend the existing Dapr framework, developers also get the ability to define a list of tools that the agent can then use to fulfill a given task.

Currently, Dapr Agents supports Python, with .NET support launching soon. Java, JavaScript and Go will follow soon.




Source link

Show Comments (0) Hide Comments (0)
Leave a comment

Your email address will not be published. Required fields are marked *