Update to use Microsoft.Extensions.AI.Abstractions

[SteveSandersonMS]

Now that Microsoft.Extensions.AI.Abstractions is published, we should replace IInferenceBackend with IChatClient. This should also allow us to remove SmartComponents.Inference.OpenAI completely, as the code here would instantly work with any LLM backend that has a corresponding IChatClient.

[quattro004]

Is there a reason why the associated PR was closed but not merged in? I was thinking of working on this issue. #42

[SteveSandersonMS]

@quattro004 That PR was closed by its author. I'm not sure why they did that. However if you want to create an updated version of that PR please feel free.

[quattro004]

Thanks @SteveSandersonMS, I'll take a look at this over the weekend.

[quattro004]

Hi @SteveSandersonMS I've got the code updated and building locally but I am having issues with getting the tests to run. I created a branch for you to review but it seems I'm not able to push it up to the origin as I get access denied. What should I do next?

For the e2e tests the error is something related to configuring the chat client to work with the test hosts. I get this when I try to run them:

System.ArgumentException : Cannot instantiate implementation type 'Microsoft.Extensions.AI.IChatClient' for service type 'Microsoft.Extensions.AI.IChatClient'.

[SteveSandersonMS]

I created a branch for you to review but it seems I'm not able to push it up to the origin as I get access denied. What should I do next?

You'll need to push to your own fork of the repo. GitHub allows you to submit a PR to the original repo from your fork.

For the e2e tests the error is something related to configuring the chat client to work with the test hosts. I get this when I try to run them:

I'm afraid I don't know. It's something you'd need to debug. Most likely something about how you're registering IChatClient in DI is incorrect.

[quattro004]

Ok, thanks I'll get a fork setup.

No worries, I'll get this figured out and hopefully have a PR for you in the next couple of days.

[quattro004]

I've got a fork created and will make a PR once I get the tests running, any insight would be appreciated. https://github.com/quattro004/smartcomponents

[quattro004]

Hi @SteveSandersonMS I thought I'd give an update. I have most of the tests running in my fork and hope to have a PR this weekend. One of the things I noticed is that since we are removing the SmartComponents.Inference.OpenAI project completely we might need a follow up task to update this documentation which mentions the project. https://github.com/dotnet/smartcomponents/blob/main/docs/configure-openai-backend.md

[quattro004]

Hello @SteveSandersonMS I pushed my PR and it initially had a problem with the license agreement. I agreed to that, but it looks like it's stuck at the license step maybe? Let me know if there's anything more I need to do. Thanks.

[quattro004]

Hi @SteveSandersonMS, not sure if you noticed but I am just waiting on your approval for this PR.