Skip to content

fixed getting kernel by type returns only one pool#22

Open
SubZeroX9 wants to merge 1 commit intomasterfrom
fix_get_by_type_round_robin
Open

fixed getting kernel by type returns only one pool#22
SubZeroX9 wants to merge 1 commit intomasterfrom
fix_get_by_type_round_robin

Conversation

@SubZeroX9
Copy link
Collaborator

  • added ConcurrentDictionary to maintain round robin indices for AIServiceProviderType
  • update GetKernelAsync to get all configs of request type and select based on index (round robin)
  • update GetKernelByName Linq method to FirstOrDefault to use our own exception throw

- added ConcurrentDictionary to maintain round robin indices for AIServiceProviderType
- update GetKernelAsync to get all configs of request type and select based on index (round robin)
- update GetKernelByName Linq method to FirstOrDefault to use our own exception throw
@SubZeroX9 SubZeroX9 self-assigned this Jan 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant