• Convert the test project to be built on the build machine, and then run on helix similar to workload tests.
• Test to check that the generated manifest is the same as the on disk. (see [tests] Add Aspire.Playground.Tests #5208 (comment)) - Add tests that validate that playground app manifests are not broken #4297

Add more playground apps

• BrowserTelemetry
• DatabaseMigration
• OracleEndToEnd
• Stress
• orleans
• python
• webpubsub (test the webapp?)
• 🔴 dapr (Enable dapr tests on CI #5416)
• 🔴 AspireEventHub (blocked: [tests] Add AspireEventHub to playground tests #5319)
• 🔴 Elasticsearch (blocked: [tests] Elasticsearch playground app dies with exit code 137 when running as part of the tests #5283)
• 🔴 mongo (blocked: needs docker desktop - [tests] Mongo playground tests failing to connect to host.docker.internal #5274)
• AzureStorageEndToEnd ([tests] Add AzureStorageEndToEnd playground app to tests #5316)
• CosmosEndtoEnd - [tests] Add CosmosEndToEnd to playground tests #5244 depends on Aspire.Hosting.Testing: Improve error message when loading #5218
• ParameterEndToEnd ([tests] Add more playground apps to tests #5252)
• PostgresEndToEnd ([tests] Add more playground apps to tests #5252)
• ProxylessEndToEnd
• Qdrant
• SqlServerEndToEnd ([tests] Add more playground apps to tests #5252)
• TestShop
• seq
• keycloak - Hosting.Keycloak: Fix importDirectory param validation in WithRealmImport #5220
• milvus ([tests] Add tests for more Playground apps #5294)
• mysql
• nats
• withdockerfile ([tests] Add more playground apps #5395)
• kafka ([tests] Add more playground apps #5395)

Needs custom tests

• CustomResources

Need external resources

• 🟠 AzureSearchEndToEnd (Resource could not be provisioned because Azure subscription, location, and resource group information is missing.)
• 🟠 AWS ( Unable to find the "default" profile in CredentialProfileStoreChain)
• 🟠 bicep (Resource could not be provisioned because Azure subscription, location, and resource group information is missing)
• 🟠 cdk (Resource could not be provisioned because Azure subscription, location, and resource group information is missing)
• 🟠 OpenAIEndToEnd (Resource could not be provisioned because Azure subscription, location, and resource group information is missing.
• 🟠 signalr (Resource could not be provisioned because Azure subscription, location, and resource group information is missing)