What's Changed

• chore: NPM Workspaces and scripts by @ClaraLeigh in #244
• Feat: PaLM 2 by @danny-avila in #262

How to Use PaLM 2 (via Google Cloud Vertex AI API)

• Enable the Vertex AI API on Google Cloud:
• • https://console.cloud.google.com/vertex-ai
• Create a Service Account:
• • https://console.cloud.google.com/projectselector/iam-admin/serviceaccounts/create?walkthrough_id=iam--create-service-account#step_index=1
• Make sure to click 'Create and Continue' to give at least the 'Vertex AI User' role.
• Create a JSON key, rename as 'auth.json' and save it in /api/data/.

Alternatively

• In your ./api/.env file, set PALM_KEY as "user_provided" to allow the user to provide a Service Account key JSON from the UI.
• They will follow the steps above except for renaming the file, simply importing the JSON when prompted.
• The key is sent to the server but never saved except in your local storage

Note:

• Vertex AI does not (yet) support response streaming for text generations, so response may seem to take long when generating a lot of text.
• Text streaming is simulated

New Contributors

• @ClaraLeigh made their first contribution in #244

Full Changelog: v0.4.2...v0.4.3