Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
ekuka86 committed Jul 11, 2024
1 parent 3ab5051 commit 025f7c8
Showing 1 changed file with 21 additions and 0 deletions.
21 changes: 21 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,27 @@
* After a couple of minutes then head over to "localhost:8080"
* In "ADD LLM" type out the LLM you want to use (we recomend qwen2:1.5b or qwen2:0.5b) and press "Add LLM"

## Usage Flow:

The user runs ‘screenshot-desktop.py’ whenever they want to start recording their screens


The extracted text from the screenshots is processed by the DocTR OCR tool and stored in the ChromaDB vector database, along with their corresponding embeddings generated by the JinaAI embedding model.


When the user has a query or needs to retrieve relevant information, they can input their request into ‘LLM Prompt’.


The query is then processed by the JinaAI reranker model, which retrieves the most relevant text chunks from the ChromaDB database based on the semantic similarity of the embeddings.


The retrieved information is presented to the user, providing them with the necessary context and insights without ever leaving their local device.


This approach ensures that all data processing and storage remain under the user's control, eliminating the risks associated with cloud-based solutions and empowering users to maintain their privacy.



## Functionality
Run "screenshot-desktop.py" to start capturin the screen

Expand Down

0 comments on commit 025f7c8

Please sign in to comment.