FastChat Docker Deployment for Woz Prototype with MIstral 7B -- 4

I need a fast and efficient deployment of FastChat using Docker, to be implemented on a local server. The goal of this deployment is to facilitate the development of a Woz prototype, which stands for Wizard-of-Oz prototype. The prototype will be used to test various functionalities and gauge human interaction with the system. Key requirements and considerations: - FastChat implementation using Docker: The implementation should be smooth and efficient, ensuring seamless operation on a local server. - Woz prototype focus: The project primarily aims at using FastChat to create a Woz prototype. This prototype will be utilized to test and evaluate various functionalities. - Functionalities include: - Speech recognition: The system should be able to recognize and interpret speech inputs. - Natural language processing: The prototype should be capable of understanding and processing natural language inputs. - Dialog management: An essential requirement is that the prototype can manage dialogues effectively. - Model performance: The overall objective is to assess the performance and efficiency of the model. - RAG: The prototype should make effects of llmrag and reportAI (as in the attached image) Ideal skills and experience for this project: - Proficiency in Docker and deployment on local servers. - Experience in FastChat implementation or similar chatbot systems. - Knowledge in creating and testing Woz prototypes. - Expertise in speech recognition, natural language processing, and dialog management. - Understanding of model performance evaluation and RAG rating system. Your delivery should be a well-documented, functioning deployment of FastChat in a local server setting (cloud and local pcs), with the necessary functionalities for the Woz prototype in place. Dockerfile [login to view URL] [login to view URL] my pip install -r [login to view URL] errors (should be fixed) Installing collected packages: tbb, striprtf, pytz, mpmath, intel-openmp, dirtyjson, wrapt, watchdog, urllib3, tzdata, typing-extensions, tornado, toolz, toml, threadpoolctl, tenacity, sympy, soupsieve, sniffio, smmap, six, safetensors, rpds-py, regex, PyYAML, pypdf, pygments, protobuf, pillow, packaging, numpy, networkx, nest-asyncio, mypy-extensions, multidict, mkl, minijinja, mdurl, MarkupSafe, joblib, idna, h11, greenlet, fsspec, frozenlist, filelock, distro, colorama, charset-normalizer, certifi, cachetools, blinker, attrs, annotated-types, yarl, typing-inspect, tqdm, SQLAlchemy, scipy, requests, referencing, python-dateutil, pydantic-core, pyarrow, marshmallow, markdown-it-py, jinja2, httpcore, gitdb, faiss-cpu, deprecated, click, beautifulsoup4, anyio, aiosignal, torch, tiktoken, scikit-learn, rich, pydeck, pydantic, pandas, nltk, jsonschema-specifications, huggingface-hub, httpx, gitpython, dataclasses-json, aiohttp, tokenizers, openai, llamaindex-py-client, jsonschema, transformers, llama-index-legacy, llama-index-core, altair, streamlit, sentence-transformers, llama-parse, llama-index-vector-stores-faiss, llama-index-readers-file, llama-index-llms-openai, llama-index-indices-managed-llama-cloud, llama-index-embeddings-openai, llama-index-readers-llama-parse, llama-index-multi-modal-llms-openai, llama-index-embeddings-huggingface, llama-index-cli, llama-index-agent-openai, llama-index-program-openai, llama-index-question-gen-openai, llama-index ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts. tensorboard 2.13.0 requires grpcio>=1.48.2, which is not installed. tensorflow-intel 2.13.0 requires grpcio<2.0,>=1.24.3, which is not installed. conda-repo-cli 1.0.41 requires requests_mock, which is not installed. gensim 4.3.0 requires FuzzyTM>=0.4.0, which is not installed. tables 3.8.0 requires blosc2~=2.0.0, which is not installed. tables 3.8.0 requires cython>=0.29.21, which is not installed. google-auth 2.22.0 requires urllib3<2.0, but you have urllib3 2.2.1 which is incompatible. llmware 0.2.13 requires boto3==1.24.53, but you have boto3 1.24.28 which is incompatible. tensorflow-intel 2.13.0 requires numpy<=1.24.3,>=1.22, but you have numpy 1.26.4 which is incompatible. tensorflow-intel 2.13.0 requires typing-extensions<4.6.0,>=3.6.6, but you have typing-extensions 4.12.1 which is incompatible. botocore 1.27.59 requires urllib3<1.27,>=1.25.4, but you have urllib3 2.2.1 which is incompatible. conda-repo-cli 1.0.41 requires clyent==1.2.1, but you have clyent 1.2.2 which is incompatible. conda-repo-cli 1.0.41 requires nbformat==5.4.0, but you have nbformat 5.7.0 which is incompatible. conda-repo-cli 1.0.41 requires python-dateutil==2.8.2, but you have python-dateutil [login to view URL] which is incompatible. conda-repo-cli 1.0.41 requires PyYAML==6.0, but you have pyyaml 6.0.1 which is incompatible. conda-repo-cli 1.0.41 requires requests==2.28.1, but you have requests 2.32.3 which is incompatible. jupyter-server 1.23.4 requires anyio<4,>=3.1.0, but you have anyio 4.4.0 which is incompatible. mdit-py-plugins 0.3.0 requires markdown-it-py<3.0.0,>=1.0.0, but you have markdown-it-py 3.0.0 which is incompatible. python-lsp-black 1.2.1 requires black>=22.3.0, but you have black 0.0 which is incompatible. s3fs 2023.3.0 requires fsspec==2023.3.0, but you have fsspec 2024.6.0 which is incompatible. Successfully installed MarkupSafe-2.1.1 PyYAML-6.0.1 SQLAlchemy-1.4.39 aiohttp-3.8.3 aiosignal-1.2.0 altair-5.3.0 annotated-types-0.6.0 anyio-3.5.0 attrs-22.1.0 beautifulsoup4-4.12.2 blinker-1.8.2 cachetools-5.3.3 certifi-2024.2.2 charset-normalizer-2.0.4 click-8.0.4 colorama-0.4.6 dataclasses-json-0.6.6 deprecated-1.2.14 dirtyjson-1.0.8 distro-1.9.0 faiss-cpu-1.8.0 filelock-3.14.0 frozenlist-1.3.3 fsspec-2023.3.0 gitdb-4.0.11 gitpython-3.1.43 greenlet-2.0.1 h11-0.14.0 httpcore-1.0.2 httpx-0.26.0 huggingface-hub-0.23.2 idna-3.4 intel-openmp-2021.4.0 jinja2-3.1.2 joblib-1.2.0 jsonschema-4.17.3 jsonschema-specifications-2023.12.1 llama-index-0.10.43 llama-index-agent-openai-0.2.7 llama-index-cli-0.1.12 llama-index-core-0.10.43 llama-index-embeddings-huggingface-0.2.1 llama-index-embeddings-openai-0.1.10 llama-index-indices-managed-llama-cloud-0.1.6 llama-index-legacy-0.9.48 llama-index-llms-openai-0.1.22 llama-index-multi-modal-llms-openai-0.1.6 llama-index-program-openai-0.1.6 llama-index-question-gen-openai-0.1.3 llama-index-readers-file-0.1.23 llama-index-readers-llama-parse-0.1.4 llama-index-vector-stores-faiss-0.1.2 llama-parse-0.4.4 llamaindex-py-client-0.1.19 markdown-it-py-2.2.0 marshmallow-3.21.2 mdurl-0.1.0 minijinja-2.0.1 mkl-2021.4.0 mpmath-1.3.0 multidict-6.0.2 mypy-extensions-0.4.3 nest-asyncio-1.5.6 networkx-3.1 nltk-3.8.1 numpy-1.24.3 openai-1.31.0 packaging-23.0 pandas-1.5.3 pillow-10.3.0 protobuf-4.25.3 pyarrow-11.0.0 pydantic-2.5.3 pydantic-core-2.14.6 pydeck-0.9.1 pygments-2.15.1 pypdf-4.2.0 python-dateutil-2.8.2 pytz-2022.7 referencing-0.35.1 regex-2022.7.9 requests-2.31.0 rich-13.7.1 rpds-py-0.18.1 safetensors-0.4.3 scikit-learn-1.3.0 scipy-1.10.1 sentence-transformers-2.7.0 six-1.16.0 smmap-5.0.1 sniffio-1.2.0 soupsieve-2.4 streamlit-1.35.0 striprtf-0.0.26 sympy-1.11.1 tbb-0.2 tenacity-8.2.2 threadpoolctl-2.2.0 tiktoken-0.7.0 tokenizers-0.19.1 toml-0.10.2 toolz-0.12.0 torch-2.3.0 tornado-6.3.2 tqdm-4.65.0 transformers-2.1.1 typing-extensions-4.12.1 typing-inspect-0.9.0 tzdata-2024.1 urllib3-1.26.16 watchdog-2.1.6 wrapt-1.14.1 yarl-1.8.1 WARNING: There was an error checking the latest version of pip.