Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add to onboarding reproduction logs #1726

Merged
merged 5 commits into from
Nov 28, 2023

Conversation

AndreSlavescu
Copy link
Contributor

@AndreSlavescu AndreSlavescu commented Nov 28, 2023

Environment

Ran in conda environment

System

Operating System

  • Ubuntu 22.04

Development Environment

  • Python 3.10.12 (conda)
  • CUDA 12.0

Hardware

  • Processor: Ryzen 9 5950x
  • Motherboard: Aorus x570s Master
  • RAM: 128GB 3600mhz CL 16
  • Storage: 4TB NVME 7000mhz read/write
  • GPU: 3080ti 12GB VRAM

Result

Ran all tests successfully after downgrading to python 3.10.12 and running in a conda env + faiss installation for conda target.

Additional Notes

I tried building for mac with M2 pro 12 core spec, but ultimately failed due to issue with nmslib. I will try to make a fix in the future, but for the time being, as far as I know, the package will not build for m series mac devices without any downgrading to older package versions.

build instruction that will work for Macbook Pro M1 2020 is:
CFLAGS="-mavx -DWARN(a)=(a)" pip install nmslib

I do not recommend building with this however, because this disables some acceleration profiles.

Refer to this issue for more information:
nmslib/nmslib#476

@lintool
Copy link
Member

lintool commented Nov 28, 2023

@AndreSlavescu have you tried the instructions here? https://github.com/castorini/pyserini/blob/master/docs/installation.md#pypi-installation-walkthrough

If you're on a Mac with an M-series (i.e., ARM) processor, the following recipe should work:

conda install wget -y
conda install -c conda-forge openjdk=11 maven -y
conda install -c conda-forge lightgbm nmslib -y

# from https://github.com/facebookresearch/faiss/blob/main/INSTALL.md
conda install -c pytorch faiss-cpu=1.7.4 blas=1.0 -y
conda install -c pytorch faiss-cpu pytorch -y

pip install pyserini

@lintool lintool merged commit e6700f6 into castorini:master Nov 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants