I was able to resolve this by installing the dependencies manually using the pip inside the conda env.

pip install torch==2.0.1 torchvision==0.15.2 torchaudio==2.0.2 --index-url https://download.pytorch.org/whl/cu118

When following the setup instructions in the readme I get the following error message

Could not solve for environment specs
The following packages are incompatible
├─ pin-1 is installable and it requires
│  └─ python 3.12.* , which can be installed;
└─ torchvision 0.15.0  is not installable because there are no viable options
   ├─ torchvision 0.15.0 would require
   │  └─ python >=3.10,<3.11.0a0 , which conflicts with any installable versions previously reported;
   ├─ torchvision 0.15.0 would require
   │  └─ python >=3.8,<3.9.0a0 , which conflicts with any installable versions previously reported;
   └─ torchvision 0.15.0 would require
      └─ python >=3.9,<3.10.0a0 , which conflicts with any installable versions previously reported.

A way to get around this would be appreciated

The python version you are using is 3.12, this causes torchvision 0.15.0 to conflict. so because you are using python 3.12 you can install pytorch >= 2.3.1, you can check it on the following pytroch website: https://pytorch.org/get-started/previous-versions/