Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Cannot install 'smart-open' using Pipenv - incompatible dependencies #227

Closed
pranasziaukas opened this issue Sep 10, 2018 · 12 comments · Fixed by #232
Closed

Cannot install 'smart-open' using Pipenv - incompatible dependencies #227

pranasziaukas opened this issue Sep 10, 2018 · 12 comments · Fixed by #232

Comments

@pranasziaukas
Copy link

I am using Python 3.7 and Pipenv to manage the dependencies.

I am starting from scratch in a new folder with

pipenv install smart-open --three

This is supposed to create a new virtual environment using Python3, install smart-open and... that's it. However, it cannot lock the dependencies and returns

Warning: Your dependencies could not be resolved. You likely have a mismatch in your sub-dependencies.
  You can use $ pipenv install --skip-lock to bypass this mechanism, then run $ pipenv graph to inspect the situation.
  Hint: try $ pipenv lock --pre if it is a pre-release dependency.
Could not find a version that matches botocore<1.11.0,<1.13.0,<2.0.0,==1.10.84,>=1.10.65,>=1.12.0,>=1.3.0

Further inspection

pipenv graph

returns

smart-open==1.6.0
  - boto [required: >=2.32, installed: 2.49.0]
  - boto3 [required: Any, installed: 1.9.0]
    - botocore [required: >=1.12.0,<1.13.0, installed: 1.12.0]
      - docutils [required: >=0.10, installed: 0.14]
      - jmespath [required: >=0.7.1,<1.0.0, installed: 0.9.3]
      - python-dateutil [required: >=2.1,<3.0.0, installed: 2.7.3]
        - six [required: >=1.5, installed: 1.11.0]
      - urllib3 [required: >=1.20,<1.24, installed: 1.23]
    - jmespath [required: >=0.7.1,<1.0.0, installed: 0.9.3]
    - s3transfer [required: >=0.1.10,<0.2.0, installed: 0.1.13]
      - botocore [required: >=1.3.0,<2.0.0, installed: 1.12.0]
        - docutils [required: >=0.10, installed: 0.14]
        - jmespath [required: >=0.7.1,<1.0.0, installed: 0.9.3]
        - python-dateutil [required: >=2.1,<3.0.0, installed: 2.7.3]
          - six [required: >=1.5, installed: 1.11.0]
        - urllib3 [required: >=1.20,<1.24, installed: 1.23]
  - bz2file [required: Any, installed: 0.98]
  - requests [required: Any, installed: 2.19.1]
    - certifi [required: >=2017.4.17, installed: 2018.8.24]
    - chardet [required: >=3.0.2,<3.1.0, installed: 3.0.4]
    - idna [required: >=2.5,<2.8, installed: 2.7]
    - urllib3 [required: >=1.21.1,<1.24, installed: 1.23]
@pranasziaukas
Copy link
Author

Sorry, I'm moving this to the pipenv issue tracker.

@whyboris
Copy link

I too have the problem with pipenv installing the package. Is it not an issue with smart-open though? I am trying to install gensim and get this tree:

  - smart-open [required: >=1.2.1, installed: 1.7.0]
    - boto [required: >=2.32, installed: 2.49.0]
    - boto3 [required: <1.8.0, installed: 1.7.84]
      - botocore [required: >=1.10.84,<1.11.0, installed: 1.10.84]
        - docutils [required: >=0.10, installed: 0.14]
        - jmespath [required: >=0.7.1,<1.0.0, installed: 0.9.3]
        - python-dateutil [required: >=2.1,<3.0.0, installed: 2.7.3]
          - six [required: >=1.5, installed: 1.11.0]
      - jmespath [required: >=0.7.1,<1.0.0, installed: 0.9.3]
      - s3transfer [required: >=0.1.10,<0.2.0, installed: 0.1.13]
        - botocore [required: >=1.3.0,<2.0.0, installed: 1.10.84]
          - docutils [required: >=0.10, installed: 0.14]
          - jmespath [required: >=0.7.1,<1.0.0, installed: 0.9.3]
          - python-dateutil [required: >=2.1,<3.0.0, installed: 2.7.3]
            - six [required: >=1.5, installed: 1.11.0]
    - botocore [required: <1.11.0, installed: 1.10.84]
      - docutils [required: >=0.10, installed: 0.14]
      - jmespath [required: >=0.7.1,<1.0.0, installed: 0.9.3]
      - python-dateutil [required: >=2.1,<3.0.0, installed: 2.7.3]
        - six [required: >=1.5, installed: 1.11.0]
    - bz2file [required: Any, installed: 0.98]
    - requests [required: Any, installed: 2.19.1]
      - certifi [required: >=2017.4.17, installed: 2018.8.24]
      - chardet [required: >=3.0.2,<3.1.0, installed: 3.0.4]
      - idna [required: >=2.5,<2.8, installed: 2.7]
      - urllib3 [required: >=1.21.1,<1.24, installed: 1.23]

Specifically, notice that we have incompatible versions required:

- botocore [required: >=1.10.84,<1.11.0,  installed: 1.10.84]
- botocore [required: >=1.3.0,<2.0.0,     installed: 1.10.84]
- botocore [required: <1.11.0,            installed: 1.10.84]

I'm looking on pipenv issue tracker as well, but why are the required fields different? I imagine that comes from the package, not the pipenv installer 😕

@whyboris whyboris mentioned this issue Sep 19, 2018
Closed
@whyboris
Copy link

Related ticket for tracking on pipenv side: pypa/pipenv#2867

@whyboris
Copy link

We're in trouble ... @menshikh-iv ?

It looks like pipenv is doing its best, but the versions are simply incompatible -- two dependencies want two different versions of sub-dependencies:

smart_open wants

        'boto3 < 1.8.0',
        'botocore < 1.11.0'

https://github.com/RaRe-Technologies/smart_open/blob/master/setup.py#L54

While boto3 wants

    'botocore>=1.12.6,<1.13.0',

https://github.com/boto/boto3/blob/develop/setup.py#L17

@menshikh-iv
Copy link
Contributor

@whyboris yes, you are right, looks critical

I can drop limitations, but in this case, we can't use tests, hmm
we'll try to fix it ASAP, thanks.

CC: @mpenkov

@menshikh-iv menshikh-iv reopened this Sep 19, 2018
This was referenced Sep 19, 2018
Merged
Merged
@menshikh-iv
Copy link
Contributor

menshikh-iv commented Sep 19, 2018 •
edited
Loading

Fixed in #232, let me release this bugfix as 1.7.1

@menshikh-iv
Copy link
Contributor

Version 1.7.1 (with unpinned boto3 & botocore) released @whyboris @petergaultney

@petergaultney
Copy link

Thank you for this!!

For anyone else watching this issue, I had to run curl -X PURGE https://pypi.org/simple/smart_open to get pip to actually find the new 1.7.1 version on PyPi. YMMV :)

@whyboris
Copy link

Confirming the problem is solved. I no longer get the error I got before I opened this issue. 🎉

Thank you for the swift work 🙌

@piskvorky
Copy link
Owner

piskvorky commented Sep 20, 2018 •
edited
Loading

Ivan is an unstoppable release tornado this week 🌪 Thanks @menshikh-iv!

@shubhangi-bajpai
Copy link

hello everyone. I tried to import gensim in python and am faced with the following error.. please help me. It's urgent as I am working on my internship project.

AttributeError: module 'smart_open' has no attribute 'local_file'

Thanks in advance

@mpenkov
Copy link
Collaborator

mpenkov commented Apr 20, 2020

@shubhangi-bajpai Please make a new ticket and fill in the template, including the version you're using, etc.

Repository owner locked as resolved and limited conversation to collaborators Apr 20, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Unpin boto/botocore for regular installation piskvorky/smart_open
7 participants
@petergaultney @piskvorky @mpenkov @menshikh-iv @whyboris @pranasziaukas @shubhangi-bajpai