1. 30 Apr, 2024 8 commits
    • Xavier Thompson's avatar
      [opti] Unannotate sections in-place · 30e29733
      Xavier Thompson authored
      This avoids unecessary copies. This is a preparatory step to
      reimplementing the extends algorithm. It may be that this breaks
      the extends algorithm as it is currently implemented.
      30e29733
    • Xavier Thompson's avatar
      [opti] Update sections in-place · 50c49e39
      Xavier Thompson authored
      This avoids unecessary deepcopies. This is a preparatory step to
      reimplementing the extends algorithm. It may be that this breaks
      the extends algorithm as it is currently implemented.
      50c49e39
    • Xavier Thompson's avatar
      [opti] Remove redundant deepcopies · 404d9d4f
      Xavier Thompson authored
      404d9d4f
    • Julien Muchembled's avatar
      [feat] Omit Python library in script paths · bbe81a7c
      Julien Muchembled authored
      This is useful when using OS Python & eggs.
      
      Useless for SlapOS.
      bbe81a7c
    • Xavier Thompson's avatar
      cf2d0ed0
    • Xavier Thompson's avatar
      [doc] Show getting-started with modern python venv · 822116e6
      Xavier Thompson authored
      Also show `pip install <url-for-tar.gz-of-master-branch-on-gitlab>`.
      822116e6
    • Xavier Thompson's avatar
      [feat] Add 'zc.buildout' mode to 'extra-paths' · 3e87a0e2
      Xavier Thompson authored
      This mode is similar to 'legacy' mode as it uses only the paths of
      the currently running distributions for zc.buildout and dependencies,
      but unlike 'legacy' mode it respects the order in which these appear
      in sys.path, avoiding unexpected results.
      
      This is now set to the default because it is closer to 'legacy' mode
      and because it has a nice property: running in succession
      
        `buildout buildout:extra-paths= bootstrap` (1)
        `bin/buildout` (2)
      
      will result in the (1) installing zc.buildout and its dependencies
      in /eggs in isolation from the environment, and (2) using only the
      paths of these in /eggs, i.e. continuing to operate in isolation,
      even without setting extra-paths explictly.
      
      Before this change, (2) would have still used  the whole `sys.path`
      unless extra-paths was set otherwise.
      
      With this change, we can remove 'extra-paths=legacy' in the tests
      that previously required it.
      3e87a0e2
    • Xavier Thompson's avatar
      [fix] Adapt tests to extra-paths changes · 5e6bd1e5
      Xavier Thompson authored
      Now that extra-paths is sys.path by default instead of the legacy
      value of the specific paths of zc.buildout and its dependencies,
      some tests fail because some eggs in sys.path that were previously
      not in extra-paths were instead found on sys.path by package index's
      search_path and subsequently installed in ./eggs, whereas they are
      now directly seen as already installed at their original location.
      5e6bd1e5
  2. 29 Apr, 2024 4 commits
    • Xavier Thompson's avatar
      [feat] Add buildout:extra-paths option · 336be55f
      Xavier Thompson authored
      This option determines what paths zc.buildout will scan for already
      installed distributions. This defaults to sys.path and can be set to
      an empty value to enable isolation. The special value 'legacy' yields
      the previous behavior of scanning specifically the paths of the current
      zc.buildout distribution and its dependencies.
      336be55f
    • Xavier Thompson's avatar
      [fix] Fix bootstrap working set order · 2f6e6f29
      Xavier Thompson authored
      In bootstrap we potentially copy eggs from the working set to ./eggs.
      We then reconstruct the same working set using the moved locations.
      
      This commits ensures we keep a correct working set order throughout
      and that we avoid activating unintended dists.
      2f6e6f29
    • Xavier Thompson's avatar
      [fix] Fix working set sorting · 65b4b94c
      Xavier Thompson authored
      If a dist in the computed working set is at a location shared with
      other dists - such as site-packages - then when generating scripts
      these other packages may overshadow the next items on the sys.path
      and result in importing a different version than the one installed
      and intended by buildout.
      
      To avert this, a sort of the working set was introduced at various
      points just before generating a script.
      
      However, that sort put the paths referenced from an `.egg-link` in
      ./develop-eggs first. This is truly problematic because dists from
      site-packages which are not eggs - e.g. dists installed with pip -
      can become referenced as `.egg-link` during buildout bootstrap and
      the sort then causes site-packages to be one of the first items in
      sys.path.
      
      In particular when running buildout bootstrap from a venv in which
      zc.buildout was installed by pip, if any one of zc.buildout or its
      dependencies from the venv meets the version requirements, then it
      can cause the generated bin/buildout to import the dists only from
      the venv's site-packages, even when some do not meet requirements.
      
      To fix this, the sort now puts the dists from `./eggs` first as we
      know their locations contain only a single dist, and then puts the
      dists from ./develop-eggs which have locations inside the buildout
      directory before the others.
      
      The previous sort was also activating all the dists from the paths
      of the already activated dists.
      
      Note that this also means that any working set must be manipulated
      with care in general to avoid activating unintended dists from the
      locations of the already activated dists.
      65b4b94c
    • Xavier Thompson's avatar
      [fix] Use only ws.find in install · 8a649631
      Xavier Thompson authored
      Replace `pkg_resources.Environment(ws.entries).best_match(req, ws)`
      with `ws.find(req)`.
      
      The first already starts by calling `ws.find(req)` to attempt to find
      an already activated dist in the working set, but if none is found it
      then proceeds to scan through the entries of the environment - i.e.
      the locations of the directly-requested distributions, `ws.entries` -
      to activate a dist at these locations if one matches.
      
      This is problematic when directly-requested distributions are found in
      a location shared by multiple dists, such as site-packages: this gives
      that location precedence over the normal order of locations scanned by
      easy_install, and can result in undesired versions being chosen over
      versions available in ./eggs or in ./develop-eggs. The random aspect
      of this is also problematic, as the order of paths considered will
      depend on the order of the directly-requested distributions and where
      they are found.
      8a649631
  3. 13 Mar, 2024 2 commits
    • Xavier Thompson's avatar
      [feat] Respect pinned versions in bootstrap · 0dcfd8c2
      Xavier Thompson authored
      If zc.buildout or its dependencies have pinned versions that do not
      match the currently running versions, they are now installed in the
      local eggs directory from scratch according to the pinned versions.
      
      In offline mode this merely ensures that versions that satisfy the
      requirements are already available. This is the case when the eggs
      are already installed, or when the running versions are a match to
      the pinned versions or the absence of a pinned version.
      
      If after this matching versions of zc.buildout and its dependencies
      are not located in the local eggs or develop-eggs directories, they
      are copied there as was already the case before.
      0dcfd8c2
    • Xavier Thompson's avatar
      [bug] Fix accidental changes to PYTHONPATH in os.environ · e521348b
      Xavier Thompson authored
      When generating an environment dict for subprocess calls to pip,
      os.environ was accidentally modified despite efforts to copy it
      and modify only the copy, as copy.copy(os.environ) is not enough.
      e521348b
  4. 08 Nov, 2022 2 commits
  5. 06 Nov, 2022 24 commits