Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade nixpkgs #8190

Merged
merged 8 commits into from
Feb 8, 2021
Merged

Upgrade nixpkgs #8190

merged 8 commits into from
Feb 8, 2021

Conversation

cocreature
Copy link
Contributor

changelog_begin
changelog_end

Pull Request Checklist

  • Read and understand the contribution guidelines
  • Include appropriate tests
  • Set a descriptive title and thorough description
  • Add a reference to the issue this PR will solve, if appropriate
  • Include changelog additions in one or more commit message bodies between the CHANGELOG_BEGIN and CHANGELOG_END tags
  • Normal production system change, include purpose of change in description

NOTE: CI is not automatically run on non-members pull-requests for security
reasons. The reviewer will have to comment with /AzurePipelines run to
trigger the build.

@cocreature cocreature force-pushed the upgrade-nixpkgs branch 2 times, most recently from 58f3cab to ed89b91 Compare December 8, 2020 14:10
@garyverhaegen-da garyverhaegen-da changed the base branch from master to main December 27, 2020 12:16
@garyverhaegen-da
Copy link
Contributor

/azp run

@azure-pipelines
Copy link
Contributor

Azure Pipelines successfully started running 1 pipeline(s).

@garyverhaegen-da
Copy link
Contributor

/azp run

@azure-pipelines
Copy link
Contributor

Azure Pipelines successfully started running 1 pipeline(s).

@cocreature
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link
Contributor

Pull request contains merge conflicts.

@cocreature cocreature force-pushed the upgrade-nixpkgs branch 4 times, most recently from bfb008f to a542051 Compare February 4, 2021 21:43
@cocreature
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link
Contributor

Azure Pipelines successfully started running 1 pipeline(s).

changelog_begin
changelog_end
.
changelog_begin
changelog_end
.
changelog_begin
changelog_end
changelog_begin
changelog_end
.
changelog_begin
changelog_end
changelog_begin
changelog_end
@@ -1,9 +1,28 @@
From 167bee5cd95f679dc4c4e1ff732a4e251ef12633 Mon Sep 17 00:00:00 2001
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I’ve removed our own debugging printf. The issue hasn’t reappeared so seems a bit pointless to keep it here.

@@ -62,12 +62,6 @@ common_nix_file_deps = [
"@daml//nix:nixpkgs/default.src.json",
]

nix_ghc_deps = common_nix_file_deps + [
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we now use upstream GHC. The only patch we still had was the dwarf stuff and that hasn’t been used for months so I don’t think it’s worth keeping the custom GHC around.

@@ -150,8 +150,7 @@ update_s3 opts temp vs = do
-- Not going through Aeson because it represents JSON objects as
-- unordered maps, and here order matters.
versions_json vs = vs
& map show
& map (\s -> "\"" <> s <> "\": \"" <> s <> "\"")
& map ((\s -> "\"" <> s <> "\": \"" <> s <> "\"") . show)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

all the haskell changes are forced by the hlint upgrade.

@@ -1,6 +1,6 @@
# This file originates from node2nix

{stdenv, nodejs, python2, utillinux, libtool, runCommand, writeTextFile}:
{lib, stdenv, nodejs, python2, utillinux, libtool, runCommand, writeTextFile}:
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pgs.stdenv.lib is deprecated in favor of pkgs.lib.

"branch": "nixpkgs-unstable",
"rev": "1d8018068278a717771e9ec4054dff1ebd3252b0",
"sha256": "1vi3wbvlvpd4200swd3594vps1fsnd7775mgzm3nnfs1imzkg00i"
"repo": "nixpkgs",
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nixpkgs-channels is dead.

@@ -29,7 +29,20 @@ let shared = rec {
zip
;

scala = pkgs.scala_2_12;
scala = (pkgs.scala_2_12.override { }).overrideAttrs (attrs: {
# Something appears to be broken in nixpkgs' fixpoint which results in the
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If someone has any idea for fixing that I’m all ears. I tried to overwrite nixosTests.scala.scala_2_12 as well but I couldn’t get it to work 🤷

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there an issue on nixpkgs about it?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

not yet, I was planning to look into it a bit more but haven’t found the time.

# Note: we need to pin Terraform to 0.11 until nixpkgs includes a version
# of the secret provider that is compatiblz with Terraform 0.12 (1.1.0+)
terraform = pkgs.terraform_0_11.withPlugins (p: with p; [
terraform = pkgs.terraform_0_12.withPlugins (p: with p; [
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@garyverhaegen-da how do I test that the security plugin works with terraform 0.12? Nix killed terraform 0.11 completely so I would hope that it works but 🤷

ci/build.yml Outdated Show resolved Hide resolved
@cocreature
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link
Contributor

Azure Pipelines successfully started running 1 pipeline(s).

Copy link
Contributor

@aherrmann-da aherrmann-da left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you! LGTM

Comment on lines -36 to -37
# Required for node_modules trees generated by yarn_install.
common --experimental_allow_incremental_repository_updates
Copy link
Contributor

@aherrmann-da aherrmann-da Feb 8, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Flag was removed in 3.5.0. (To answer to myself why this was removed)

@@ -29,7 +29,20 @@ let shared = rec {
zip
;

scala = pkgs.scala_2_12;
scala = (pkgs.scala_2_12.override { }).overrideAttrs (attrs: {
# Something appears to be broken in nixpkgs' fixpoint which results in the
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there an issue on nixpkgs about it?

packages = pkgs.haskell.packages // {
integer-simple = pkgs.haskell.packages.integer-simple // {
ghc8103 = pkgs.haskell.packages.integer-simple.ghc8103.override {
ghc = pkgs.haskell.compiler.integer-simple.ghc8103.overrideAttrs (old: {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why is this needed?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Otherwise GHC fails to find otool. Added a comment (I already had, just forgot to push it 🤦)

.
changelog_begin
changelog_end
@mergify mergify bot merged commit 773ddad into main Feb 8, 2021
@mergify mergify bot deleted the upgrade-nixpkgs branch February 8, 2021 11:12
garyverhaegen-da added a commit that referenced this pull request Feb 8, 2021
Two changes have happened recently that have invalidated the current
Terraform files:

1. The Terraform version has gone through a major, incompatible upgrade
   (#8190); the required updates for this are reflected in the first
   commit of this PR.
2. The certificate used to serve [Hoogle](https://hoogle.daml.com) was
   about to expire, so Edward created a new one and updated the config
   directly. The second commit in this PR updates the Terraform config
   to match that new, already-in-prod setting.

Note: This PR applies cleanly, as there are no resulting changes in
Terraform's perception of the target state from 1, and the change from 2
has already been applied through other channels.

CHANGELOG_BEGIN
CHANGELOG_END
mergify bot pushed a commit that referenced this pull request Feb 8, 2021
* fixup terraform config

Two changes have happened recently that have invalidated the current
Terraform files:

1. The Terraform version has gone through a major, incompatible upgrade
   (#8190); the required updates for this are reflected in the first
   commit of this PR.
2. The certificate used to serve [Hoogle](https://hoogle.daml.com) was
   about to expire, so Edward created a new one and updated the config
   directly. The second commit in this PR updates the Terraform config
   to match that new, already-in-prod setting.

Note: This PR applies cleanly, as there are no resulting changes in
Terraform's perception of the target state from 1, and the change from 2
has already been applied through other channels.

CHANGELOG_BEGIN
CHANGELOG_END

* update hoogle cert
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants