story

Arch Linux: Git migration completed (opens in new tab)

archlinux.org

129 pointstimnf2y ago20 comments

20 comments

likeclockwork2y ago

Context: https://wiki.archlinux.org/title/DeveloperWiki:GitMigration

Foxboron2y ago

Well, that is a bit outdated.

I think my draft is more detailed: https://wiki.archlinux.org/title/User:Foxboron/GitMigration

Runbook for the migration can be found here: https://md.archlinux.org/utjjQ-bQTsipIKntPrpf8g?both

zeusk2y ago

Is there a reason why you have a mix of github and gitlab?

Foxboron2y ago

Historical mostly.

Github usage predates the Gitlab instance and some projects haven't been migrated. We also keep some repositories on Github as a secondary mirror.

We've also had some performance issues on Gitlab for `svntogit` repository because of weird branch structures. However this repo is not deprecated so it doesn't matter anymore.

5e92cb50239222b2y ago

Seems like you're using btrfs for repos.archlinux.org. Any problems with reliability and/or performance? Very rarely does someone share their experience if everything is working fine, regardless of a technology in question.

Foxboron2y ago

I don't do any of the actual server infra so I don't have all the details.

The btrfs raid setup is standardized across all our infra and can be found on ansible.

https://gitlab.archlinux.org/archlinux/infrastructure/-/blob...

From what I can tell it's been working fine and behaves nicely with failing disks.

xeromal2y ago

Thanks!

pm22222y ago

I check several mirrors which are said to be in sync but got this. This cannot be right:

  pacman-6.0.2-6-x86_64.pkg.tar.zst        18-Mar-2023 15:24   944412
  pacman-6.0.2-6-x86_64.pkg.tar.zst.sig    18-Mar-2023 15:24   119
  pacman-6.0.2-7-x86_64.pkg.tar.zst        20-May-2023 14:17   56
  pacman-6.0.2-7-x86_64.pkg.tar.zst.sig    20-May-2023 14:17   60

bdhcuidbebe2y ago

mirrors are all still unsynced since may 19, so announcement was premature

qD29Lno-oKXPLEv2y ago

Most mirrors (at least within the US) are now up-to-date. I finished installing pacman 6.0.2-7 a few minutes ago.

conaclos2y ago

Which mirror do you use?

I got some issues with all my mirrors: the size of the last pacman package is very (too) small (60 vs 944412 for previous version). e.g. https://archlinux.uk.mirror.allworldit.com/archlinux/core/os...

qD29Lno-oKXPLEv2y ago

Most of the US ones now are synced. I haven't tried out other countries. Initially, there were ~130 that I tried and got a 404 on all of them for the latest pacman. When I tried again a about half an hour ago, only ~50 of the US mirrors returned a 404

I would try and generate a new mirrorlist for your locale: https://archlinux.org/mirrorlist/

sva_2y ago

I'm a bit confused by how pacman works.

I picked a mirror that definitely has the 6.0.2-7 version on it[0], yet Pacman can't find it.

Does the server's core.db have to update before the new version is available? Because that one is dated 18-May-2023 05:21.

0. https://archlinux.cu.be/core/os/x86_64/

5e92cb50239222b2y ago

Probably PEBCAK, but even the best mirrors according to

https://archlinux.org/mirrors/status

still seem unsynced on my arch systems.

Foxboron2y ago

The 1 Gbit/s uplink for the Tier 0 mirror has been fully saturated for almost 4-5 hours now and I expect servers to be syncing for rest of the day really.

dicytea2y ago

Weird, I ran reflector which should update my mirrorlist with the 5 most recently synchronized mirrors, but I'm still not getting them.

qD29Lno-oKXPLEv2y ago

I would just go to https://archlinux.org/mirrorlist and generate your mirrorlist there. I've heard from others that reflector isn't detected newly synced mirrors at the moment.

unixhero2y ago

This is going to be huge

lytedev2y ago

Why is that?

unixhero2y ago

Better quality of life for the rest of the world looking into Arch Linux packages. The aggregate of this, will most probably be more involvement from more people as it brings the development to life on the Gitlab Web interface.

j / k navigate · click thread line to collapse

20 comments

likeclockwork2y ago

Context: https://wiki.archlinux.org/title/DeveloperWiki:GitMigration

Foxboron2y ago

Well, that is a bit outdated.

I think my draft is more detailed: https://wiki.archlinux.org/title/User:Foxboron/GitMigration

Runbook for the migration can be found here: https://md.archlinux.org/utjjQ-bQTsipIKntPrpf8g?both

zeusk2y ago

Is there a reason why you have a mix of github and gitlab?

Foxboron2y ago

Historical mostly.

Github usage predates the Gitlab instance and some projects haven't been migrated. We also keep some repositories on Github as a secondary mirror.

We've also had some performance issues on Gitlab for `svntogit` repository because of weird branch structures. However this repo is not deprecated so it doesn't matter anymore.

5e92cb50239222b2y ago

Foxboron2y ago

I don't do any of the actual server infra so I don't have all the details.

The btrfs raid setup is standardized across all our infra and can be found on ansible.

https://gitlab.archlinux.org/archlinux/infrastructure/-/blob...

From what I can tell it's been working fine and behaves nicely with failing disks.

xeromal2y ago

Thanks!

pm22222y ago

I check several mirrors which are said to be in sync but got this. This cannot be right:

  pacman-6.0.2-6-x86_64.pkg.tar.zst        18-Mar-2023 15:24   944412
  pacman-6.0.2-6-x86_64.pkg.tar.zst.sig    18-Mar-2023 15:24   119
  pacman-6.0.2-7-x86_64.pkg.tar.zst        20-May-2023 14:17   56
  pacman-6.0.2-7-x86_64.pkg.tar.zst.sig    20-May-2023 14:17   60

bdhcuidbebe2y ago

mirrors are all still unsynced since may 19, so announcement was premature

qD29Lno-oKXPLEv2y ago

Most mirrors (at least within the US) are now up-to-date. I finished installing pacman 6.0.2-7 a few minutes ago.

conaclos2y ago

Which mirror do you use?

qD29Lno-oKXPLEv2y ago

I would try and generate a new mirrorlist for your locale: https://archlinux.org/mirrorlist/

sva_2y ago

I'm a bit confused by how pacman works.

I picked a mirror that definitely has the 6.0.2-7 version on it[0], yet Pacman can't find it.

Does the server's core.db have to update before the new version is available? Because that one is dated 18-May-2023 05:21.

0. https://archlinux.cu.be/core/os/x86_64/

5e92cb50239222b2y ago

Probably PEBCAK, but even the best mirrors according to

https://archlinux.org/mirrors/status

still seem unsynced on my arch systems.

Foxboron2y ago

The 1 Gbit/s uplink for the Tier 0 mirror has been fully saturated for almost 4-5 hours now and I expect servers to be syncing for rest of the day really.

dicytea2y ago

Weird, I ran reflector which should update my mirrorlist with the 5 most recently synchronized mirrors, but I'm still not getting them.

qD29Lno-oKXPLEv2y ago

I would just go to https://archlinux.org/mirrorlist and generate your mirrorlist there. I've heard from others that reflector isn't detected newly synced mirrors at the moment.

unixhero2y ago

This is going to be huge

lytedev2y ago

Why is that?

unixhero2y ago

j / k navigate · click thread line to collapse