Hardy heron upgrade

Hardy Heron upgrade status, as it happens

April 24, Hardy Heron is released. All times in Pacific daylight time.

11:00am Ran update-manger -d

11:05am Accepted license, downloading the upgrade tool (1 mirror failure so far)

11:35am Third-party sources disabled for the upgrade.

11:38am Eeek, some applications are no longer supported by Canonical, 
        including courier-imap, xmms, xvnc.  If I want to continue using those packages, 
        I need to enable community support.  Here is the full list it came up with for
        my machine:

binfmt-support
console-common
console-data
courier-authdaemon
courier-base
courier-imap
courier-imap-ssl
courier-ssl
doc-debian
evms
evms-ncurses
gcj-4.1-base
gij-4.1
gnome-cups-manager
gtkhtml3.8
irssi-text
libasn1-6-heimdal
libcompfaceg1
libconvert-binhex-perl
libdvdnav4
libdvdread3
libevms-2.5
libfinance-quote-perl
libgcj7-jar
libgda2-3
libgda2-common
libglib1.2
libgnomecupsui1.0-1c2a
libgnucrypto-java
libgssapi4-heimdal
libgtk1.2
libgtk1.2-common
libhtml-tableextract-perl
libjaxp1.2-java
libkrb5-17-heimdal
liblzo1
libmailtools-perl
libmime-perl
libnet-dns-perl
libnet-ip-perl
libnetcdf3
libpq4
libroken16-heimdal
libxml1
menu-xdg
pmount
python-eunuchs
python-gadfly
python-htmltmpl
python-kjbuckets
python-netcdf
python-pgsql
python-soappy
python-sqlite
python-stats
python-syck
reportbug
ttf-baekmuk
vnc-common
xmms
xvncviewer

11:40am Do you want to start the upgrade?  It will take 2 hours and 27 minutes from 
        this point and once the download is complete, you cannot cancel.

12:36pm Still downloading packages.  It estimates completion in 19 hours.

 2:29pm Downloading 616 of 1575 packages.  It appears to be stalled.  It has 
        no prediction for completion.

 2:33pm Estimated completion in 6 hours.  It looks like other people are still
        using courier-imap with Hardy Heron.  I just have to make sure I don't
        let the installer remove those packages.  Then I can figure out what a 
        supported replacement is on my own time.

 3:09pm Downloading 717 of 1575.  Estimated completion in 5 hours.

 4:13pm Downloading 900 of 1575.  Estimated completion in 4 hours.
 
 8:25pm Downloads complete.  Installing and configuring.

 8:28pm The upgrade will continue but the
        '/var/cache/apt/archives/dpkg_1.14.16.6ubuntu3_amd64.deb' package may be in
        a not working state. Please consider submitting a bugreport about it.

 8:30pm A fatal error occured

        Please report this as a bug (if you haven't already) and include thefiles
        /var/log/dist-upgrade/main.log and /var/log/dist-upgrade/apt.log in your
        report. The upgrade aborts now.
        Your original sources.list was saved in /etc/apt/sources.list.distUpgrade.

Huh? Now what? My machine is still running. I guess not much, if anything has actually been installed. I guess I try again later.

/var/log/dist-upgrade/main.log

The full log is gigantic. Here are just the ERROR lines:

2008-04-24 11:21:18,215 ERROR IOError/SystemError in cache.update(): 'Failed to fetch http://ubuntu.compiz.net/dists/dapper/main/binary-amd64/Packages.gz 302 Found
2008-04-24 11:21:18,215 ERROR doUpdate() failed completely
2008-04-24 20:27:06,756 ERROR got an error from dpkg for pkg: '/var/cache/apt/archives/dpkg_1.14.16.6ubuntu3_amd64.deb': 'installing dpkg would break apt, and
2008-04-24 20:27:06,758 ERROR got an error from dpkg for pkg: '/var/cache/apt/archives/dpkg_1.14.16.6ubuntu3_amd64.deb': 'installing dpkg would break apt, and
2008-04-24 20:29:30,622 ERROR not handled expection:
2008-04-24 20:29:30,623 ERROR failed to import apport python module, can't report bug: No module named apport.python_hook

---

Second try

On April 25, I tried again by downloading the alternate cdrom for amd64 Hardy Heron

7:57pm Inserted the cd and tried to launch cdromupgrade, but got this error:

root@weasel:/media/cdrom0# sh ./cdromupgrade
tar: ./dists/stable/main/dist-upgrader/binary-all//hardy.tar.gz: Cannot open: No such file or directory
tar: Error is not recoverable: exiting now
tar: Child returned status 2
tar: Error exit delayed from previous errors
Could not find the upgrade application in the archive, exiting

The error appears to be a lie. The file hardy.tar.gz does exist where it should on the CD:

root@weasel:/media/cdrom0/dists/stable/main/dist-upgrader/binary-all# ls -l
total 672
-r--r--r-- 1 root root 687228 Apr 22 00:30 hardy.tar.gz
-r--r--r-- 1 root root    191 Apr 22 01:12 hardy.tar.gz.gpg

Third try

root@weasel:~# apt-get -f install
Reading package lists... Done
Building dependency tree... Done
Correcting dependencies... Done
The following extra packages will be installed:
  binutils cpp cpp-4.2 g++ g++-4.2 gcc gcc-4.2 libapr1 libaprutil1
  libarchive-dev libarchive1 libc6-dev libc6-i386 libdb4.6 libflac8
  libgnutls13 libgomp1 libkeyutils1 libkrb53 libldap-2.4-2 liblzo2-2
  libmysqlclient15off libopencdk10 libpq5 libsasl2 libsasl2-2 libsasl2-modules
  libsqlite3-0 libssl-dev libssl0.9.8 libstdc++6-4.2-dev libtasn1-3
  libvorbis-dev libvorbis0a libvorbisenc2 libvorbisfile3 linux-libc-dev
  mod-musicindex-common mysql-common postfix postfix-mysql zlib1g zlib1g-dev
Suggested packages:
  binutils-doc cpp-doc gcc-4.2-locales g++-multilib g++-4.2-multilib
  gcc-4.2-doc libstdc++6-4.2-dbg automake1.9 bison flex gcc-doc gcc-multilib
  manpages-dev gcc-4.2-multilib libgcc1-dbg libgomp1-dbg libmudflap0-4.2-dbg
  libmudflap0-4.2-dev glibc-doc gnutls-bin krb5-doc krb5-user
  libsasl2-modules-gssapi-mit libsasl2-modules-gssapi-heimdal
  libsasl2-modules-ldap libsasl2-modules-otp libsasl2-modules-sql
  libstdc++6-4.2-doc postfix-cdb postfix-ldap postfix-pcre postfix-pgsql
  resolvconf
The following packages will be REMOVED:
  apache2 g++-4.0 gcc-4.0 ia32-libs ia32-libs-gtk ia32-libs-openoffice.org
  libapache2-mod-musicindex libstdc++6-4.0-dev linux-kernel-headers
The following NEW packages will be installed:
  cpp-4.2 g++-4.2 gcc-4.2 libapr1 libaprutil1 libdb4.6 libflac8 libgnutls13
  libgomp1 libkeyutils1 libldap-2.4-2 liblzo2-2 libopencdk10 libpq5 libsasl2-2
  libstdc++6-4.2-dev libtasn1-3 linux-libc-dev
The following packages will be upgraded:
  binutils cpp g++ gcc libarchive-dev libarchive1 libc6-dev libc6-i386
  libkrb53 libmysqlclient15off libsasl2 libsasl2-modules libsqlite3-0
  libssl-dev libssl0.9.8 libvorbis-dev libvorbis0a libvorbisenc2
  libvorbisfile3 mod-musicindex-common mysql-common postfix postfix-mysql
  zlib1g zlib1g-dev
25 upgraded, 18 newly installed, 9 to remove and 1062 not upgraded.
4 not fully installed or removed.
Need to get 0B/26.4MB of archives.
After unpacking 46.7MB disk space will be freed.

12:51am Ran update-manager -d and got 545 packages to update.  Had an error with xfonts-scalable.
        Restarted apache after removing the musicindex module.

12:54am update-manger -d now fails with pango warnings about ugly output.  Fonts are screwed up.

12:57am "apt-get -f install" now gives me more info about the font error:

Setting up xfonts-scalable (1:1.0.0-6) ...
usage error: unrecognized option
Usage: update-fonts-dir DIRECTORY ...
       update-fonts-dir { -h | --help }
This program is a wrapper for mkfontdir(1x) that is primarily useful to Debian
package maintainer scripts.  See update-fonts-dir(8) for more information.
Options:
    -h, --help                               display this usage message and exitdpkg: error processing xfonts-scalable (--configure):
 subprocess post-installation script returned error exit status 2
Errors were encountered while processing:
 xfonts-scalable
E: Sub-process /usr/bin/dpkg returned an error code (1)

dpkg -l xfonts-scalable initially reported that it was installed but failed config. Since then, I've tried to remove it, update it, reinstall it, but all fail. Now it looks like this:

root@weasel:/usr/share/X11/fonts# dpkg -l xfonts-scalable
Desired=Unknown/Install/Remove/Purge/Hold
| Status=Not/Installed/Config-f/Unpacked/Failed-cfg/Half-inst/t-aWait/T-pend
|/ Err?=(none)/Hold/Reinst-required/X=both-problems (Status,Err: uppercase=bad)
||/ Name           Version        Description
+++-==============-==============-============================================
iHR xfonts-scalabl 1:1.0.0-6      scalable fonts for X

There seems to be a bug related to this:

https://bugs.launchpad.net/ubuntu/+source/xfonts-scalable/+bug/150770

Bummer. I'm stuck without fonts, so I can't run synaptic, or any other X app. And this was first reported in October 2007. That doesn't give me much hope that it will be resolved soon. There isn't even any activity posted on this bug. It really seems like amd64 is a second-class platform.

Googling for other problems similar, I find that someone had a similar problem with all his X fonts showing up as tall, narrow, empty boxes and the locale was implied to be the problem but no solution was found. An idea was to verify that fonts were installed with fc-list.

My fc-list returns a list of 183 fonts. And the output looks normal.

My locale looks like this:

root@weasel:~# locale
LANG=en_US.UTF-8
LANGUAGE=en
LC_CTYPE="en_US.UTF-8"
LC_NUMERIC="en_US.UTF-8"
LC_TIME="en_US.UTF-8"
LC_COLLATE="en_US.UTF-8"
LC_MONETARY="en_US.UTF-8"
LC_MESSAGES="en_US.UTF-8"
LC_PAPER="en_US.UTF-8"
LC_NAME="en_US.UTF-8"
LC_ADDRESS="en_US.UTF-8"
LC_TELEPHONE="en_US.UTF-8"
LC_MEASUREMENT="en_US.UTF-8"
LC_IDENTIFICATION="en_US.UTF-8"
LC_ALL=