xorg/ X11R68ReleaseStatus

The X.Org Foundation X11R6.8 Release Status

Table of Contents

  1. Table of Contents
  2. Current status
  3. Legend
  4. Detailed test instructions
  5. Tinderboxes

Current status

The following describes the current status of this release. Each row describes one platform. See the legend at the bottom of this page for a description of each column and the color codings.

The current release candidate tag is: XORG-6_8_0

The release criteria is that the release is ready to ship when there are no red cells in table.

At this time, we need:

  1. Volunteers to perform the tests described below. Please e-mail xorg@lists.freedesktop.org if you can test a platform.
  2. There are several platforms listed at the bottom of the table that are currently all in the open questions state. If you have information about these distributions, please send e-mail to xorg@lists.freedesktop.org with the info.
  3. If any of the data in the table is incorrect, please e-mail xorg@lists.freedesktop.org with a description of the error.
  4. Please report intermediate states (e.g. build tests done), so that people can see your progress.
OS Arch Distro/Release Name Build Install Conformance Run
AIX arch??? release(s)??? Dan McNichol
Cygwin IA-32 Net-release Alexander Gottwald
FreeBSD Alpha 4.10 Eric Anholt
FreeBSD Alpha 5.2.1 Eric Anholt
FreeBSD AMD64/EM64T 5.2.1 Eric Anholt
FreeBSD IA-32 4.10 Eric Anholt
FreeBSD IA-32 5.2.1 Eric Anholt
FreeBSD IA-64 5.2.1 Eric Anholt
FreeBSD Sparc64 5.2.1 Eric Anholt
HP-UX HP PA-RISC release(s)??? Paul Anderson
Linux Alpha Debian version(s)???
Linux Alpha Gentoo Donnie Berkholz
Linux Alpha SUSE 8.1
Linux AMD64/EM64T Debian version(s)???
Linux AMD64/EM64T Gentoo Andrew Bevitt RC2 RC2 RC2 RC2
Linux AMD64/EM64T Red Hat FC2
Linux AMD64/EM64T Red Hat RHEL3
Linux AMD64/EM64T SUSE 9.1 Egbert Eich
Linux AMD64/EM64T SUSE SLES9 Egbert Eich
Linux ARM Debian version(s)???
Linux ARM Gentoo Donnie Berkholz
Linux IA-32 Debian unstable Several RC2 RC2
Linux IA-32 Debian 3.0
Linux IA-32 Gentoo Andrew Bevitt RC2 RC2 RC2 RC2
Linux IA-32 LTSP 4.1 Jim McQuillan
Linux IA-32 Red Hat 7.2 Kevin Martin RC2 RC2 RC2 RC2
Linux IA-32 Red Hat 9 Kevin Martin RC2 RC2 RC2 RC2
Linux IA-32 Red Hat FC1 Mike Harris
Linux IA-32 Red Hat FC2 Mike Harris
Linux IA-32 Red Hat RHEL3 Mike Harris
Linux IA-32 SUSE 9.1 Several RC2 FC2
Linux IA-32 SUSE SLES9 Egbert Eich
Linux IA-64 Debian unstable
Linux IA-64 Debian 3.0
Linux IA-64 Gentoo Donnie Berkholz
Linux IA-64 Red Hat RHEL3
Linux IA-64 SUSE SLES9 Egbert Eich
Linux M68k Debian version(s)???
Linux MIPS Debian version(s)???
Linux MIPS Gentoo Donnie Berkholz
Linux PPC Debian unstable Nathan Hand RC2 RC2 RC2 RC2
Linux PPC Gentoo Donnie Berkholz
Linux PPC SUSE SLES9 Egbert Eich
Linux PPC64 Gentoo Donnie Berkholz
Linux HP PA-RISC Debian version(s)???
Linux HP PA-RISC Gentoo Donnie Berkholz
Linux S/390 Debian version(s)???
Linux S/390 SUSE SLES9 Egbert Eich
Linux Sparc Debian/SID Chris Debenham RC2
Linux Sparc Gentoo Donnie Berkholz
MacOS PPC 10.1 Torrey Lyons
MacOS PPC 10.2 Torrey Lyons
MacOS PPC 10.3 Torrey Lyons
MacOS/Darwin IA-32 7.2.1 Torrey Lyons
MacOS/Darwin PPC 7.2.1 Torrey Lyons
OpenBSD AMD64/EM64T 3.6 Matthieu Herrb RC2 RC2 RC2 RC2
OpenBSD IA-32 3.6 Matthieu Herrb RC2 RC2 RC2 RC2
Solaris IA-32 Solaris 9 Alan Coopersmith
Solaris IA-32 Solaris 10 Beta Alan Coopersmith
Solaris Sparc Solaris 9 Alan Coopersmith
Solaris Sparc Solaris 10 Beta Alan Coopersmith
IRIX ???
LynxOS ???
NetBSD ???
OS/2 ???
SCO ???

Legend

Columns

  1. OS -- Operating system
  2. Arch -- Architecture
  3. Distro/Release -- Distribution with release number or simply release number if distribution is not applicable
  4. Name -- Name of the person responsible for testing this platform
  5. Build -- Release has been built properly
  6. Install -- Release has been installed properly
  7. Conformance -- Release passes VSW4 test suite
  8. Run -- Release runs on platform

Colors

  1. Blue -- All column headings
  2. Green -- Build, Install, Conformance or Run tests passed and are ready for release
  3. Red -- Build, Install, Conformance or Run tests have not passed and are not ready for release
  4. Purple -- Open questions (e.g., what distribution release is to be tested or what architecture is to be tested)

Detailed test instructions

This section outlines the test procedure for each of the test columns above. When a test run has been completed, please e-mail the xorg@lists.freedesktop.org mailing list with the following information so that the release status matrix (above) can be updated. Note that we are interested in progress: please do not wait to complete all phases of testing to send in reports.

  1. Your Name
  2. The date tested
  3. The platform you tested:
    • The operating system tested (e.g., AIX, Cygwin, !FreeBSD, HP-UX, Linux, etc.)
    • The architecture tested (e.g., Alpha, AMD64, EM64T, IA-32, IA-64, Sparc, etc.)
    • The distribution and release tested (e.g., Red Hat FC2, SUSE 9.1, Debian unstable, Solaris 9, etc.)
  4. The snapshot or release candidate tag tested (e.g., XORG-6_7_99_1, etc.)
  5. Build test status: passed or failed or untested
  6. Install test status: passed or failed or untested
  7. Conformance test status: passed or failed or untested
  8. Run test status: passed or failed or untested
    • List the tests run

For any test(s) that failed, please include in your report the test(s) that failed, and file a bugzilla report if no one has already filed one against the failure(s) you found.

Build tests

Each of the following build tests can be performed by copying the sample host.def file (or the alternate) to the xc/config/cf directory and the running make World >& World.LOG (or other such command as appropriate for your platform), and then checking the !World.LOG file for any failures.

  1. Build with empty host.def file (sample alternate)
  2. Build with BuildServersOnly defined as YES (sample alternate)
  3. Build with DoLoadableServer defined as NO (sample alternate)

Note that some systems do not have a compatible version of Freetype2 installed on their system, so in addition to each build requirement above, defining HasFreetype2 as NO is permitted. Each alternate host.def file above have this define included.

Install tests

Each of the following install tests can be performed by building the release (as described above using the sample or alternate host.def file provided), running make Install >& Install.LOG (or other such command as appropriate for your platform), and checking the !Install.LOG output for any failures.

  1. Build and install with no host.def file (sample alternate)
  2. Build and install with: ProjectRoot defined to be something other than the default, and NothingOutsideProjectRoot defined as YES (sample alternate)

Note that some systems do not have a compatible version of Freetype2 installed on their system, so in addition to each install requirement above, defining HasFreetype2 as NO is permitted. Each alternate host.def file above have this define included.

Conformance tests

After installing the full release, the conformance tests can be run using the X test suite, which can be downloaded here. A helper script (called xreg) is used to run the X test suite, which can be downloaded here. See the next two sections below for more information on how to setup and use these tools.

UPDATE The xreg script and the xtest.tar.gz tarball have been updated to fix some xtest errors. Please update to these latest versions (27 Aug 04).

Setting up the X test suite

Here are some brief instructions on how to download and set up everything that you will need to run the X test suite:

  1. mkdir /tmp/testing
  2. cd /tmp/testing
  3. wget http://www.freedesktop.org/~kem/testing/xtest.tar.gz
  4. wget http://www.freedesktop.org/~kem/testing/xreg
  5. tar xvzf xtest.tar.gz
  6. cd xtest/xsuite
  7. sh BUILD.xf86
  8. cd ../.. Now you should be ready to begin testing.

Examples of how to use the xreg script

Here are some examples of how to use xreg to run the X test suite:

  1. xreg -xtest -xvfb
    • This runs xtest at all default depths using the Xvfb server.
    • The default depths are 8, 15, 16, and 24+32.
    • The "24+32" depth is one that uses a depth of 24 with a frame buffer bits per pixel of 32 (i.e., -depth 24 -fbbpp 32).
  2. xreg -xtest -xorg -d 16
    • This runs xtest at depth 16 using the Xorg server.
  3. xreg -xtest -xvfb -d 15 -test !XCopyArea
    • This runs xtest at depth 15 using the Xvfb server, but it only runs the !XCopyArea test.
    • Selecting individual tests is very useful to track down test failures.
  4. xreg -xtest -xvfb -d 16 -xvfbwidth 1280 -xvfbheight 1024 -test !XFillRectangles -n 3-5
    • This runs xtest at depth 16 using the Xvfb server running at 1280x1024, but only runs the third through the fifth tests of the !XFillRectangles test.

Notes on using xreg:

  • The output from these test runs are stored in pwd/results by default. You can change the default output dir using the -O command line option.
  • The material below assumes that you have done a full install of the system to /usr/X11R6. However, if you are using a different ProjectRoot, you can use the following command line option to the xreg script to run from that alternate location: -projroot path-to-your-project-root
  • The files that are generated from an xreg run of xtest are:
    1. X-setup..output -- this file contains the output of the X server during the setup phase
    2. xtest.DEPTH.DATE.TIME.errors -- this file contains the list of errors found during the test run at depth DEPTH made on date DATE at time TIME.
    3. xtest.DEPTH.DATE.TIME.report -- this file contains the report of all tests run at depth DEPTH made on date DATE at time TIME.
    4. xtest.DEPTH.DATE.TIME.summary -- this file contains a summary of the errors found during the test run at depth DEPTH made on date DATE at time TIME. The summary file is only useful during full test runs (e.g., not when running individual tests).
    5. xtest.DEPTH.DATE.TIME.results -- this directory contains the journal from the tests run at depth DEPTH made on date DATE at time TIME as well as any error images generated.
  • After running xtest, you can check to see if everything passed by looking at the summary/errors/report file(s) to see if there are any failures.
  • There are some known failures that the summary file attempts to take into account. The first part of the summary file is the list of failures, and at the end of the summary file is a diff between the known failures (e.g., !XDrawArcs) and what the failures were for this run.
  • The xreg script has only been tested on Linux systems. If there are problems with these scripts, please post patches to the xorg@lists.freedesktop.org mailing list.
  • There are many other options to xreg (and it can be used to run other tests such as x11perf). Run xreg -help to see the usage message.

Actually running the conformance tests

For this section, one of the following should be used for testing:

  • For platforms based on a XFree86-style DDX, the dummy driver should be used.
    • For example: xreg -xtest -xorg
    • This will run xtest at all the default depths using the Xorg server.
    • Check the output of each report or summary file to make sure that all tests that are expected to pass do actually pass.
  • For all other platforms, Xvfb should be used.
    • For example: xreg -xtest -xvfb -d "15 16 24+32"
    • This will run xtest at depths 15, 16 and 24+32 using the Xvfb server.
    • Check the output of each report or summary file to make sure that all tests that are expected to pass do actually pass.
    • Note that Xvfb does not currently run at depth 8, so the example above limits the testing to depths 15, 16 and 24+32. Update, this problem has been fixed in CVS now and Xvfb at depth 8 works again.

Additional notes:

  • The Xvfb server is special X server that uses a virtual framebuffer. It is normally built and installed with the full release. See the Xvfb(1) for more information about this server.
  • The dummy driver is a special driver available with the XFree86 DDX. To use the dummy driver, simply substitue it for your normal card driver in the Device section of your xorg.conf configuration file. For example, if you normally uses an ati driver, then you will have a Device section with Driver "ati" to let the X server know that you want it to load and use the ati driver; however, for these conformance tests, you would change that line to Driver "dummy" and remove any other ati specific options from the Device section.

Run tests

After installing the full release, you can run the subset of tests listed below that applies to the platform being tested. Please run these tests on at least two different driver families (where applicable). For example, on an IA-32 system running Linux, you could run the tests using one card from the ATI driver family and another card from the NVIDIA driver family.

Tests for each driver family:

  1. X test suite (listed above)
  2. x11perf
  3. rendertest (found in the xapps CVS repository on freedesktop.org)
  4. Standard graphical environment
  5. GL tests: glxgears, gloss, quake3
  6. Switch to/from VTs (on Linux)

Tinderboxes

Several tinderboxes have been set up to test the release. See this page for their status.

Ideally, the tinderboxes could be set up to run the build, install and conformance tests listed above.

-- Main.KevinEMartin - 17 Aug 2004