]> xenbits.xensource.com Git - people/dariof/osstest.git/log
people/dariof/osstest.git
11 years agoREADME: Add some core concepts and terminology
Ian Campbell [Mon, 20 Jan 2014 13:20:10 +0000 (13:20 +0000)]
README: Add some core concepts and terminology

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoCXFabric: Register more MAC addresses with the fabric
Ian Campbell [Sun, 2 Mar 2014 10:22:44 +0000 (10:22 +0000)]
CXFabric: Register more MAC addresses with the fabric

I've seen 0x20 used in a single flight. Register up to 0x40.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agocr-for-branches: Branch for Xen 4.4
Ian Jackson [Fri, 21 Feb 2014 16:44:15 +0000 (16:44 +0000)]
cr-for-branches: Branch for Xen 4.4

Process the new branches xen-4.4-testing and qemu-upstream-4.4-testing.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agots-xen-build: Set LIBLEAFDIR_x86_64
Ian Jackson [Fri, 21 Feb 2014 18:27:12 +0000 (18:27 +0000)]
ts-xen-build: Set LIBLEAFDIR_x86_64

Xen 4.1 puts things in /usr/lib64 otherwise.  This is wrong for
Debian, and does not work at all on wheezy.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agots-kernel-build: Disable "Brocade BFA Fibre Channel Support"
Ian Campbell [Mon, 24 Feb 2014 09:50:57 +0000 (09:50 +0000)]
ts-kernel-build: Disable "Brocade BFA Fibre Channel Support"

This driver is broken on ARM:
    ERROR: "__bad_udelay" [drivers/scsi/bfa/bfa.ko] undefined!

I've taken the lazy way out and disabled it on all platforms. I think it isn't
especially likely that any of the current osstest hosts are using Fibre
Channel right now. The code to enable it came from a big batch addition of
drivers in 451f39c6149e.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoallow.all: Tolerate all build-*-oldkern failures
Ian Jackson [Thu, 27 Feb 2014 15:00:11 +0000 (15:00 +0000)]
allow.all: Tolerate all build-*-oldkern failures

We are getting very many of these due to network braindamage.
For now, tolerate them.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoExecutive.pm: Change default ControlDaemonHost
Ian Jackson [Tue, 18 Feb 2014 18:58:12 +0000 (18:58 +0000)]
Executive.pm: Change default ControlDaemonHost

We are going to move these daemons from woking to the new osstest VM.
So use a DNS alias for now.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoproduction-config: do not set WebspaceUrl, WebspaceFile
Ian Jackson [Fri, 14 Feb 2014 18:16:29 +0000 (18:16 +0000)]
production-config: do not set WebspaceUrl, WebspaceFile

The defaults,
    $c{WebspaceFile} ||= "$ENV{'HOME'}/public_html/";
    $c{WebspaceUrl} ||= "http://$myfqdn/~$whoami/";
are adequate.  This means the configuration can work on both
woking and the new osstest VM.

Signed-off-by: Ian Jackson <iwj@osstest.cam.xci-test.com>
11 years agoproduction-config: authorise iwj@osstest key
Ian Jackson [Tue, 18 Feb 2014 18:05:53 +0000 (18:05 +0000)]
production-config: authorise iwj@osstest key

Just like the iwj@woking key.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoreadglobalconfig: change default DhcpWatchMethod
Ian Jackson [Tue, 18 Feb 2014 18:05:32 +0000 (18:05 +0000)]
readglobalconfig: change default DhcpWatchMethod

Use the TCP connection to woking, so that it works after we switch
to the new osstest VM.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoproduction-config: use /home/xc_tftpboot, not /tftpboot
Ian Jackson [Fri, 14 Feb 2014 19:09:32 +0000 (19:09 +0000)]
production-config: use /home/xc_tftpboot, not /tftpboot

This is available on both woking and on the new osstest VM.

Signed-off-by: Ian Jackson <iwj@osstest.cam.xci-test.com>
11 years agogit: Use "git foo" rather than "git-foo"
Ian Jackson [Fri, 14 Feb 2014 16:08:00 +0000 (16:08 +0000)]
git: Use "git foo" rather than "git-foo"

All of our machines now have "git foo" and have done for some time,
and some are going to not have "git-foo".

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agots-xen-build: Apply python workaround in wheezy too
Ian Jackson [Wed, 19 Feb 2014 15:58:20 +0000 (15:58 +0000)]
ts-xen-build: Apply python workaround in wheezy too

Debian #693721 is not yet fixed.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoDo not attempt migration tests if the platform doesn't support it
Ian Campbell [Wed, 12 Feb 2014 14:27:56 +0000 (14:27 +0000)]
Do not attempt migration tests if the platform doesn't support it

Doing so blocks the rest of the tests in the job, which may be able to
indepentently complete. So arrange for a ts-migrate-support-check test to run
and gate the remaining migration tests on that.

This relies on the xen patch "xl: suppress suspend/resume functions on
platforms which do not support it" to actually suppress migration support on
arm.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
This needs to go in after the Xen patch. Otherwise this new step will appear to
pass and then start to fail when the Xen patch is applied.

11 years agoConfigure the Calxeda fabric on host boot
Ian Campbell [Wed, 12 Feb 2014 10:30:49 +0000 (10:30 +0000)]
Configure the Calxeda fabric on host boot

The fabric on the Calxeda midway boxes (marilith-* in osstest) does not learn
mac address (at least not with the firmware we have, and with Calxeda folding
this seems unlikely to get fixed). This means that guests do not get network
connectivity unless their mac addresses explicitly registered with the fabric.

Registrations can be done with the bridge(8) tool from the iproute2 package
which unfortunately is only present in Jessie+ and not in Wheezy. So I have
done my own backport and placed it in $images/wheezy-iproute2 and arranged for
it to be installed along with the transitional iproute package (from the same
source) which is needed to satisfy various dependencies.

The registrations are ephemeral and need to be renewed on each reboot, so add
the necessary commands to rc.local during ts-xen-install.

This required leaking a certain amount of the implementation of select_ether.
Unless we want to do the bodge on every ts-guest-start, reboot, migrate etc
then this seems to be the best way.

test-armhf-armhf-xl now gets past ts-guest-start and as far as the migration
tests.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
v2: hardcode 8 mac addresses and gate on equiv-marilith host flag
    simplify code to install iproute debs

11 years agofreebsd: switch to 10.0-RELEASE (20140116-r260789)
Ian Jackson [Mon, 10 Feb 2014 12:09:51 +0000 (12:09 +0000)]
freebsd: switch to 10.0-RELEASE (20140116-r260789)

11 years agomake-flight: abolish special-casing of suite for armhf
Ian Jackson [Thu, 12 Dec 2013 12:08:31 +0000 (12:08 +0000)]
make-flight: abolish special-casing of suite for armhf

Since the suite is now wheezy by default this is no longer needed.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoDebian: Switch to wheezy
Ian Jackson [Mon, 18 Nov 2013 16:04:45 +0000 (16:04 +0000)]
Debian: Switch to wheezy

This involves updating the d-i version too.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-guests-nbd-mirror: set "oldstyle=true"
Ian Jackson [Mon, 10 Feb 2014 16:40:37 +0000 (16:40 +0000)]
ts-guests-nbd-mirror: set "oldstyle=true"

Newer NBDs (wheezy's and later) need a config option to say we're
using the old-style port-based addressing.  At some point we will
probably switch to using the new-style addressing, but not yet.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-guests-nbd-mirror: add checkaccessible test
Ian Jackson [Mon, 10 Feb 2014 16:40:22 +0000 (16:40 +0000)]
ts-guests-nbd-mirror: add checkaccessible test

If the NBD devices are not properly accessible on the client, bomb out
here rather than futilely starting a guest, and then timing out when
the guest fails to boot because it can't find its root fs.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-guests-nbd-mirror: purge old packages first
Ian Jackson [Mon, 10 Feb 2014 16:39:37 +0000 (16:39 +0000)]
ts-guests-nbd-mirror: purge old packages first

Purge any old nbd-client and nbd-server _before_ we make their config.

This only has any effect if the packages are installed before this
script starts, which isn't the case in any of the automatically-run
recipes.  But it can occur when the script is being tested by hand.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport: Suppress prompting by apt
Ian Jackson [Mon, 10 Feb 2014 16:38:57 +0000 (16:38 +0000)]
TestSupport: Suppress prompting by apt

Always set DEBIAN_PRIORITY=critical UCF_FORCE_CONFFOLD=y in
environment of apt, to suppress some prompts.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport: break out target_run_apt
Ian Jackson [Mon, 10 Feb 2014 16:34:52 +0000 (16:34 +0000)]
TestSupport: break out target_run_apt

We are going to add some environment variables to the apt invocation,
so centralise where this happens.  No functional change.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-xen-install: default the interface to the one in /etc/network/interfaces
Ian Jackson [Thu, 23 Jan 2014 18:30:47 +0000 (18:30 +0000)]
ts-xen-install: default the interface to the one in /etc/network/interfaces

The default was simply eth0.  This is the other piece of automatically
coping with the boot interface not being eth0.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-xen-install: nodhcp: restructure
Ian Jackson [Thu, 23 Jan 2014 17:50:02 +0000 (17:50 +0000)]
ts-xen-install: nodhcp: restructure

Move target_editfile_root to contain all the meat of the function.
This is useful because we're going to possibly want to read the input
interfaces file twice.

No functional change.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-host-install: set `IPAPPEND 2' (if interface isn't forced)
Ian Jackson [Thu, 23 Jan 2014 16:33:44 +0000 (16:33 +0000)]
ts-host-install: set `IPAPPEND 2' (if interface isn't forced)

This causes BOOTIF=<mac-address> to appear on command line.  This
makes d-i use that interface.  (See also Debian #615600.)

This is a better approach to interface name instability than setting
the force interface host property.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-kernel-build: force CONFIG_BLK_DEV_NBD=y
Ian Jackson [Thu, 23 Jan 2014 11:29:52 +0000 (11:29 +0000)]
ts-kernel-build: force CONFIG_BLK_DEV_NBD=y

Otherwise, with wheezy and Linux 3.4.77:

Jan 23 04:36:42 lake-frog nbd_client[4274]: Cannot open NBD: No such file or directory#012Please ensure the nbd module is loaded.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-xen-build-prep: avoid lvextend segfault (Debian #736173) with wheezy
Ian Jackson [Tue, 21 Jan 2014 18:53:13 +0000 (18:53 +0000)]
ts-xen-build-prep: avoid lvextend segfault (Debian #736173) with wheezy

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agocr-daily-branch: make sure we test the correct tree for Linux branches
Ian Campbell [Tue, 11 Feb 2014 12:30:21 +0000 (12:30 +0000)]
cr-daily-branch: make sure we test the correct tree for Linux branches

These branches should test the specific Linux tree which they and so should
not apply the per-arch overrides which are only intended to be used to pick up
an already verified tested Linux branch for use when testing some other
non-linux branch.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-kernel-build: make sure CONFIG_PACKET is enabled
Ian Campbell [Fri, 7 Feb 2014 09:57:22 +0000 (09:57 +0000)]
ts-kernel-build: make sure CONFIG_PACKET is enabled

It is required by the dhcp client and is not present in the arm
multi_v7_defconfig.

Also stash the config file in the build results for easy reference, it is
already in kerndist.tar.gz but that's a 30+M download compared with a few tens
of K.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agocr-daily-branch: Limit "people who touched" listing
Ian Jackson [Wed, 5 Feb 2014 16:55:51 +0000 (16:55 +0000)]
cr-daily-branch: Limit "people who touched" listing

Sometimes this can be very large, which can result in the results
postings getting discarded.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoEnable armhf tests for linux-linus branch
Ian Campbell [Wed, 5 Feb 2014 16:46:19 +0000 (16:46 +0000)]
Enable armhf tests for linux-linus branch

Rather than whitelisting interesting branches, instead blacklist the hisotrical
branches which are not interesting to armhf, ensuring that any new branches
will pick up armhf automatically.

This creates the expected build-armhf, build-armhf-pvops and
test-armhf-armhf-xl jobs for the linux-linus branch.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agomake-flight: refactor test_matrix_do_one
Ian Campbell [Tue, 21 Jan 2014 11:52:54 +0000 (11:52 +0000)]
make-flight: refactor test_matrix_do_one

Pull some test creation out into their own subdirectories. This allows the
total level of indentation to be reduced.

It also allows us to invert the pre-condition test and simply return at the
top of the subroutine, which further reduces indentation.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomfi-common: onetoolstack does not vary for a given $xenbranch
Ian Campbell [Mon, 20 Jan 2014 17:58:33 +0000 (17:58 +0000)]
mfi-common: onetoolstack does not vary for a given $xenbranch

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: Refactor test matrix iteration into mfi-common
Ian Campbell [Mon, 20 Jan 2014 17:56:28 +0000 (17:56 +0000)]
make-flight: Refactor test matrix iteration into mfi-common

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: reduce indentation in test_matrix_do_one
Ian Campbell [Mon, 20 Jan 2014 17:52:10 +0000 (17:52 +0000)]
make-flight: reduce indentation in test_matrix_do_one

Now that the body of the multiple nested loops is in a function it doesn't need
to be so deeply indented. This wasn't done in the previous patch for clarity.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: Separate matrix iteration from test job creation
Ian Campbell [Mon, 20 Jan 2014 17:48:35 +0000 (17:48 +0000)]
make-flight: Separate matrix iteration from test job creation

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: refactor test case filter over $branch
Ian Campbell [Mon, 20 Jan 2014 17:47:15 +0000 (17:47 +0000)]
make-flight: refactor test case filter over $branch

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: refactor job_create_test into mfi-common
Ian Campbell [Mon, 20 Jan 2014 17:20:57 +0000 (17:20 +0000)]
make-flight: refactor job_create_test into mfi-common

Now that it uses a callback it can trivially be moved to mfi-common

Arguably the setting of *buildjob could also be a callback, but my intended use
case doesn't need that and it seems reasonable enough for now that users of the
common job_create_test also use the common create_build_jobs (or produce
something sufficiently similar).

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: refactor job_create_test filters
Ian Campbell [Mon, 20 Jan 2014 17:18:22 +0000 (17:18 +0000)]
make-flight: refactor job_create_test filters

This will allow job_create_test to be moved mfi-common.

No (intentional) change to the set of jobs which are created.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: Remove md5sum based job filtering
Ian Campbell [Mon, 20 Jan 2014 16:48:11 +0000 (16:48 +0000)]
make-flight: Remove md5sum based job filtering

JOB_MD5_PATTERN was intended to allow making randomly smaller flights, but is
not used in practice.

The filtering of the qemmu*-win jobs was intended to reduce the number of
combinations but ended up suppressing only:
  test-amd64-i386-xl-qemuu-winxpsp3-vcpus1
  test-amd64-i386-xl-qemuu-win7-amd64

Both of which seem useful so allow them to be enabled.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomfi-common: restrict scope of local vars in create_build_jobs
Ian Campbell [Mon, 20 Jan 2014 15:47:01 +0000 (15:47 +0000)]
mfi-common: restrict scope of local vars in create_build_jobs

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomfi-common: Allow caller of create_build_jobs to include/exclude xend builds
Ian Campbell [Mon, 20 Jan 2014 15:43:12 +0000 (15:43 +0000)]
mfi-common: Allow caller of create_build_jobs to include/exclude xend builds

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
---
v2: Corect WANT_XEND test.

11 years agoRemove support for building the XCP kernel
Ian Campbell [Mon, 20 Jan 2014 15:38:26 +0000 (15:38 +0000)]
Remove support for building the XCP kernel

This kernel is well and truly dead.

I've left some of the general support for using other kernel types in place
even though it is now unused.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: refactor build job creation into mfi-common
Ian Campbell [Mon, 20 Jan 2014 15:32:27 +0000 (15:32 +0000)]
make-flight: refactor build job creation into mfi-common

This is pure code motion *except* I have aligned the backslash continuation
lines at the same time -- I was unable to resist doing so.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: Drop obsolete/unused xenrt_images variable.
Ian Campbell [Mon, 20 Jan 2014 15:12:24 +0000 (15:12 +0000)]
make-flight: Drop obsolete/unused xenrt_images variable.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: refactor common function "stripy" into helper library
Ian Campbell [Mon, 20 Jan 2014 15:07:18 +0000 (15:07 +0000)]
make-flight: refactor common function "stripy" into helper library

Will be useful for other make-flight variants.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: expand hard tabs
Ian Campbell [Mon, 20 Jan 2014 13:48:35 +0000 (13:48 +0000)]
make-flight: expand hard tabs

Run expand on the file.

Add an emacs magic var block disabling indent-tabs-mode and setting the sh
mode basic offset to 2 (which appears to be the common, but not universal,
case).

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agostandalone: Correct arguments to JobDB flight_create
Ian Campbell [Tue, 21 Jan 2014 16:44:29 +0000 (16:44 +0000)]
standalone: Correct arguments to JobDB flight_create

The real jobdb takes $intended and $branch in the other order, meaning that
the standalone db ends up with them backwards.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoRemove obsolete scripts.
Ian Campbell [Mon, 20 Jan 2014 12:43:58 +0000 (12:43 +0000)]
Remove obsolete scripts.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agots-kernel-build: override kernel config from runvars
Ian Campbell [Fri, 10 Jan 2014 14:58:32 +0000 (14:58 +0000)]
ts-kernel-build: override kernel config from runvars

Use this to build EXT4 into the kernel statically for armhf build to work
around the lack of guest initrd support on ARM at the moment.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agomake-flight: override the Debian guest suite on armhf
Ian Campbell [Fri, 10 Jan 2014 11:41:47 +0000 (11:41 +0000)]
make-flight: override the Debian guest suite on armhf

We already override the host Debian suite but we need to override the guest too
(since armhf doesn't exist in squeeze).

Consolidate the Debian guest vars in to one place and add  debian_suite runvar
when appropriate.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agomake-flight: Adjust buildjob runvar for xend vs non-xend tests
Ian Campbell [Fri, 10 Jan 2014 09:55:10 +0000 (09:55 +0000)]
make-flight: Adjust buildjob runvar for xend vs non-xend tests

Currently we only do so for xenbuildjob which only contains the hypervisor and
not the tools, for those we need buildjob. In principal the xenbuildjob output
should be identical for both xend and non-xend builds, but we use a matching
set of consistency.

This adds a xend suffix to buildjob for exactly test-amd64-i386-pv,
test-amd64-amd64-pv, test-amd64-i386-xend-winxpsp3,
test-amd64-i386-xend-qemut-winxpsp3 which is the expected set of xend jobs.

11 years agodo not install xend for xl tests
Ian Campbell [Fri, 20 Dec 2013 12:35:27 +0000 (12:35 +0000)]
do not install xend for xl tests

We need to check that xl works correctly when xend is not even installed (in
case we are subtly relying on some file which xend installs).

Therefore for xen 4.4 onwards never build xend in the default build job and
instead create two new build jobs (for i386 and amd64) with xend enabled.
Update the tests to use the correct xenbuildjob.

Tested only to the extent of running make-flight for xen-4.{2,3,4}-testing and
xen-unstable and observing that the jobs do not differ for 4.2 and 4.3 and the
4.4 and unstable have gained the new build-{i386,and64}-xend jobs and that the
relevant tests have switched their xenbuildjob runvar to have the suffix.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agocs-bisection-step: Use tree URLs from latest flight, not basis pass
Ian Jackson [Mon, 6 Jan 2014 13:52:58 +0000 (13:52 +0000)]
cs-bisection-step: Use tree URLs from latest flight, not basis pass

We (both in adhoc-revtuple-generator and in the eventual build job)
(when using git) clone a particular url and then expect that the
resulting tree has all of the relevant revisions in it.

If a push gate has a different input tree to output tree, it is
necessary to use the output tree.  And, if the tree has moved, it is
probably more useful to use the new url than the old.

So it is more proper to use the tree url from the last flight found,
rather than that from the basis pass.  Do that.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoap-common: arm: set TREE_LINUX_ARM_THIS and TAG_LINUX_ARM_THIS too
Ian Jackson [Thu, 2 Jan 2014 19:20:41 +0000 (19:20 +0000)]
ap-common: arm: set TREE_LINUX_ARM_THIS and TAG_LINUX_ARM_THIS too

11 years agots-debian-install: work around xen-create-image reliance on xend
Ian Campbell [Wed, 18 Dec 2013 09:32:04 +0000 (09:32 +0000)]
ts-debian-install: work around xen-create-image reliance on xend

The xen-tools script contains some sanity checks of the xend configuration and
fails if the configuration file is not present. This issue has been reported
upstream http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=732456.

Workaround this issue by creating a dummy xend-config.sxp if it does not
already exist. Include network- and vif- script options to keep the sanity
checks happy.

The workaround is enabled for all releases up to and including Wheezy in the
hopes that this will be fixed by the time Jessie is released, if not then the
osstest pushgate will hopefully catch this when Jessie is pushed to it.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: disable OVMF build for 4.3.
Ian Jackson [Thu, 12 Dec 2013 16:31:33 +0000 (16:31 +0000)]
make-flight: disable OVMF build for 4.3.

11 years agomake-flight, ts-xen-build: Build OVMF for Xen-unstable
Wei Liu [Tue, 10 Dec 2013 17:19:33 +0000 (17:19 +0000)]
make-flight, ts-xen-build: Build OVMF for Xen-unstable

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agofreebsd: run ts-guest-start, as ts-freebsd-install just prepares the disk
Ian Jackson [Wed, 4 Dec 2013 18:15:05 +0000 (18:15 +0000)]
freebsd: run ts-guest-start, as ts-freebsd-install just prepares the disk

11 years agotarget_guest_lv_name: move into TestSupport; fix FreeBSD test
Roger Pau Monné [Mon, 2 Dec 2013 15:22:53 +0000 (16:22 +0100)]
target_guest_lv_name: move into TestSupport; fix FreeBSD test

Move from lvm_lv_name in Debian.pm, and use it where appropriate in
ts-freebsd-install.  This will fix the bug where ts-freebsd-install
fails on hsots with "-" in their hostname (and hence their vg name).

Signed-off-by: Roger Pau Monné <roger.pau@citrix.com>
Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agotarget_file_exists: Use non-root access for this check
Ian Jackson [Thu, 28 Nov 2013 18:20:04 +0000 (18:20 +0000)]
target_file_exists: Use non-root access for this check

The new call of this in built_stash_file makes ts-*-build require root
access, which is not desirable.

The only other caller of target_file_exists is in ts-xen-install where
it is called on
                        /etc/default/xencommons
                        /etc/sysconfig/xencommons
                        /etc/default/xend
                        /etc/sysconfig/xend
all of which should be accessible as a normal user in a default config.

So change the access to use target_cmd_output rather than
target_cmd_output_root.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agotarget_cmd_build: honour DistccHosts host property
Ian Jackson [Thu, 28 Nov 2013 18:05:56 +0000 (18:05 +0000)]
target_cmd_build: honour DistccHosts host property

If this property is set then the environment variable
 (a) DISTCC_HOSTS is set to the value of the host property
 (a) CCACHE_PREFIX is set to "distcc"
which will result in distcc being used as configured.

distcc had better be installed for such hosts.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agots-hosts-allocate-Executive: crash if no hostflags specified
Ian Jackson [Thu, 28 Nov 2013 16:06:21 +0000 (16:06 +0000)]
ts-hosts-allocate-Executive: crash if no hostflags specified

Rather than picking a machine at random.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agomake-flight: freebsd: include hostflags in job creation
Ian Jackson [Thu, 28 Nov 2013 15:46:31 +0000 (15:46 +0000)]
make-flight: freebsd: include hostflags in job creation

Otherwise we can pick totally unsuitable hosts.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agocrontab: Run most branches half-hourly with -q rather than infrequently with -w
Ian Jackson [Thu, 21 Nov 2013 12:27:51 +0000 (12:27 +0000)]
crontab: Run most branches half-hourly with -q rather than infrequently with -w

Hopefully this won't implode too badly.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agocr-for-branches: when doing pre-pull from incoming, take out lock correctly
Ian Jackson [Thu, 21 Nov 2013 12:26:43 +0000 (12:26 +0000)]
cr-for-branches: when doing pre-pull from incoming, take out lock correctly

I.e. with -f if caller specified -q, rather than always using -w.  -q
would make the script carry on if it didn't manage to get the lock and
do the pull, which would be wrong.  -w is wrong because it can block
for another long-running script.

11 years agocri-common, ap-*: use >&2 with git-clone, git-fetch to avoid ap-* producing spurious...
Ian Jackson [Thu, 21 Nov 2013 12:24:06 +0000 (12:24 +0000)]
cri-common, ap-*: use >&2 with git-clone, git-fetch to avoid ap-* producing spurious messages on stdout

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport: fix a call to target_put_guest_image to call the right function
Ian Jackson [Tue, 26 Nov 2013 11:22:46 +0000 (11:22 +0000)]
TestSupport: fix a call to target_put_guest_image to call the right function

This call site mentioned target_transfer_guest_image which was my
first name for this function; the function was renamed before I
committed.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agots-freebsd-install: remove unused $xl setting
Roger Pau Monne [Thu, 21 Nov 2013 18:29:23 +0000 (18:29 +0000)]
ts-freebsd-install: remove unused $xl setting

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agosg-run-job: prototype test-freebsd recipe
Ian Jackson [Thu, 21 Nov 2013 18:23:40 +0000 (18:23 +0000)]
sg-run-job: prototype test-freebsd recipe

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agots-freebsd-install: sort out image handling by using target_put_guest_image, and...
Ian Jackson [Thu, 21 Nov 2013 18:23:21 +0000 (18:23 +0000)]
ts-freebsd-install: sort out image handling by using target_put_guest_image, and use job-specific local filenames

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoTestSupport: break out target_put_guest_image
Ian Jackson [Thu, 21 Nov 2013 18:22:31 +0000 (18:22 +0000)]
TestSupport: break out target_put_guest_image

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agots-freebsd-install: split big setup command into three chunks
Ian Jackson [Thu, 21 Nov 2013 18:00:01 +0000 (18:00 +0000)]
ts-freebsd-install: split big setup command into three chunks

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-freebsd-install: say set -ex at appropriate point
Ian Jackson [Thu, 21 Nov 2013 17:58:35 +0000 (17:58 +0000)]
ts-freebsd-install: say set -ex at appropriate point

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-*: make all target_cmd[_root] set -e (or +e)
Ian Jackson [Thu, 21 Nov 2013 17:55:57 +0000 (17:55 +0000)]
ts-*: make all target_cmd[_root] set -e (or +e)

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-freebsd-install: fix mode to be +x
Ian Jackson [Thu, 21 Nov 2013 17:50:20 +0000 (17:50 +0000)]
ts-freebsd-install: fix mode to be +x

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agomake-flight: freebsd jobs
Ian Jackson [Thu, 21 Nov 2013 16:04:31 +0000 (16:04 +0000)]
make-flight: freebsd jobs

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-freebsd-install: honour <guest>_image runvar
Ian Jackson [Thu, 21 Nov 2013 16:04:17 +0000 (16:04 +0000)]
ts-freebsd-install: honour <guest>_image runvar

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-freebsd-install: Style fixes
Ian Jackson [Thu, 21 Nov 2013 15:18:43 +0000 (15:18 +0000)]
ts-freebsd-install: Style fixes

No functional change.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agots-freebsd-install: add FreeBSD PVHVM installer
Roger Pau Monne [Thu, 21 Nov 2013 11:48:14 +0000 (12:48 +0100)]
ts-freebsd-install: add FreeBSD PVHVM installer

Signed-off-by: Roger Pau Monné <roger.pau@citrix.com>
Cc: Ian Jackson <Ian.Jackson@eu.citrix.com>
Cc: Ian Campbell <ian.campbell@citrix.com>
11 years agomore_prepareguest_hvm: honour xopt NoCdromImage
Ian Jackson [Wed, 20 Nov 2013 11:56:05 +0000 (11:56 +0000)]
more_prepareguest_hvm: honour xopt NoCdromImage

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-kernel-build: add UFS rw support to pvops kernel
Roger Pau Monne [Thu, 21 Nov 2013 11:48:13 +0000 (12:48 +0100)]
ts-kernel-build: add UFS rw support to pvops kernel

This is needed in order to mount and modify the FreeBSD VM images.

Signed-off-by: Roger Pau Monné <roger.pau@citrix.com>
Cc: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoMerge branch 'master' of ssh://woking/export/home/osstest/testing.git/ into pretest
Ian Campbell [Thu, 21 Nov 2013 08:42:53 +0000 (08:42 +0000)]
Merge branch 'master' of ssh://woking/export/home/osstest/testing.git/ into pretest

11 years agoMake libfdt available at build and runtime.
Ian Campbell [Wed, 20 Nov 2013 09:24:11 +0000 (09:24 +0000)]
Make libfdt available at build and runtime.

This library is only available from Wheezy onwards and is only used by ARM.
Since ARM tests require Wheezy just install on Wheezy onwards. The presence of
this library would be harmless if x86 were using Wheezy (but it currently uses
Squeeze so is totally unaffected)

11 years agocr-cleanup-tmps: actually do stuff properly
Ian Jackson [Mon, 18 Nov 2013 16:13:45 +0000 (16:13 +0000)]
cr-cleanup-tmps: actually do stuff properly

11 years agocr-cleanup-tmps: actually do stuff
Ian Jackson [Mon, 18 Nov 2013 16:13:15 +0000 (16:13 +0000)]
cr-cleanup-tmps: actually do stuff

11 years agocr-cleanup-tmps: new script
Ian Jackson [Mon, 18 Nov 2013 16:10:51 +0000 (16:10 +0000)]
cr-cleanup-tmps: new script

11 years agoRevert "allow.all: ignore all arm regressions"
Ian Jackson [Mon, 18 Nov 2013 11:03:59 +0000 (11:03 +0000)]
Revert "allow.all: ignore all arm regressions"

This reverts commit 861e49338c95cea94d2ecee6bfac4075be2a37df.

11 years agoallow.all: ignore all arm regressions
Ian Jackson [Mon, 18 Nov 2013 11:00:29 +0000 (11:00 +0000)]
allow.all: ignore all arm regressions

11 years agogit caching: abolish cacheing-git, and replace with use of chiark-utils git-cache...
Ian Jackson [Mon, 11 Nov 2013 15:58:20 +0000 (15:58 +0000)]
git caching: abolish cacheing-git, and replace with use of chiark-utils git-cache-proxy

11 years agoREADME: Document the RebootTimeExtra host property
Dario Faggioli [Wed, 6 Nov 2013 15:15:47 +0000 (15:15 +0000)]
README: Document the RebootTimeExtra host property

Signed-off-by: Dario Faggioli <dario.faggioli@citrix.com>
11 years agots-kernel-build: Enable MegaRAID SAS support
Dario Faggioli [Wed, 6 Nov 2013 15:13:46 +0000 (15:13 +0000)]
ts-kernel-build: Enable MegaRAID SAS support

when building linux, by adding the proper setopt
in $config_hardware in.

This is required for having the ultralisk big box
in the Cambridge office to properly boot.

Signed-off-by: Dario Faggioli <dario.faggioli@citrix.com>
11 years agoproduction-config: reduce min log expire age from 7d to 4d :-(
Ian Jackson [Tue, 5 Nov 2013 17:03:42 +0000 (17:03 +0000)]
production-config: reduce min log expire age from 7d to 4d :-(

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agomg-debian-installer-update: restrict armhf to Wheezy+
Ian Campbell [Thu, 31 Oct 2013 13:12:34 +0000 (13:12 +0000)]
mg-debian-installer-update: restrict armhf to Wheezy+

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agostandalone-reset: fix check for existing d-i and creation of symlink
Ian Campbell [Fri, 1 Nov 2013 09:33:08 +0000 (09:33 +0000)]
standalone-reset: fix check for existing d-i and creation of symlink

We need to check for "$diver-$suite" not just "$diver" now

Also when creating the current symlink only do so if
mg-debian-installer-update did something, since it will now silently ignore
unavailable combinations (e.g. armhf on Squeeze)

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-xen-build: make collection on xen-syms optional
Ian Campbell [Fri, 1 Nov 2013 12:55:38 +0000 (12:55 +0000)]
ts-xen-build: make collection on xen-syms optional

Fixes things on i386 for branches which no longer build an i386 hypervisor.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoPDU/xenuse: Support xenuse on machine not locked by current user
Ian Campbell [Fri, 25 Oct 2013 10:29:42 +0000 (11:29 +0100)]
PDU/xenuse: Support xenuse on machine not locked by current user

xenuse checks that whoever is trying to reboot a machine "owns" that machine
via a locking mechanism. This is usually fine doesn't work well when one wants
to book a machine out of the osstest pool for adhoc testing. In this case
machine ownership is maintained by osstest ahd the machine remains locked to
osstest as far as xenuse is concerned.

Therefore add a global configuration option and perhost override to override
$USER (which xenuse obeys) to osstest.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoStash debug symbols for build results
Ian Campbell [Thu, 31 Oct 2013 16:53:15 +0000 (16:53 +0000)]
Stash debug symbols for build results

Specifically xen-syms (<1M compressed) and the vmlinux (~13M compressed) files.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport: Add interface to compress stash files
Ian Campbell [Thu, 31 Oct 2013 16:53:14 +0000 (16:53 +0000)]
TestSupport: Add interface to compress stash files

Use it in ts-logs-capture

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>