]> xenbits.xensource.com Git - osstest.git/log
osstest.git
11 years agocr-publish-flight-logs: use ssh -o batchmode=yes flight-25950 flight-25951 flight-25956 flight-25957 flight-25958 flight-25960 flight-25961 flight-25962 flight-25963 flight-25965 flight-25966 flight-25967 flight-25968 flight-25969 flight-25970 flight-25971 flight-25972 flight-25973
Ian Jackson [Thu, 17 Apr 2014 10:29:38 +0000 (11:29 +0100)]
cr-publish-flight-logs: use ssh -o batchmode=yes

This avoids a problem (seen twice now) where NAT causes this
to hang and block everything.

Other invocations of rsync (eg in TestSupport) are all inside the
command-running machinery which imposes its own timeout.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agots-debian-hvm-install: fix local migration test
Wei Liu [Thu, 17 Apr 2014 13:59:06 +0000 (14:59 +0100)]
ts-debian-hvm-install: fix local migration test

Make sure there's enough free RAM for local migration test.

(Adjust $ram_lots to 5000 -iwj.)

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-debian-hvm-install: fix guest memory size
Wei Liu [Mon, 14 Apr 2014 11:04:34 +0000 (12:04 +0100)]
ts-debian-hvm-install: fix guest memory size

If the host has more than 5G free memory, change guest memory size to 5G
to catch any error that triggers by crossing 4G boundary. Otherwise
guest memory size is set to 768 MB (taken from ts-redhat-install) which
should be a safe value to run this testcase on every host.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport.pm: introduce host_get_free_memory
Wei Liu [Mon, 14 Apr 2014 11:03:49 +0000 (12:03 +0100)]
TestSupport.pm: introduce host_get_free_memory

... which returns the size of free memory in MB.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agostandalone: force an explicit default config flight-25929 flight-25932 flight-25935 flight-25937 flight-25940 flight-25943 flight-25946 flight-25949 flight-25952 flight-25954
Ian Campbell [Mon, 14 Apr 2014 10:31:15 +0000 (11:31 +0100)]
standalone: force an explicit default config

Some scripts (e.g. cri-args-hostlists) default to production-config instead of
the more expected ~/.xen-osstest/config. I keep forgetting this, so set the
more appropriate default in the helper script.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-xen-build: remove frobbing of xen.git/buildconfigs/enable-xen-config
Ian Campbell [Mon, 14 Apr 2014 10:31:00 +0000 (11:31 +0100)]
ts-xen-build: remove frobbing of xen.git/buildconfigs/enable-xen-config

This shouldn't be touched since osstest.git commit c1fba9810435 "import
enable-xen-config from xen.git, use for ts-kernel-build" and is just wrong
since xen.git 40305629dc48 "build: remove Linux kernel build integration."
since the file no longer exists.

Of the options which were being set here only CONFIG_HIGHPTE isn't already
handled by ts-kernel-build. I don't think CONFIG_HIGHPTE needs to be forced to
off these days (pvops kernels do it automagically). If I'm wrong I'm sure
osstest will tell us...

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
Cc: Jan Beulich <JBeulich@suse.com>
11 years agosg-report-flight: report when flight finished
Ian Jackson [Mon, 7 Apr 2014 15:59:29 +0000 (16:59 +0100)]
sg-report-flight: report when flight finished

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agosg-report-flight: Add some flight information
Ian Jackson [Mon, 7 Apr 2014 15:51:47 +0000 (16:51 +0100)]
sg-report-flight: Add some flight information

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agosg-report-flight: show the job recipe and overall status
Ian Jackson [Mon, 7 Apr 2014 15:30:03 +0000 (16:30 +0100)]
sg-report-flight: show the job recipe and overall status

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agosg-report-flight: mkdir the per-job directories
Ian Jackson [Mon, 7 Apr 2014 15:29:34 +0000 (16:29 +0100)]
sg-report-flight: mkdir the per-job directories

This makes sure the per-job pages always get created.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport: logm: use show_abs_time
Ian Jackson [Mon, 7 Apr 2014 16:11:28 +0000 (17:11 +0100)]
TestSupport: logm: use show_abs_time

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoshow_abs_time: break out from sg-report-flight
Ian Jackson [Mon, 7 Apr 2014 16:03:53 +0000 (17:03 +0100)]
show_abs_time: break out from sg-report-flight

No functional change.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-xen-build: bump "configure" timeout to 600s flight-25873 flight-25877 flight-25890 flight-25897 flight-25898 flight-25900 flight-25901 flight-25904 flight-25905 flight-25907 flight-25912 flight-25913 flight-25914 flight-25915 flight-25917 flight-25918 flight-25919 flight-25920 flight-25921 flight-25923 flight-25924 flight-25926 flight-25927 flight-25930 flight-25931 flight-25933 flight-25934 flight-25936 flight-25938 flight-25939 flight-25941 flight-25942 flight-25944 flight-25945 flight-25947 flight-25948
Ian Jackson [Wed, 9 Apr 2014 10:36:44 +0000 (11:36 +0100)]
ts-xen-build: bump "configure" timeout to 600s

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoiso_create_genisoimage: Honour $isotimeout flight-25827 flight-25835 flight-25841 flight-25851 flight-25857 flight-25863 flight-25864 flight-25865 flight-25866 flight-25867 flight-25868 flight-25874 flight-25875 flight-25876 flight-25878 flight-25879 flight-25880 flight-25881 flight-25882 flight-25883 flight-25884 flight-25885 flight-25887 flight-25888 flight-25889 flight-25891 flight-25892 flight-25893 flight-25894 flight-25895 flight-25896
Ian Jackson [Wed, 9 Apr 2014 10:20:22 +0000 (11:20 +0100)]
iso_create_genisoimage: Honour $isotimeout

Fixes regression introduced in 20387acf, where the newly-moved code
used a hardwired value of 60 rather than the parameter provided for
the purpose.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoSwitch back to genisoimage flight-25809 flight-25817 flight-25822
Wei Liu [Mon, 7 Apr 2014 11:34:41 +0000 (12:34 +0100)]
Switch back to genisoimage

Xorriso is too slow. This is a patch to modify all related sites to use
genisoimage.

This effectively reverts the introduction of iso_create_xorriso and
introduces iso_create_genisoimage.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
11 years agots-redhat-install: use double quote in paths
Wei Liu [Sat, 5 Apr 2014 19:01:26 +0000 (20:01 +0100)]
ts-redhat-install: use double quote in paths

Otherwise variables are not substituted.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
11 years agots-redhat-install: copy_iso_content_to_dir -> iso_copy_content_from_image
Wei Liu [Fri, 4 Apr 2014 10:31:13 +0000 (11:31 +0100)]
ts-redhat-install: copy_iso_content_to_dir -> iso_copy_content_from_image

I renamed the function and missed this callsite.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
11 years agomake-flight: OVMF test flight
Wei Liu [Fri, 21 Mar 2014 12:12:27 +0000 (12:12 +0000)]
make-flight: OVMF test flight

Output of following runes attached:
  ./standalone-reset
  ./mg-show-flight-runvars standalone | grep ovmf | sed 's/[ \t]*$//'

test-amd64-amd64-xl-qemuu-ovmf-amd64     all_hostflags             arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,hvm
test-amd64-i386-xl-qemuu-ovmf-amd64      all_hostflags             arch-i386,arch-xen-amd64,suite-wheezy,purpose-test,hvm
test-amd64-amd64-xl-qemuu-ovmf-amd64     arch                      amd64
test-amd64-i386-xl-qemuu-ovmf-amd64      arch                      i386
test-amd64-amd64-xl-qemuu-ovmf-amd64     buildjob                  build-amd64
test-amd64-i386-xl-qemuu-ovmf-amd64      buildjob                  build-i386
test-amd64-amd64-xl-qemuu-ovmf-amd64     device_model_version      qemu-xen
test-amd64-i386-xl-qemuu-ovmf-amd64      device_model_version      qemu-xen
build-amd64                              enable_ovmf               true
build-armhf                              enable_ovmf               true
build-i386                               enable_ovmf               true
test-amd64-amd64-xl-qemuu-ovmf-amd64     kernbuildjob              build-amd64-pvops
test-amd64-i386-xl-qemuu-ovmf-amd64      kernbuildjob              build-i386-pvops
test-amd64-amd64-xl-qemuu-ovmf-amd64     kernkind                  pvops
test-amd64-i386-xl-qemuu-ovmf-amd64      kernkind                  pvops
test-amd64-amd64-xl-qemuu-ovmf-amd64     ovmf_image                debian-7.2.0-amd64-CD-1.iso
test-amd64-i386-xl-qemuu-ovmf-amd64      ovmf_image                debian-7.2.0-amd64-CD-1.iso
test-amd64-amd64-xl-qemuu-ovmf-amd64     toolstack                 xl
test-amd64-i386-xl-qemuu-ovmf-amd64      toolstack                 xl
test-amd64-amd64-xl-qemuu-ovmf-amd64     xenbuildjob               build-amd64
test-amd64-i386-xl-qemuu-ovmf-amd64      xenbuildjob               build-amd64

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agosg-run-job: OVMF job
Wei Liu [Tue, 10 Dec 2013 11:56:41 +0000 (11:56 +0000)]
sg-run-job: OVMF job

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoIntroduce ts-debian-hvm-install
Wei Liu [Wed, 4 Dec 2013 17:19:32 +0000 (17:19 +0000)]
Introduce ts-debian-hvm-install

This is debian hvm guest test case. It resembles ts-redhat-install:
1. prepare a auto install CD
2. install debian hvm guest, currently using OVMF
3. test if the guest is up

The installtion CD is also bootable with seabios.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoDebian.pm: factor out preseed_base
Wei Liu [Wed, 11 Dec 2013 13:26:22 +0000 (13:26 +0000)]
Debian.pm: factor out preseed_base

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport.pm: introduce iso_copy_content_from_image
Wei Liu [Wed, 2 Apr 2014 18:04:59 +0000 (19:04 +0100)]
TestSupport.pm: introduce iso_copy_content_from_image

... which returns a string of commands to pass into target_cmd_root.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport.pm: introduce iso_gen_flags_basic
Wei Liu [Wed, 2 Apr 2014 18:01:39 +0000 (19:01 +0100)]
TestSupport.pm: introduce iso_gen_flags_basic

... which returns the flags that can be passed to xorriso to create a
bootable image (not EFI capable though).

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport.pm: introduce iso_create_empty
Wei Liu [Wed, 2 Apr 2014 17:58:01 +0000 (18:58 +0100)]
TestSupport.pm: introduce iso_create_empty

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-redhat-install: use $flight, $job and $gn when creating iso
Wei Liu [Fri, 21 Mar 2014 11:06:44 +0000 (11:06 +0000)]
ts-redhat-install: use $flight, $job and $gn when creating iso

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport.pm: introduce guest_create
Wei Liu [Wed, 2 Apr 2014 17:50:40 +0000 (18:50 +0100)]
TestSupport.pm: introduce guest_create

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport.pm: move rewrite_config_nocd to support library
Wei Liu [Wed, 2 Apr 2014 17:49:27 +0000 (18:49 +0100)]
TestSupport.pm: move rewrite_config_nocd to support library

... and rename it to guest_editconfig_nocd.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport.pm: introduce iso_create_xorriso
Wei Liu [Wed, 2 Apr 2014 17:21:22 +0000 (18:21 +0100)]
TestSupport.pm: introduce iso_create_xorriso

... and convert ts-redhat-install to make use of it.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport.pm: add bios option to guest config file
Wei Liu [Thu, 5 Dec 2013 11:16:21 +0000 (11:16 +0000)]
TestSupport.pm: add bios option to guest config file

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agomake-flight: really drop the stray xend test from 4.5 onwards flight-25795 flight-25801 flight-25802 flight-25803 flight-25804 flight-25805 flight-25807 flight-25808 flight-25810 flight-25811 flight-25812 flight-25813 flight-25814 flight-25815 flight-25816 flight-25818 flight-25819 flight-25820 flight-25821 flight-25823 flight-25824 flight-25825 flight-25826 flight-25828 flight-25829 flight-25832 flight-25833 flight-25837 flight-25838 flight-25839 flight-25840 flight-25843 flight-25845 flight-25847 flight-25853 flight-25856 flight-25858 flight-25859
Ian Campbell [Fri, 4 Apr 2014 08:55:56 +0000 (09:55 +0100)]
make-flight: really drop the stray xend test from 4.5 onwards

The precedence rules meant the test was:
  ( xend enabled AND arch = i386 ) OR ( arch = amd64 )
rather than the intended:
  ( xend enabled ) AND ( arch = i386 OR arch = amd64 )

I've confirmed that a xen-instable flight no longer has test jobs with
toolstack == xend and that a Xen 4.4 flight is unchanged.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agostandalone-reset: fix typo
Wei Liu [Wed, 2 Apr 2014 19:12:30 +0000 (20:12 +0100)]
standalone-reset: fix typo

The script name is sa-init-db not sa-db-init.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agomake-flight: drop another stray xend test from 4.5 onwards flight-25731 flight-25736 flight-25741 flight-25742 flight-25744 flight-25745 flight-25746 flight-25748 flight-25749 flight-25750 flight-25751 flight-25752 flight-25753 flight-25754 flight-25756 flight-25757 flight-25758 flight-25760 flight-25762 flight-25763 flight-25764 flight-25765 flight-25766 flight-25767 flight-25768 flight-25770 flight-25771 flight-25772 flight-25773 flight-25775 flight-25776 flight-25777 flight-25778 flight-25779 flight-25781 flight-25783 flight-25785 flight-25789 flight-25790 flight-25791 flight-25792 flight-25793 flight-25794 flight-25796 flight-25797 flight-25798 flight-25799
Ian Campbell [Mon, 24 Mar 2014 11:50:11 +0000 (11:50 +0000)]
make-flight: drop another stray xend test from 4.5 onwards

I believe this configuration is covered for xl by the existing
test-amd64-i386-xl so test-amd64-i386-pv is dropped rather than replaced.

Changes for xen-4.4-testing flights:
$ diff -ub <(./mg-show-flight-runvars before44) <(./mg-show-flight-runvars after44)
$

Changes to unstable flights:
$ diff -ub <(./mg-show-flight-runvars beforeunstable) <(./mg-show-flight-runvars afterunstable) | grep -E '^[-+]'

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoCorrect crontab syntax to run most jobs at 30 minute intervals. flight-25691 flight-25699 flight-25700 flight-25701 flight-25702 flight-25703 flight-25704 flight-25705 flight-25706 flight-25707 flight-25708 flight-25709 flight-25710 flight-25711 flight-25712 flight-25713 flight-25714 flight-25715 flight-25716 flight-25717 flight-25718 flight-25719 flight-25720 flight-25721 flight-25722 flight-25723 flight-25724 flight-25725 flight-25726 flight-25727 flight-25728 flight-25729 flight-25730 flight-25732 flight-25733 flight-25734 flight-25735 flight-25737 flight-25738 flight-25739 flight-25740
Ian Campbell [Mon, 31 Mar 2014 11:01:22 +0000 (12:01 +0100)]
Correct crontab syntax to run most jobs at 30 minute intervals.

4/30 means 4-4/30, the correct (if counter intuitive) syntax is 4-59/30.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agostandalone mode convenience frontend flight-25616 flight-25618 flight-25619 flight-25620 flight-25621 flight-25622 flight-25623 flight-25624 flight-25625 flight-25626 flight-25627 flight-25628 flight-25629 flight-25630 flight-25631 flight-25632 flight-25633 flight-25634 flight-25635 flight-25636 flight-25637 flight-25638 flight-25639 flight-25640 flight-25641 flight-25642 flight-25643 flight-25644 flight-25645 flight-25646 flight-25647 flight-25648 flight-25649 flight-25650 flight-25651 flight-25652 flight-25653 flight-25655 flight-25656 flight-25657 flight-25658 flight-25659 flight-25660 flight-25661 flight-25662 flight-25663 flight-25665 flight-25666 flight-25667 flight-25668 flight-25669 flight-25670 flight-25671 flight-25672 flight-25673 flight-25675 flight-25676 flight-25677 flight-25678 flight-25679 flight-25680 flight-25681 flight-25682 flight-25683 flight-25684 flight-25685 flight-25686 flight-25687 flight-25689 flight-25690 flight-25692 flight-25693 flight-25694 flight-25695 flight-25696 flight-25697 flight-25698
Ian Campbell [Fri, 21 Mar 2014 09:58:00 +0000 (09:58 +0000)]
standalone mode convenience frontend

I can never remember all the various env vars which I can/should set so this
tool provides a command line veneer over the basics.

It also does some sanity checks for things which keep tripping me up
(inability to read apache logs, lack of ssh-agent) which fail in more or less
obscure ways.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
[ijc -- remove stray debug comment]

11 years agostandalone: refactor out some useful bits of standalone-reset
Ian Campbell [Fri, 21 Mar 2014 09:57:59 +0000 (09:57 +0000)]
standalone: refactor out some useful bits of standalone-reset

I sometimes want just these bits.

I went with a new "sa" prefix, but I left standalone-reset alone since it is
already reasonably well known.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-xen-build: Drop ability to build kernels
Ian Campbell [Thu, 20 Mar 2014 15:56:28 +0000 (15:56 +0000)]
ts-xen-build: Drop ability to build kernels

These are now all handled by ts-kernel-build.

We continue to specify KERNELS='' so that when building ancient versions of
Xen they won't try and build anything.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoUse ts-kernel-build for build-*-oldkern
Ian Campbell [Thu, 20 Mar 2014 15:56:27 +0000 (15:56 +0000)]
Use ts-kernel-build for build-*-oldkern

instead of using the kernel build integration in xen.git, which is going away.

There is no difference to the .config produced. No test jobs seem to rely on
these kernels so I have not worried about making the contents of dist be
identical (specifically the filenames under /boot have lost their -xen suffix)

Remove the now unused xen and qemu(u) tree/revision stuff from the jobs'
runvars. Add the appropriate kconfighow and kimagefile runvars and implement
an appropriate kconfighow handler to use the create_config.sh present in this
tree (the xen.git intergration called the same script)

If the 2.6.18 build starts to fail, xen-unstable pushes will be broken
until they are fixed, as before.  Previously such a build failure might be due
to changes in xen.git so that was slightly justifiable.  But in practice this
is quite rare.  This situation, while anomalous, is tolerable.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoimport enable-xen-config from xen.git, use for ts-kernel-build
Ian Campbell [Thu, 20 Mar 2014 15:56:26 +0000 (15:56 +0000)]
import enable-xen-config from xen.git, use for ts-kernel-build

I plan to remove it from xen.git. Take the version from a03984e7bcdf which
hasn't changed since 8dedf6431393 in 2010.

Update ts-kernel-build to not require xen.git.

config_intree_buildconfigs was unused so remove it.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
[ijc -- reduce timeout to 100, wrap log line]

11 years agomfi-common: remove xen_kernels runvar from build-*-pvops
Ian Campbell [Thu, 20 Mar 2014 15:56:25 +0000 (15:56 +0000)]
mfi-common: remove xen_kernels runvar from build-*-pvops

ts-kernel-build does not use this.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoCapture "lspci -vvv" and "lspci -tv" output.
Ian Campbell [Thu, 20 Mar 2014 10:49:07 +0000 (10:49 +0000)]
Capture "lspci -vvv" and "lspci -tv" output.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
[ijc -- added "lspci -tv" and adjusted changelog to match]

11 years agomake-flight: only test xl in unstable
Ian Campbell [Wed, 12 Mar 2014 16:47:44 +0000 (16:47 +0000)]
make-flight: only test xl in unstable

xend has been deprecated for enough releases now, lets focus on xl and/or make
space to add libvirt tests.

I have verified that a xen-4.4-testing flight does not change, while a
xen-unstable flight changes in the following expected ways:
  - build-.*-xend jobs are dropped
  - test-.*-xend-.* jobs become test-.*-xl-.*, the corresponding toolstack
    runvar changes to xl and the buildjob runvar loses its -xen suffix. This
    affects:
     - test-amd64-i386-xend-qemut-winxpsp3
     - test-amd64-i386-xend-winxpsp3
  - a new job test-amd64-i386-xl-qemuu-winxpsp3 is added, previously the
    non-sensical test-amd64-i386-xend-qemuu-winxpsp3 was suppressed by
    job_create_test_filter_callback.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoRevert "allow.all: Tolerate all build-*-oldkern failures" flight-25609 flight-25610 flight-25612 flight-25613 flight-25614 flight-25615 flight-25617
Ian Jackson [Wed, 19 Mar 2014 15:20:38 +0000 (15:20 +0000)]
Revert "allow.all: Tolerate all build-*-oldkern failures"

The network braindamage has been worked around in the firewall.

This reverts commit b4fdc54eac9ed82e0e056573a11f3ad106f97c67.

11 years agoAllow per-host TFTP setup flight-25569 flight-25574 flight-25594 flight-25607 flight-25608 flight-25611
Ian Campbell [Tue, 18 Mar 2014 14:56:51 +0000 (14:56 +0000)]
Allow per-host TFTP setup

I run osstest against machines which are in both the XenServer and XenClient
administrative domains, and hence which have different TFTP servers, accessible
locally via different NFS mounted paths.

Make it possible to specify various bits of TFTP path via ~/.xen-osstest/config
by introducing the idea of Tftp "scope" and allowing that to be configurable on
a per-host basis. For example I have:
  TftpDefaultScope xenserver

  TftpPath_xenserver /usr/groups/netboot/
  TftpPxeDir_xenserver pxelinux.cfg/

  TftpPath_xenclient /home/xc_tftpboot/pxe/
  TftpPxeDir_xenclient /
  TftpPxeTemplates_xenclient %ipaddrhex%/pxelinux.cfg

  HostProp_marilith-n4_TftpScope xenclient

and I am now able to install on both cam-st16 (a xenserver world test box) and
marilith-n4 (an osstest machine hosted in the xenclient network) without
messing around with my configuration every time. I ran build-$ARCH,
build-$ARCH-pvops and test-$ARCH-$ARCH-xl in both cases.

Per-host Tftp settings are now in the $ho->{Tftp} hash instead of in $c.

$c{TftpHost} is unused -- remove the setting of its default.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoDebian: die if we are unable to find the override kernel deb
Ian Campbell [Tue, 18 Mar 2014 10:22:56 +0000 (10:22 +0000)]
Debian: die if we are unable to find the override kernel deb

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agostandalone: add blessing to flights table.
Ian Campbell [Wed, 22 Jan 2014 16:39:28 +0000 (16:39 +0000)]
standalone: add blessing to flights table.

sg-check-tested wants this to exist.

I haven't implemented Osstest/JobDB/Standalone::job_ensure_started, which
should transition from 'contructing' to 'running' because I'm not hitting that
path.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agocri-args-hostlists: Allow environment to control OSSTEST_CONFIG
Ian Campbell [Wed, 22 Jan 2014 16:39:23 +0000 (16:39 +0000)]
cri-args-hostlists: Allow environment to control OSSTEST_CONFIG

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport: Don't use git proxy for non-git:// or http urls.
Ian Campbell [Mon, 17 Mar 2014 14:58:59 +0000 (14:58 +0000)]
TestSupport: Don't use git proxy for non-git:// or http urls.

After this I was stymied by ssh host keys and other roadblocks and just pushed
the branch to my xenbits tree but I think this is still correct as far as it
goes.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoAllow forcing the use of current osstest HEAD for branch=osstest flight-25561 flight-25563 flight-25564 flight-25565 flight-25566 flight-25567 flight-25568 flight-25570 flight-25571
Ian Campbell [Tue, 11 Feb 2014 13:31:43 +0000 (13:31 +0000)]
Allow forcing the use of current osstest HEAD for branch=osstest

Otherwise cr-daily-branch expects $HOME/testing.git to exist and will
git-reset it etc, which is rather annoying when in standalone mode...

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-hosts-allocate-Standalone: abort if the host to use has changed
Ian Campbell [Wed, 12 Feb 2014 11:10:51 +0000 (11:10 +0000)]
ts-hosts-allocate-Standalone: abort if the host to use has changed

When a job has been run once then the selected host is stored in a runvar and
used from then on. This means that if you try to run on a different host (by
changing the config or by changing OSSTEST_HOST_HOST) then you may be
surprised when things happen to the original host and not the new one.

Abort when this is detected.

Changing host requires you to run:
    ./cs-adjust-flight -v $flight runvar-del $job host
$flight = standalone by default
$job = test-x-y-z or build-x etc
host = the literal string host (not either of the host names)

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agocs-adjust-flight: fix runvar-del
Ian Campbell [Tue, 11 Feb 2014 16:49:29 +0000 (16:49 +0000)]
cs-adjust-flight: fix runvar-del

Missing $.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agocr-daily-branch: Make it possible to suppress the forcing of a baseline test
Ian Campbell [Mon, 10 Feb 2014 13:36:10 +0000 (13:36 +0000)]
cr-daily-branch: Make it possible to suppress the forcing of a baseline test

This is undesirable (most of the time) in a standalone environment, where you
are most likely to be interested in the current version and not historical
comparissons.

Not sure there isn't a better way.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoCXFabric: Use a vif script hook to (de)register guest mac address flight-25361 flight-25366 flight-25371 flight-25372 flight-25373 flight-25374 flight-25375 flight-25376 flight-25377 flight-25378 flight-25379 flight-25380 flight-25381 flight-25382 flight-25383 flight-25384 flight-25385 flight-25386 flight-25387 flight-25388 flight-25389 flight-25390 flight-25391 flight-25392 flight-25393 flight-25394 flight-25395 flight-25396 flight-25397 flight-25398 flight-25399 flight-25400 flight-25401 flight-25402 flight-25403 flight-25404 flight-25405 flight-25406 flight-25410 flight-25411 flight-25413 flight-25454 flight-25476 flight-25477 flight-25478 flight-25479 flight-25480 flight-25481 flight-25482 flight-25483 flight-25484 flight-25485 flight-25486 flight-25487 flight-25488 flight-25489 flight-25490 flight-25491 flight-25492 flight-25493 flight-25494 flight-25495 flight-25496 flight-25497 flight-25498 flight-25499 flight-25500 flight-25501 flight-25502 flight-25503 flight-25504 flight-25505 flight-25506 flight-25542 flight-25543 flight-25544 flight-25545 flight-25546 flight-25547 flight-25548 flight-25549 flight-25550 flight-25551 flight-25552 flight-25553 flight-25554 flight-25555 flight-25556 flight-25557 flight-25558 flight-25559 flight-25560 flight-25562
Ian Campbell [Thu, 6 Mar 2014 14:12:45 +0000 (14:12 +0000)]
CXFabric: Use a vif script hook to (de)register guest mac address

Since mac table is apparently small this avoids filling it with mac addresses
which may never get used.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agoRevert "CXFabric: Register more MAC addresses with the fabric"
Ian Jackson [Thu, 6 Mar 2014 12:36:23 +0000 (12:36 +0000)]
Revert "CXFabric: Register more MAC addresses with the fabric"

This reverts commit 9be39d3917d33abeba14f7f282e0b896ebc25ab7.

It turns out that the Calxeda fabric has a limit on the number of
addresses, which this exceeds.  For now, go back to 8.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agomg-allocate: allow alternatives flight-25355 flight-25356 flight-25358
Ian Jackson [Fri, 21 Feb 2014 15:34:24 +0000 (15:34 +0000)]
mg-allocate: allow alternatives

11 years agomg-allocate: fix typo in message
Ian Jackson [Fri, 21 Feb 2014 13:44:39 +0000 (13:44 +0000)]
mg-allocate: fix typo in message

11 years agots-hosts-allocate-Executive: Compress debug output
Ian Jackson [Fri, 21 Feb 2014 13:31:39 +0000 (13:31 +0000)]
ts-hosts-allocate-Executive: Compress debug output

Send the voluminous host allocation debug output to a compressed
logfile "hosts-allocate.debug.gz".  Also send a copy of the logm
output to the debug log, by manipulating $logm_handle.

Remove the bodge which unshifted -D onto the arguments, and then
parsed it.  Now the script takes no options.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoTestSupport: logm: allow $logm_handle to be an aref
Ian Jackson [Fri, 21 Feb 2014 13:30:29 +0000 (13:30 +0000)]
TestSupport: logm: allow $logm_handle to be an aref

If $logm_handle is an array reference, iterate over it.  This allows
calling code to duplicate the messages.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoExecutive: support DebugFh xparam to alloc_resources
Ian Jackson [Fri, 21 Feb 2014 13:27:49 +0000 (13:27 +0000)]
Executive: support DebugFh xparam to alloc_resources

This redirects some of the more verbose output (the json dumps)
elsewhere.  If DebugFh is not set, this output is suppressed.

ts-hosts-allocate-Executive provides DebugFh pointing to its DEBUG fh.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agostandalone-reset: actually honour '-f' option
Dario Faggioli [Wed, 29 Jan 2014 14:32:35 +0000 (14:32 +0000)]
standalone-reset: actually honour '-f' option

standalone-reset's usage says:

  usage: ./standalone-reset [<options>] [<branch> [<xenbranch> [<buildflight>]]]
   branch and xenbranch default, separately, to xen-unstable
  options:
   -f<flight>     generate flight "flight", default is "standalone"

but then there is no place where '-f' is processed, and hence
no real way to pass a specific flight name to make-flight.

Signed-off-by: Dario Faggioli <dario.faggioli@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoREADME: Add some core concepts and terminology
Ian Campbell [Mon, 20 Jan 2014 13:20:10 +0000 (13:20 +0000)]
README: Add some core concepts and terminology

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoCXFabric: Register more MAC addresses with the fabric flight-25346 flight-25347 flight-25348 flight-25349 flight-25350 flight-25351 flight-25352 flight-25353 flight-25354 flight-25357 flight-25359 flight-25360 flight-25362 flight-25363 flight-25364 flight-25365 flight-25367 flight-25368 flight-25369 flight-25370
Ian Campbell [Sun, 2 Mar 2014 10:22:44 +0000 (10:22 +0000)]
CXFabric: Register more MAC addresses with the fabric

I've seen 0x20 used in a single flight. Register up to 0x40.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agocr-for-branches: Branch for Xen 4.4 flight-25332 flight-25335 flight-25336 flight-25337 flight-25339 flight-25340 flight-25341 flight-25342 flight-25343 flight-25344 flight-25345
Ian Jackson [Fri, 21 Feb 2014 16:44:15 +0000 (16:44 +0000)]
cr-for-branches: Branch for Xen 4.4

Process the new branches xen-4.4-testing and qemu-upstream-4.4-testing.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agots-xen-build: Set LIBLEAFDIR_x86_64
Ian Jackson [Fri, 21 Feb 2014 18:27:12 +0000 (18:27 +0000)]
ts-xen-build: Set LIBLEAFDIR_x86_64

Xen 4.1 puts things in /usr/lib64 otherwise.  This is wrong for
Debian, and does not work at all on wheezy.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agots-kernel-build: Disable "Brocade BFA Fibre Channel Support"
Ian Campbell [Mon, 24 Feb 2014 09:50:57 +0000 (09:50 +0000)]
ts-kernel-build: Disable "Brocade BFA Fibre Channel Support"

This driver is broken on ARM:
    ERROR: "__bad_udelay" [drivers/scsi/bfa/bfa.ko] undefined!

I've taken the lazy way out and disabled it on all platforms. I think it isn't
especially likely that any of the current osstest hosts are using Fibre
Channel right now. The code to enable it came from a big batch addition of
drivers in 451f39c6149e.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoallow.all: Tolerate all build-*-oldkern failures flight-25323 flight-25328 flight-25333 flight-25334
Ian Jackson [Thu, 27 Feb 2014 15:00:11 +0000 (15:00 +0000)]
allow.all: Tolerate all build-*-oldkern failures

We are getting very many of these due to network braindamage.
For now, tolerate them.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoExecutive.pm: Change default ControlDaemonHost flight-25154 flight-25174 flight-25251 flight-25266 flight-25267 flight-25268 flight-25269 flight-25270 flight-25271 flight-25272 flight-25273 flight-25274 flight-25275 flight-25276 flight-25278 flight-25281 flight-25284 flight-25286 flight-25287 flight-25289 flight-25290 flight-25291 flight-25292 flight-25293 flight-25295 flight-25296 flight-25297 flight-25298 flight-25299 flight-25300 flight-25302 flight-25303 flight-25305 flight-25306 flight-25307 flight-25308 flight-25309 flight-25311 flight-25312 flight-25314 flight-25315 flight-25317 flight-25318 flight-25319 flight-25321 flight-25322 flight-25324 flight-25325 flight-25326 flight-25327 flight-25329 flight-25330 flight-25331
Ian Jackson [Tue, 18 Feb 2014 18:58:12 +0000 (18:58 +0000)]
Executive.pm: Change default ControlDaemonHost

We are going to move these daemons from woking to the new osstest VM.
So use a DNS alias for now.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoproduction-config: do not set WebspaceUrl, WebspaceFile
Ian Jackson [Fri, 14 Feb 2014 18:16:29 +0000 (18:16 +0000)]
production-config: do not set WebspaceUrl, WebspaceFile

The defaults,
    $c{WebspaceFile} ||= "$ENV{'HOME'}/public_html/";
    $c{WebspaceUrl} ||= "http://$myfqdn/~$whoami/";
are adequate.  This means the configuration can work on both
woking and the new osstest VM.

Signed-off-by: Ian Jackson <iwj@osstest.cam.xci-test.com>
11 years agoproduction-config: authorise iwj@osstest key
Ian Jackson [Tue, 18 Feb 2014 18:05:53 +0000 (18:05 +0000)]
production-config: authorise iwj@osstest key

Just like the iwj@woking key.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoreadglobalconfig: change default DhcpWatchMethod
Ian Jackson [Tue, 18 Feb 2014 18:05:32 +0000 (18:05 +0000)]
readglobalconfig: change default DhcpWatchMethod

Use the TCP connection to woking, so that it works after we switch
to the new osstest VM.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoproduction-config: use /home/xc_tftpboot, not /tftpboot
Ian Jackson [Fri, 14 Feb 2014 19:09:32 +0000 (19:09 +0000)]
production-config: use /home/xc_tftpboot, not /tftpboot

This is available on both woking and on the new osstest VM.

Signed-off-by: Ian Jackson <iwj@osstest.cam.xci-test.com>
11 years agogit: Use "git foo" rather than "git-foo"
Ian Jackson [Fri, 14 Feb 2014 16:08:00 +0000 (16:08 +0000)]
git: Use "git foo" rather than "git-foo"

All of our machines now have "git foo" and have done for some time,
and some are going to not have "git-foo".

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agots-xen-build: Apply python workaround in wheezy too flight-25147 flight-25151 flight-25152 flight-25153 flight-25155 flight-25156 flight-25157 flight-25159 flight-25161 flight-25162 flight-25163 flight-25164 flight-25165 flight-25205 flight-25210 flight-25221 flight-25223 flight-25229 flight-25237 flight-25248 flight-25253 flight-25254 flight-25255 flight-25256 flight-25258 flight-25259 flight-25260 flight-25262 flight-25265
Ian Jackson [Wed, 19 Feb 2014 15:58:20 +0000 (15:58 +0000)]
ts-xen-build: Apply python workaround in wheezy too

Debian #693721 is not yet fixed.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoDo not attempt migration tests if the platform doesn't support it flight-25125 flight-25130 flight-25138 flight-25139 flight-25140 flight-25142 flight-25143 flight-25144 flight-25145 flight-25146 flight-25148 flight-25149 flight-25150
Ian Campbell [Wed, 12 Feb 2014 14:27:56 +0000 (14:27 +0000)]
Do not attempt migration tests if the platform doesn't support it

Doing so blocks the rest of the tests in the job, which may be able to
indepentently complete. So arrange for a ts-migrate-support-check test to run
and gate the remaining migration tests on that.

This relies on the xen patch "xl: suppress suspend/resume functions on
platforms which do not support it" to actually suppress migration support on
arm.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
This needs to go in after the Xen patch. Otherwise this new step will appear to
pass and then start to fail when the Xen patch is applied.

11 years agoConfigure the Calxeda fabric on host boot
Ian Campbell [Wed, 12 Feb 2014 10:30:49 +0000 (10:30 +0000)]
Configure the Calxeda fabric on host boot

The fabric on the Calxeda midway boxes (marilith-* in osstest) does not learn
mac address (at least not with the firmware we have, and with Calxeda folding
this seems unlikely to get fixed). This means that guests do not get network
connectivity unless their mac addresses explicitly registered with the fabric.

Registrations can be done with the bridge(8) tool from the iproute2 package
which unfortunately is only present in Jessie+ and not in Wheezy. So I have
done my own backport and placed it in $images/wheezy-iproute2 and arranged for
it to be installed along with the transitional iproute package (from the same
source) which is needed to satisfy various dependencies.

The registrations are ephemeral and need to be renewed on each reboot, so add
the necessary commands to rc.local during ts-xen-install.

This required leaking a certain amount of the implementation of select_ether.
Unless we want to do the bodge on every ts-guest-start, reboot, migrate etc
then this seems to be the best way.

test-armhf-armhf-xl now gets past ts-guest-start and as far as the migration
tests.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
v2: hardcode 8 mac addresses and gate on equiv-marilith host flag
    simplify code to install iproute debs

11 years agofreebsd: switch to 10.0-RELEASE (20140116-r260789) flight-24886 flight-24902 flight-24919 flight-25005 flight-25043 flight-25069 flight-25106 flight-25111 flight-25115 flight-25121 flight-25122 flight-25126 flight-25127 flight-25128 flight-25131 flight-25132 flight-25133 flight-25134 flight-25135 flight-25136 flight-25137
Ian Jackson [Mon, 10 Feb 2014 12:09:51 +0000 (12:09 +0000)]
freebsd: switch to 10.0-RELEASE (20140116-r260789)

11 years agomake-flight: abolish special-casing of suite for armhf flight-24866 flight-24872 flight-24873 flight-24874 flight-24875 flight-24876 flight-24877 flight-24878 flight-24879 flight-24880 flight-24881 flight-24882 flight-24883 flight-24884 flight-24885 flight-24887 flight-24888 flight-24900 flight-24901 flight-24903 flight-24904 flight-24905 flight-24906 flight-24907 flight-24908 flight-24909 flight-24910 flight-24911 flight-24912 flight-24913 flight-24914 flight-24915 flight-24916 flight-24917 flight-24918 flight-24925 flight-24973 flight-25009 flight-25011 flight-25013 flight-25035 flight-25048 flight-25054 flight-25060 flight-25061 flight-25092 flight-25094 flight-25101 flight-25102 flight-25103 flight-25104 flight-25107 flight-25108 flight-25109 flight-25112 flight-25114 flight-25116 flight-25117 flight-25118 flight-25119 flight-25120
Ian Jackson [Thu, 12 Dec 2013 12:08:31 +0000 (12:08 +0000)]
make-flight: abolish special-casing of suite for armhf

Since the suite is now wheezy by default this is no longer needed.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoDebian: Switch to wheezy
Ian Jackson [Mon, 18 Nov 2013 16:04:45 +0000 (16:04 +0000)]
Debian: Switch to wheezy

This involves updating the d-i version too.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-guests-nbd-mirror: set "oldstyle=true" flight-24856 flight-24861 flight-24862 flight-24863 flight-24864 flight-24865 flight-24867 flight-24868 flight-24869 flight-24870
Ian Jackson [Mon, 10 Feb 2014 16:40:37 +0000 (16:40 +0000)]
ts-guests-nbd-mirror: set "oldstyle=true"

Newer NBDs (wheezy's and later) need a config option to say we're
using the old-style port-based addressing.  At some point we will
probably switch to using the new-style addressing, but not yet.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-guests-nbd-mirror: add checkaccessible test
Ian Jackson [Mon, 10 Feb 2014 16:40:22 +0000 (16:40 +0000)]
ts-guests-nbd-mirror: add checkaccessible test

If the NBD devices are not properly accessible on the client, bomb out
here rather than futilely starting a guest, and then timing out when
the guest fails to boot because it can't find its root fs.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-guests-nbd-mirror: purge old packages first
Ian Jackson [Mon, 10 Feb 2014 16:39:37 +0000 (16:39 +0000)]
ts-guests-nbd-mirror: purge old packages first

Purge any old nbd-client and nbd-server _before_ we make their config.

This only has any effect if the packages are installed before this
script starts, which isn't the case in any of the automatically-run
recipes.  But it can occur when the script is being tested by hand.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport: Suppress prompting by apt
Ian Jackson [Mon, 10 Feb 2014 16:38:57 +0000 (16:38 +0000)]
TestSupport: Suppress prompting by apt

Always set DEBIAN_PRIORITY=critical UCF_FORCE_CONFFOLD=y in
environment of apt, to suppress some prompts.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agoTestSupport: break out target_run_apt
Ian Jackson [Mon, 10 Feb 2014 16:34:52 +0000 (16:34 +0000)]
TestSupport: break out target_run_apt

We are going to add some environment variables to the apt invocation,
so centralise where this happens.  No functional change.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-xen-install: default the interface to the one in /etc/network/interfaces
Ian Jackson [Thu, 23 Jan 2014 18:30:47 +0000 (18:30 +0000)]
ts-xen-install: default the interface to the one in /etc/network/interfaces

The default was simply eth0.  This is the other piece of automatically
coping with the boot interface not being eth0.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-xen-install: nodhcp: restructure
Ian Jackson [Thu, 23 Jan 2014 17:50:02 +0000 (17:50 +0000)]
ts-xen-install: nodhcp: restructure

Move target_editfile_root to contain all the meat of the function.
This is useful because we're going to possibly want to read the input
interfaces file twice.

No functional change.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-host-install: set `IPAPPEND 2' (if interface isn't forced)
Ian Jackson [Thu, 23 Jan 2014 16:33:44 +0000 (16:33 +0000)]
ts-host-install: set `IPAPPEND 2' (if interface isn't forced)

This causes BOOTIF=<mac-address> to appear on command line.  This
makes d-i use that interface.  (See also Debian #615600.)

This is a better approach to interface name instability than setting
the force interface host property.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-kernel-build: force CONFIG_BLK_DEV_NBD=y
Ian Jackson [Thu, 23 Jan 2014 11:29:52 +0000 (11:29 +0000)]
ts-kernel-build: force CONFIG_BLK_DEV_NBD=y

Otherwise, with wheezy and Linux 3.4.77:

Jan 23 04:36:42 lake-frog nbd_client[4274]: Cannot open NBD: No such file or directory#012Please ensure the nbd module is loaded.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-xen-build-prep: avoid lvextend segfault (Debian #736173) with wheezy
Ian Jackson [Tue, 21 Jan 2014 18:53:13 +0000 (18:53 +0000)]
ts-xen-build-prep: avoid lvextend segfault (Debian #736173) with wheezy

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agocr-daily-branch: make sure we test the correct tree for Linux branches flight-24847 flight-24850 flight-24853 flight-24855 flight-24857 flight-24858 flight-24859 flight-24860
Ian Campbell [Tue, 11 Feb 2014 12:30:21 +0000 (12:30 +0000)]
cr-daily-branch: make sure we test the correct tree for Linux branches

These branches should test the specific Linux tree which they and so should
not apply the per-arch overrides which are only intended to be used to pick up
an already verified tested Linux branch for use when testing some other
non-linux branch.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agots-kernel-build: make sure CONFIG_PACKET is enabled flight-24791 flight-24798 flight-24806 flight-24807 flight-24808 flight-24809 flight-24811 flight-24812 flight-24813 flight-24816 flight-24817 flight-24818 flight-24819 flight-24821 flight-24830 flight-24839 flight-24841 flight-24846 flight-24848 flight-24849 flight-24851 flight-24852 flight-24854
Ian Campbell [Fri, 7 Feb 2014 09:57:22 +0000 (09:57 +0000)]
ts-kernel-build: make sure CONFIG_PACKET is enabled

It is required by the dhcp client and is not present in the arm
multi_v7_defconfig.

Also stash the config file in the build results for easy reference, it is
already in kerndist.tar.gz but that's a 30+M download compared with a few tens
of K.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agocr-daily-branch: Limit "people who touched" listing flight-24745 flight-24754 flight-24755 flight-24756 flight-24757 flight-24758 flight-24759 flight-24760 flight-24761 flight-24762 flight-24763 flight-24764 flight-24765 flight-24766 flight-24767 flight-24770 flight-24771 flight-24772 flight-24774 flight-24775 flight-24777 flight-24778 flight-24779 flight-24780 flight-24781 flight-24782 flight-24783 flight-24784 flight-24785 flight-24786 flight-24787 flight-24788 flight-24789 flight-24790 flight-24792 flight-24793 flight-24796 flight-24797 flight-24799 flight-24800 flight-24801 flight-24802 flight-24803 flight-24804
Ian Jackson [Wed, 5 Feb 2014 16:55:51 +0000 (16:55 +0000)]
cr-daily-branch: Limit "people who touched" listing

Sometimes this can be very large, which can result in the results
postings getting discarded.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
11 years agoEnable armhf tests for linux-linus branch flight-24735 flight-24738 flight-24740 flight-24741
Ian Campbell [Wed, 5 Feb 2014 16:46:19 +0000 (16:46 +0000)]
Enable armhf tests for linux-linus branch

Rather than whitelisting interesting branches, instead blacklist the hisotrical
branches which are not interesting to armhf, ensuring that any new branches
will pick up armhf automatically.

This creates the expected build-armhf, build-armhf-pvops and
test-armhf-armhf-xl jobs for the linux-linus branch.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
11 years agomake-flight: refactor test_matrix_do_one flight-24468 flight-24472 flight-24475 flight-24476 flight-24477 flight-24478 flight-24479 flight-24480 flight-24482 flight-24483 flight-24484 flight-24485 flight-24486 flight-24487 flight-24488 flight-24489 flight-24490 flight-24491 flight-24492 flight-24493 flight-24494 flight-24495 flight-24496 flight-24497 flight-24498 flight-24500 flight-24501 flight-24502 flight-24503 flight-24504 flight-24505 flight-24506 flight-24507 flight-24508 flight-24509 flight-24511 flight-24512 flight-24513 flight-24515 flight-24516 flight-24517 flight-24519 flight-24520 flight-24522 flight-24523 flight-24524 flight-24525 flight-24526 flight-24527 flight-24528 flight-24529 flight-24531 flight-24532 flight-24533 flight-24535 flight-24536 flight-24537 flight-24538 flight-24540 flight-24542 flight-24544 flight-24546 flight-24553 flight-24568 flight-24569 flight-24570 flight-24571 flight-24572 flight-24589 flight-24590 flight-24591 flight-24592 flight-24593 flight-24594 flight-24595 flight-24596 flight-24597 flight-24598 flight-24599 flight-24603 flight-24604 flight-24605 flight-24608 flight-24609 flight-24610 flight-24611 flight-24612 flight-24613 flight-24616 flight-24617 flight-24618 flight-24622 flight-24627 flight-24628 flight-24629 flight-24630 flight-24632 flight-24634 flight-24635 flight-24637 flight-24639 flight-24640 flight-24641 flight-24643 flight-24644 flight-24647 flight-24648 flight-24649 flight-24650 flight-24651 flight-24652 flight-24653 flight-24654 flight-24655 flight-24656 flight-24660 flight-24661 flight-24662 flight-24663 flight-24664 flight-24665 flight-24666 flight-24667 flight-24668 flight-24669 flight-24670 flight-24671 flight-24672 flight-24673 flight-24674 flight-24675 flight-24676 flight-24677 flight-24678 flight-24679 flight-24680 flight-24681 flight-24682 flight-24683 flight-24684 flight-24685 flight-24686 flight-24687 flight-24689 flight-24690 flight-24691 flight-24692 flight-24693 flight-24694 flight-24695 flight-24696 flight-24697 flight-24698 flight-24699 flight-24700 flight-24701 flight-24702 flight-24703 flight-24706 flight-24707 flight-24708 flight-24709 flight-24710 flight-24711 flight-24712 flight-24713 flight-24715 flight-24716 flight-24717 flight-24718 flight-24719 flight-24720 flight-24721 flight-24722 flight-24723 flight-24724 flight-24725 flight-24727 flight-24728 flight-24729 flight-24730 flight-24733 flight-24734 flight-24737 flight-24739 flight-24742 flight-24743 flight-24744 flight-24746 flight-24747 flight-24748 flight-24749 flight-24750 flight-24751 flight-24752
Ian Campbell [Tue, 21 Jan 2014 11:52:54 +0000 (11:52 +0000)]
make-flight: refactor test_matrix_do_one

Pull some test creation out into their own subdirectories. This allows the
total level of indentation to be reduced.

It also allows us to invert the pre-condition test and simply return at the
top of the subroutine, which further reduces indentation.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomfi-common: onetoolstack does not vary for a given $xenbranch
Ian Campbell [Mon, 20 Jan 2014 17:58:33 +0000 (17:58 +0000)]
mfi-common: onetoolstack does not vary for a given $xenbranch

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: Refactor test matrix iteration into mfi-common
Ian Campbell [Mon, 20 Jan 2014 17:56:28 +0000 (17:56 +0000)]
make-flight: Refactor test matrix iteration into mfi-common

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: reduce indentation in test_matrix_do_one
Ian Campbell [Mon, 20 Jan 2014 17:52:10 +0000 (17:52 +0000)]
make-flight: reduce indentation in test_matrix_do_one

Now that the body of the multiple nested loops is in a function it doesn't need
to be so deeply indented. This wasn't done in the previous patch for clarity.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: Separate matrix iteration from test job creation
Ian Campbell [Mon, 20 Jan 2014 17:48:35 +0000 (17:48 +0000)]
make-flight: Separate matrix iteration from test job creation

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: refactor test case filter over $branch
Ian Campbell [Mon, 20 Jan 2014 17:47:15 +0000 (17:47 +0000)]
make-flight: refactor test case filter over $branch

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: refactor job_create_test into mfi-common
Ian Campbell [Mon, 20 Jan 2014 17:20:57 +0000 (17:20 +0000)]
make-flight: refactor job_create_test into mfi-common

Now that it uses a callback it can trivially be moved to mfi-common

Arguably the setting of *buildjob could also be a callback, but my intended use
case doesn't need that and it seems reasonable enough for now that users of the
common job_create_test also use the common create_build_jobs (or produce
something sufficiently similar).

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: refactor job_create_test filters
Ian Campbell [Mon, 20 Jan 2014 17:18:22 +0000 (17:18 +0000)]
make-flight: refactor job_create_test filters

This will allow job_create_test to be moved mfi-common.

No (intentional) change to the set of jobs which are created.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
11 years agomake-flight: Remove md5sum based job filtering
Ian Campbell [Mon, 20 Jan 2014 16:48:11 +0000 (16:48 +0000)]
make-flight: Remove md5sum based job filtering

JOB_MD5_PATTERN was intended to allow making randomly smaller flights, but is
not used in practice.

The filtering of the qemmu*-win jobs was intended to reduce the number of
combinations but ended up suppressing only:
  test-amd64-i386-xl-qemuu-winxpsp3-vcpus1
  test-amd64-i386-xl-qemuu-win7-amd64

Both of which seem useful so allow them to be enabled.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>