]> xenbits.xensource.com Git - osstest.git/log
osstest.git
10 years agots-libvirt-build: use Osstest::BuildSupport::submodulefixup flight-33126 flight-33182 flight-33183 flight-33184 flight-33185 flight-33186 flight-33187 flight-33188 flight-33189 flight-33190 flight-33191 flight-33192 flight-33193
Ian Campbell [Mon, 5 Jan 2015 12:57:08 +0000 (12:57 +0000)]
ts-libvirt-build: use Osstest::BuildSupport::submodulefixup

Instead of cloning gnulib manually which can break if upstream gnulib
gets ahead of libvirt.git (which applies patches on the fly etc). By
using submodulefixup we automatically DTRT and use the version of
gnulib specified by the libvirt.git submodule metadata, but with a
runvar override if necessary.

This also removes a whole bunch of faffing in ap-*, cr-daily-branch
and mfi-common to get the version of gnulib to use, which was always a
bit of a wart (ungated for one thing...).

We continue to use --no-git and GNULIB_SRCDIR because otherwise
autogen.sh (via bootstrap) will force its own version, overwriting
what submodulefixup has done. For this we need a way to get the hash
representing the module, so introduce submodule_find (and rework
submodule_have in terms of it).

Tested in standalone mode with build-amd64-libvirt and
build-amd64-rumpuserxen (because I touched submodule_have, AFAICT the
bodges were not run). The libvirt build was tested both with the
automatic revisions and with:
    revision_libvirt=2360fe5d24175835d3f5fd1c7e8e6e13addab629
    revision_libvirt_gnulib=16518d9ed8f25d3e53931dd1aa343072933e4604
(used in successful libvirt flight 32648), in both cases confirming
that the build used the desired versions.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@citrix.com>
---
v2: Honour revision_libvirt_gnulib.
v3: Fix submodule_have, defined(&sub) is always true because defined
    is special wrt &sub.

10 years agoTftpDiVersion 2014-12-14 flight-32427 flight-32454 flight-32514 flight-32515 flight-32516 flight-32517 flight-32518 flight-32519 flight-32520 flight-32521 flight-32522 flight-32523 flight-32524 flight-32525 flight-32526 flight-32527 flight-32528 flight-32529 flight-32530 flight-32531 flight-32533 flight-32534 flight-32535 flight-32536 flight-32537 flight-32538 flight-32539 flight-32540 flight-32541 flight-32542 flight-32543 flight-32544 flight-32545 flight-32546 flight-32547 flight-32548 flight-32549 flight-32550 flight-32551 flight-32552 flight-32553 flight-32554 flight-32555 flight-32556 flight-32557 flight-32558 flight-32560 flight-32561 flight-32562 flight-32563 flight-32564 flight-32565 flight-32566 flight-32567 flight-32568 flight-32569 flight-32570 flight-32571 flight-32572 flight-32573 flight-32574 flight-32575 flight-32576 flight-32577 flight-32578 flight-32579 flight-32580 flight-32581 flight-32582 flight-32583 flight-32584 flight-32585 flight-32586 flight-32587 flight-32588 flight-32589 flight-32590 flight-32591 flight-32592 flight-32593 flight-32594 flight-32595 flight-32596 flight-32597 flight-32598 flight-32599 flight-32600 flight-32601 flight-32602 flight-32603 flight-32604 flight-32605 flight-32606 flight-32607 flight-32608 flight-32609 flight-32610 flight-32611 flight-32612 flight-32613 flight-32614 flight-32615 flight-32616 flight-32617 flight-32618 flight-32619 flight-32620 flight-32621 flight-32622 flight-32623 flight-32624 flight-32625 flight-32626 flight-32627 flight-32628 flight-32629 flight-32630 flight-32631 flight-32632 flight-32633 flight-32634 flight-32635 flight-32636 flight-32637 flight-32638 flight-32639 flight-32640 flight-32641 flight-32642 flight-32643 flight-32644 flight-32645 flight-32646 flight-32647 flight-32648 flight-32649 flight-32650 flight-32651 flight-32652 flight-32653 flight-32654 flight-32655 flight-32656 flight-32657 flight-32658 flight-32659 flight-32660 flight-32661 flight-32662 flight-32663 flight-32664 flight-32665 flight-32666 flight-32667 flight-32668 flight-32669 flight-32670 flight-32671 flight-32672 flight-32673 flight-32674 flight-32675 flight-32676 flight-32677 flight-32678 flight-32679 flight-32680 flight-32681 flight-32682 flight-32683 flight-32684 flight-32685 flight-32686 flight-32687 flight-32688 flight-32689 flight-32690 flight-32691 flight-32692 flight-32693 flight-32694 flight-32695 flight-32696 flight-32697 flight-32698 flight-32699 flight-32700 flight-32701 flight-32702 flight-32703 flight-32704 flight-32705 flight-32706 flight-32707 flight-32708 flight-32709 flight-32710 flight-32711 flight-32712 flight-32713 flight-32714 flight-32715 flight-32716 flight-32717 flight-32718 flight-32719 flight-32720 flight-32721 flight-32722 flight-32723 flight-32724 flight-32725 flight-32726 flight-32727 flight-32728 flight-32733 flight-32746 flight-32747 flight-32748 flight-32749 flight-32750 flight-32751 flight-32752 flight-32753 flight-32754 flight-32755 flight-32756 flight-32757 flight-32758 flight-32759 flight-32760 flight-32761 flight-32762 flight-32763 flight-32764 flight-32765 flight-32766 flight-32767 flight-32768 flight-32769 flight-32770 flight-32771 flight-32772 flight-32773 flight-32774 flight-32775 flight-32776 flight-32777 flight-32778 flight-32779 flight-32780 flight-32781 flight-32782 flight-32783 flight-32784 flight-32785 flight-32786 flight-32787 flight-32788 flight-32789 flight-32790 flight-32791 flight-32792 flight-32793 flight-32794 flight-32795 flight-32796 flight-32797 flight-32798 flight-32799 flight-32800 flight-32801 flight-32802 flight-32803 flight-32804 flight-32805 flight-32806 flight-32807 flight-32808 flight-32809 flight-32810 flight-32811 flight-32812 flight-32813 flight-32814 flight-32815 flight-32816 flight-32817 flight-32818 flight-32819 flight-32820 flight-32821 flight-32822 flight-32823 flight-32824 flight-32825 flight-32826 flight-32827 flight-32828 flight-32829 flight-32830 flight-32831 flight-32832 flight-32833 flight-32834 flight-32835 flight-32836 flight-32837 flight-32838 flight-32839 flight-32840 flight-32841 flight-32842 flight-32843 flight-32844 flight-32845 flight-32846 flight-32847 flight-32848 flight-32849 flight-32850 flight-32851 flight-32852 flight-32853 flight-32854 flight-32855 flight-32856 flight-32857 flight-32858 flight-32859 flight-32860 flight-32861 flight-32862 flight-32864 flight-32865 flight-32866 flight-32867 flight-32868 flight-32869 flight-32870 flight-32871 flight-32872 flight-32873 flight-32874 flight-32875 flight-32876 flight-32877 flight-32878 flight-32879 flight-32880 flight-32881 flight-32882 flight-32883 flight-32884 flight-32885 flight-32886 flight-32887 flight-32888 flight-32889 flight-32890 flight-32891 flight-32892 flight-32893 flight-32894 flight-32895 flight-32896 flight-32897 flight-32898 flight-32899 flight-32900 flight-32901 flight-32902 flight-32903 flight-32904 flight-32905 flight-32906 flight-32907 flight-32908 flight-32909 flight-32910 flight-32911 flight-32912 flight-32913 flight-32914 flight-32915 flight-32916 flight-32917 flight-32918 flight-32919 flight-32920 flight-32921 flight-32922 flight-32923 flight-32924 flight-32925 flight-32926 flight-32927 flight-32928 flight-32929 flight-32930 flight-32931 flight-32932 flight-32933 flight-32934 flight-32935 flight-32936 flight-32937 flight-32938 flight-32939 flight-32940 flight-32941 flight-32942 flight-32943 flight-32944 flight-32945 flight-32946 flight-32947 flight-32948 flight-32949 flight-32950 flight-32951 flight-32952 flight-32953 flight-32954 flight-32955 flight-32956 flight-32957 flight-32958 flight-32959 flight-32960 flight-32961 flight-32962 flight-32963 flight-32964 flight-32965 flight-32966 flight-32967 flight-32968 flight-32969 flight-32970 flight-32971 flight-32972 flight-32973 flight-32974 flight-32975 flight-32976 flight-32977 flight-32978 flight-32979 flight-32980 flight-32981 flight-32982 flight-32983 flight-32984 flight-32985 flight-32986 flight-32987 flight-32988 flight-32989 flight-32990 flight-32991 flight-32992 flight-32993 flight-32994 flight-32995 flight-32996 flight-32997 flight-32998 flight-32999 flight-33000 flight-33001 flight-33002 flight-33003 flight-33004 flight-33005 flight-33006 flight-33007 flight-33008 flight-33009 flight-33010 flight-33011 flight-33012 flight-33013 flight-33014 flight-33015 flight-33016 flight-33017 flight-33018 flight-33019 flight-33020 flight-33021 flight-33022 flight-33023 flight-33024 flight-33025 flight-33026 flight-33027 flight-33028 flight-33029 flight-33030 flight-33031 flight-33032 flight-33033 flight-33034 flight-33035 flight-33036 flight-33037 flight-33038 flight-33039 flight-33040 flight-33041 flight-33042 flight-33043 flight-33044 flight-33045 flight-33046 flight-33047 flight-33048 flight-33049 flight-33050 flight-33051 flight-33052 flight-33053 flight-33054 flight-33055 flight-33056 flight-33057 flight-33058 flight-33059 flight-33060 flight-33061 flight-33062 flight-33063 flight-33064 flight-33065 flight-33066 flight-33067 flight-33068 flight-33069 flight-33070 flight-33071 flight-33072 flight-33073 flight-33074 flight-33075 flight-33076 flight-33077 flight-33078 flight-33079 flight-33080 flight-33081 flight-33082 flight-33083 flight-33084 flight-33085 flight-33086 flight-33087 flight-33088 flight-33089 flight-33090 flight-33091 flight-33092 flight-33093 flight-33094 flight-33095 flight-33096 flight-33097 flight-33098 flight-33099 flight-33100 flight-33101 flight-33102 flight-33103 flight-33104 flight-33105 flight-33106 flight-33107 flight-33108 flight-33109 flight-33110 flight-33111 flight-33112 flight-33113 flight-33114 flight-33115 flight-33116 flight-33117 flight-33118 flight-33119 flight-33120 flight-33121 flight-33122 flight-33123 flight-33124 flight-33125 flight-33127 flight-33128 flight-33129 flight-33130 flight-33131 flight-33132 flight-33133 flight-33134 flight-33135 flight-33136 flight-33137 flight-33138 flight-33139 flight-33140 flight-33141 flight-33142 flight-33143 flight-33144 flight-33145 flight-33146 flight-33147 flight-33148 flight-33149 flight-33150 flight-33151 flight-33152 flight-33153 flight-33154 flight-33155 flight-33156 flight-33157 flight-33158 flight-33159 flight-33160 flight-33161 flight-33162 flight-33163 flight-33164 flight-33165 flight-33166 flight-33167 flight-33168 flight-33169 flight-33170 flight-33171 flight-33172 flight-33173 flight-33174 flight-33175 flight-33176 flight-33177 flight-33178 flight-33179 flight-33180 flight-33181
Ian Campbell [Sun, 14 Dec 2014 19:18:38 +0000 (19:18 +0000)]
TftpDiVersion 2014-12-14

Picks up changes on armhf to include dtbs and more modules in the initrd
overlay.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
10 years agoAdd basic PVH flights. flight-32331 flight-32346 flight-32367 flight-32388 flight-32416 flight-32421 flight-32422 flight-32423 flight-32424 flight-32425 flight-32426 flight-32428 flight-32429 flight-32430 flight-32431 flight-32432 flight-32433 flight-32434 flight-32435 flight-32436 flight-32437 flight-32438 flight-32439 flight-32440 flight-32441 flight-32442 flight-32443 flight-32444 flight-32445 flight-32446 flight-32447 flight-32448 flight-32449 flight-32450 flight-32451 flight-32452 flight-32453 flight-32455 flight-32456 flight-32457 flight-32458 flight-32459 flight-32460 flight-32461 flight-32462 flight-32463 flight-32464 flight-32465 flight-32466 flight-32467 flight-32468 flight-32469 flight-32470 flight-32471 flight-32472 flight-32473 flight-32474 flight-32475 flight-32476 flight-32477 flight-32478 flight-32479 flight-32480 flight-32481 flight-32482 flight-32483 flight-32484 flight-32485 flight-32486 flight-32487 flight-32488 flight-32489 flight-32490 flight-32491 flight-32492 flight-32493 flight-32494 flight-32495 flight-32496 flight-32497 flight-32498 flight-32499 flight-32500 flight-32501 flight-32502 flight-32503 flight-32504 flight-32506 flight-32507 flight-32508 flight-32509 flight-32510 flight-32512 flight-32513
Ian Campbell [Thu, 4 Dec 2014 09:58:34 +0000 (09:58 +0000)]
Add basic PVH flights.

These are the usual PV debian flights with pvh=1 added to the
configuration file.

A job is created for each of Intel and AMD, although obviously AMD is
expected to fail at the moment.

In my testing I got:
    (XEN) Attempt to create a PVH guest on a system without necessary hardware support
because my test box happens to be AMD.

I have confirmed that the pvh=1 option is correctly present in the
guest cfg for the new pvh job, and that no pvh= is present at all in
the existing test-amd64-amd64-xl job (which is expected and desired if
no pvh runvar is present).

Beyond that I've not tested this at all I fully expect even Intel to
fail in the first instance, due to issues such as lack of necessary
kernel options etc. I suggest to take this now and iterate on any
further changes.

For a xen-unstable flight this results in these runvars:
$ ./mg-show-flight-runvars pvh| grep -- -pvh | sort
test-amd64-amd64-xl-pvh-amd               all_hostflags               arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,hvm-amd
test-amd64-amd64-xl-pvh-amd               arch                        amd64
test-amd64-amd64-xl-pvh-amd               buildjob                    build-amd64
test-amd64-amd64-xl-pvh-amd               debian_arch                 amd64
test-amd64-amd64-xl-pvh-amd               debian_kernkind             pvops
test-amd64-amd64-xl-pvh-amd               debian_pvh                  1
test-amd64-amd64-xl-pvh-amd               kernbuildjob                build-amd64-pvops
test-amd64-amd64-xl-pvh-amd               kernkind                    pvops
test-amd64-amd64-xl-pvh-amd               toolstack                   xl
test-amd64-amd64-xl-pvh-amd               xenbuildjob                 build-amd64
test-amd64-amd64-xl-pvh-intel             all_hostflags               arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,hvm-intel
test-amd64-amd64-xl-pvh-intel             arch                        amd64
test-amd64-amd64-xl-pvh-intel             buildjob                    build-amd64
test-amd64-amd64-xl-pvh-intel             debian_arch                 amd64
test-amd64-amd64-xl-pvh-intel             debian_kernkind             pvops
test-amd64-amd64-xl-pvh-intel             debian_pvh                  1
test-amd64-amd64-xl-pvh-intel             kernbuildjob                build-amd64-pvops
test-amd64-amd64-xl-pvh-intel             kernkind                    pvops
test-amd64-amd64-xl-pvh-intel             toolstack                   xl
test-amd64-amd64-xl-pvh-intel             xenbuildjob                 build-amd64

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
v2: pvh\b.*.

10 years agoOsstest/Debian: Add support for "ExtraInitramfsModules" host property
Ian Campbell [Fri, 21 Nov 2014 13:16:58 +0000 (13:16 +0000)]
Osstest/Debian: Add support for "ExtraInitramfsModules" host property

The arndale platform needs a bunch of clk, phy and regulator stuff in order to
access its root filesystem. However mkinitramfs is not (currently?) able to
figure this out and therefore doesn't include them in the initrd. See
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=762042

Add a new host prop which can list these required additional module and
arranges for a suitable /etc/initramfs-tools/modules to be created on install.

Using the new HostGroupProp syntax the required modules are:

HostGroupProp_arndale_ExtraInitramfsModules clk-s2mps11 s5m8767 i2c-s3c2410 phy-exynos5250-sata

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agoOsstest/Debian: Refactor code to set bootargs in u-boot script
Ian Campbell [Fri, 21 Nov 2014 13:16:55 +0000 (13:16 +0000)]
Osstest/Debian: Refactor code to set bootargs in u-boot script

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agots-debian-install: rename cfg_xend to cfg
Wei Liu [Tue, 14 Oct 2014 21:50:08 +0000 (22:50 +0100)]
ts-debian-install: rename cfg_xend to cfg

... as this config file is just a config file in general, not strictly a
Xend format config file.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agogitignore: ignore images directory
Wei Liu [Tue, 14 Oct 2014 21:50:07 +0000 (22:50 +0100)]
gitignore: ignore images directory

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agoREADME: list chiark-utils-bin as requirement
Wei Liu [Tue, 14 Oct 2014 21:50:06 +0000 (22:50 +0100)]
README: list chiark-utils-bin as requirement

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agoTestSupport: allow overriding of on_* in prepareguest_part_xencfg
Ian Campbell [Mon, 1 Dec 2014 12:57:20 +0000 (12:57 +0000)]
TestSupport: allow overriding of on_* in prepareguest_part_xencfg

Currently only on_reboot can be overridden

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agoTestSupport: use timeout(1) flight-32167 flight-32235 flight-32307 flight-32332 flight-32333 flight-32334 flight-32335 flight-32336 flight-32337 flight-32338 flight-32339 flight-32340 flight-32341 flight-32342 flight-32343 flight-32344 flight-32345 flight-32347 flight-32348 flight-32349 flight-32350 flight-32351 flight-32352 flight-32353 flight-32354 flight-32355 flight-32356 flight-32357 flight-32358 flight-32359 flight-32360 flight-32361 flight-32362 flight-32363 flight-32364 flight-32365 flight-32366 flight-32368 flight-32369 flight-32370 flight-32371 flight-32372 flight-32373 flight-32374 flight-32375 flight-32376 flight-32377 flight-32378 flight-32379 flight-32380 flight-32381 flight-32383 flight-32384 flight-32385 flight-32386 flight-32387 flight-32389 flight-32390 flight-32391 flight-32392 flight-32393 flight-32394 flight-32395 flight-32396 flight-32397 flight-32398 flight-32399 flight-32400 flight-32401 flight-32402 flight-32403 flight-32404 flight-32405 flight-32406 flight-32407 flight-32408 flight-32409 flight-32410 flight-32411 flight-32412 flight-32413 flight-32414 flight-32415 flight-32417 flight-32418 flight-32419 flight-32420
Ian Jackson [Mon, 8 Dec 2014 12:10:24 +0000 (12:10 +0000)]
TestSupport: use timeout(1)

If a command we run times out, the machinery in cmd() will arrange
for the ts-* script to spot the timeout, and stop waiting for it.

However it is also necessary for the command we ran to die.  It has a
copy of the owner daemon fd, so if it doesn't, our resources won't get
freed.  In sufficiently exciting bugs, our allocation might continue
indefinitely, while a subprocess of ours hangs on after we are long
gone.

timeout(1) does not print a message when the process times out (!)  So
we can't do away with the logic in cmd().  We set the timeout(1)
timeout to 30s more than our own timeout, so that cmd() will time
out first and print a message.

We could use alarm(1) as we do in Osstest/Serial/sympathy.pm but that
program isn't packaged and its unsophisticated approach is not really
appropriate for arbitrary nonconsenting programs.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agoAdd simple helper to update DI for all architectures. flight-32111 flight-32136 flight-32137 flight-32138 flight-32139 flight-32140 flight-32141 flight-32142 flight-32143 flight-32144 flight-32145 flight-32146 flight-32147 flight-32148 flight-32149 flight-32150 flight-32151 flight-32152 flight-32153 flight-32154 flight-32155 flight-32156 flight-32157 flight-32161 flight-32162 flight-32163 flight-32164 flight-32165 flight-32166 flight-32168 flight-32169 flight-32170 flight-32171 flight-32172 flight-32173 flight-32175 flight-32176 flight-32177 flight-32178 flight-32179 flight-32180 flight-32181 flight-32182 flight-32183 flight-32184 flight-32185 flight-32186 flight-32187 flight-32188 flight-32189 flight-32190 flight-32191 flight-32192 flight-32193 flight-32194 flight-32195 flight-32196 flight-32197 flight-32198 flight-32199 flight-32200 flight-32201 flight-32202 flight-32203 flight-32204 flight-32205 flight-32206 flight-32207 flight-32208 flight-32209 flight-32210 flight-32211 flight-32212 flight-32213 flight-32214 flight-32215 flight-32216 flight-32217 flight-32218 flight-32219 flight-32220 flight-32221 flight-32222 flight-32223 flight-32224 flight-32225 flight-32226 flight-32227 flight-32228 flight-32229 flight-32230 flight-32231 flight-32232 flight-32233 flight-32234 flight-32236 flight-32237 flight-32238 flight-32239 flight-32240 flight-32241 flight-32242 flight-32243 flight-32244 flight-32245 flight-32246 flight-32247 flight-32248 flight-32249 flight-32250 flight-32251 flight-32252 flight-32253 flight-32254 flight-32255 flight-32256 flight-32257 flight-32258 flight-32259 flight-32260 flight-32261 flight-32262 flight-32263 flight-32264 flight-32265 flight-32266 flight-32267 flight-32268 flight-32270 flight-32271 flight-32272 flight-32273 flight-32274 flight-32275 flight-32276 flight-32277 flight-32278 flight-32279 flight-32280 flight-32281 flight-32282 flight-32283 flight-32284 flight-32285 flight-32286 flight-32287 flight-32288 flight-32289 flight-32290 flight-32291 flight-32292 flight-32293 flight-32294 flight-32295 flight-32296 flight-32297 flight-32298 flight-32299 flight-32300 flight-32301 flight-32302 flight-32303 flight-32304 flight-32305 flight-32306 flight-32308 flight-32309 flight-32310 flight-32311 flight-32312 flight-32313 flight-32314 flight-32315 flight-32316 flight-32317 flight-32318 flight-32319 flight-32320 flight-32321 flight-32322 flight-32323 flight-32324 flight-32325 flight-32326 flight-32327 flight-32328 flight-32329 flight-32330
Ian Campbell [Fri, 21 Nov 2014 13:16:52 +0000 (13:16 +0000)]
Add simple helper to update DI for all architectures.

Uses DebianNonfreeFirmware, even (especially) for production, so move
the README stanza out of standalone only section. The current default
matches what is in the current production versions of DI.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agots-kernel-build: enable CONFIG_IKCONFIG{_PROC}
Ian Campbell [Fri, 21 Nov 2014 13:16:51 +0000 (13:16 +0000)]
ts-kernel-build: enable CONFIG_IKCONFIG{_PROC}

This makes the kernel's .config available in /proc/config.gz and
embeds a copy which can be extracted with
linux/scripts/extract-ikconfig (which I've not tried, but have no
reason to doubt).

Having this around can be handy with an older osstest installed test
box and to confirm you've booted the kernel you think you have when
you are messing with .config options.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agostandalone: Introduce "HostGroups" for use in OSSTEST_CONFIG
Ian Campbell [Fri, 21 Nov 2014 13:16:50 +0000 (13:16 +0000)]
standalone: Introduce "HostGroups" for use in OSSTEST_CONFIG

This saves repeating identical HostProp and HostFlags for sets of
identical machines. e.g.

    HostGroupProp_cubietruck_LinuxSerialConsole ttyS0
    HostGroupProp_cubietruck_Build_Make_Flags -j12
    HostGroupProp_cubietruck_XenSerialConsole dtuart
    HostGroupProp_cubietruck_XenDTUARTPath /soc@01c00000/serial@01c28000
    HostGroupFlags_cubietruck suite-wheezy,equiv-cubietruck,need-kernel-deb-armmp,no-di-kernel,need-uboot-bootscr

    HostGroup_braque cubietruck
    HostProp_braque_Fqdn braque.uk.xensource.com

    HostGroup_picaso cubietruck
    HostProp_picaso_Fqdn picaso.uk.xensource.com

    HostGroup_metzinger cubietruck
    HostProp_metzinger metzinger.uk.xensource.com

    HostGroup_gleizes cubietruck
    HostProp_gleizes_Fqdn gleizes.uk.xensource.com

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agots-xen-build-prep: Install libxml-xpath-perl on build machines
Ian Campbell [Fri, 5 Dec 2014 14:54:08 +0000 (14:54 +0000)]
ts-xen-build-prep: Install libxml-xpath-perl on build machines

Required by latest libvirt, to build docs.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@citrix.com>
10 years agolinux-next tests: Use correct branch for baseline
Ian Jackson [Thu, 20 Nov 2014 13:48:56 +0000 (13:48 +0000)]
linux-next tests: Use correct branch for baseline

Make cr-daily-branch honour an environment or setting variable
EXTRA_SGR_ARGS.  In branch-settings.linux-next set it appropriately to
arrange that the linux-next test reports consider linux-linus tests as
interesting as well as just linux-next ones.

(We already use a flight from linux-linus for selecting the baseline
linux version.)

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agocs-adjust-flight: runvar-perlop: Do not report non-changes flight-31654 flight-31678 flight-31756 flight-31803 flight-31841 flight-31844 flight-31848 flight-31849 flight-31850 flight-31851 flight-31852 flight-31853 flight-31854 flight-31855 flight-31856 flight-31857 flight-31858 flight-31859 flight-31860 flight-31861 flight-31862 flight-31863 flight-31864 flight-31865 flight-31866 flight-31867 flight-31868 flight-31869 flight-31870 flight-31871 flight-31872 flight-31873 flight-31874 flight-31875 flight-31876 flight-31877 flight-31878 flight-31879 flight-31880 flight-31881 flight-31882 flight-31883 flight-31884 flight-31885 flight-31886 flight-31887 flight-31888 flight-31889 flight-31890 flight-31891 flight-31892 flight-31893 flight-31894 flight-31895 flight-31896 flight-31897 flight-31898 flight-31899 flight-31900 flight-31901 flight-31902 flight-31903 flight-31904 flight-31905 flight-31906 flight-31907 flight-31908 flight-31909 flight-31910 flight-31911 flight-31914 flight-31916 flight-31917 flight-31918 flight-31919 flight-31920 flight-31922 flight-31923 flight-31924 flight-31925 flight-31926 flight-31927 flight-31928 flight-31929 flight-31930 flight-31932 flight-31933 flight-31934 flight-31935 flight-31936 flight-31937 flight-31938 flight-31939 flight-31940 flight-31941 flight-31942 flight-31943 flight-31944 flight-31945 flight-31946 flight-31947 flight-31948 flight-31949 flight-31950 flight-31951 flight-31952 flight-31953 flight-31954 flight-31955 flight-31956 flight-31957 flight-31959 flight-31960 flight-31962 flight-31963 flight-31965 flight-31966 flight-31968 flight-31969 flight-31970 flight-31971 flight-31972 flight-31973 flight-31974 flight-31975 flight-31976 flight-31977 flight-31978 flight-31979 flight-31980 flight-31981 flight-31983 flight-31984 flight-31985 flight-31986 flight-31987 flight-31988 flight-31989 flight-31990 flight-31991 flight-31992 flight-31993 flight-31994 flight-31995 flight-31996 flight-31997 flight-31998 flight-31999 flight-32000 flight-32001 flight-32002 flight-32003 flight-32004 flight-32005 flight-32006 flight-32007 flight-32008 flight-32009 flight-32010 flight-32011 flight-32012 flight-32013 flight-32014 flight-32015 flight-32016 flight-32017 flight-32019 flight-32020 flight-32021 flight-32022 flight-32023 flight-32024 flight-32025 flight-32026 flight-32027 flight-32028 flight-32029 flight-32030 flight-32031 flight-32032 flight-32033 flight-32034 flight-32035 flight-32036 flight-32037 flight-32038 flight-32039 flight-32040 flight-32041 flight-32042 flight-32043 flight-32044 flight-32045 flight-32046 flight-32047 flight-32048 flight-32049 flight-32050 flight-32051 flight-32052 flight-32053 flight-32054 flight-32055 flight-32056 flight-32057 flight-32058 flight-32060 flight-32061 flight-32062 flight-32063 flight-32064 flight-32065 flight-32066 flight-32067 flight-32068 flight-32069 flight-32070 flight-32071 flight-32072 flight-32073 flight-32074 flight-32075 flight-32076 flight-32077 flight-32078 flight-32079 flight-32080 flight-32081 flight-32082 flight-32083 flight-32084 flight-32085 flight-32086 flight-32087 flight-32088 flight-32089 flight-32090 flight-32092 flight-32093 flight-32094 flight-32095 flight-32096 flight-32097 flight-32098 flight-32099 flight-32100 flight-32101 flight-32102 flight-32103 flight-32104 flight-32105 flight-32106 flight-32107 flight-32108 flight-32109 flight-32110 flight-32112 flight-32113 flight-32114 flight-32115 flight-32116 flight-32117 flight-32118 flight-32119 flight-32120 flight-32121 flight-32122 flight-32123 flight-32124 flight-32125 flight-32126 flight-32127 flight-32128 flight-32129 flight-32130 flight-32131 flight-32132 flight-32133 flight-32134 flight-32135
Ian Jackson [Thu, 13 Nov 2014 16:05:15 +0000 (16:05 +0000)]
cs-adjust-flight: runvar-perlop: Do not report non-changes

With -v, runvar-perlop would unconditionally print a message about the
changed variable.  Instead, only call runvar_set if the value is to
change.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agotarget_editfile: Improve doc comment
Ian Jackson [Thu, 13 Nov 2014 16:02:54 +0000 (16:02 +0000)]
target_editfile: Improve doc comment

More clearly state which arguments are optional.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agots-hosts-allocate-Executive: Radically reduce the previously_failed bonus
Ian Jackson [Tue, 11 Nov 2014 19:38:03 +0000 (19:38 +0000)]
ts-hosts-allocate-Executive: Radically reduce the previously_failed bonus

Make osstest less obsessive about sticking to failing hosts if they
are persistently unavailable.

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agots-hosts-allocate-Executive: Redo variation_bonus scoring
Ian Jackson [Tue, 11 Nov 2014 19:34:07 +0000 (19:34 +0000)]
ts-hosts-allocate-Executive: Redo variation_bonus scoring

Use a logarithmic scale.  Cap the bonus at 12h rather than 5d/30 = 4h.
When we have previously failed, make sure we apply a reverse bonus,
rather than a penalty.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
v2: Fix cap to really be 12h not 12d.

10 years agots-hosts-allocate-Executive: Score for equivalent previous failures
Ian Jackson [Tue, 11 Nov 2014 19:30:38 +0000 (19:30 +0000)]
ts-hosts-allocate-Executive: Score for equivalent previous failures

Look to see whether the last run on any hosts which are equivalent to
the ones we're looking at, failed.  This means that when host X is
failing and we are considering host Y which is equivalent to X, we
give Y a selection bonus.

This means that osstest will be less obsessive about sticking to the
very same failing host.

Also, no longer multiply by the number of previously-failing hosts;
instead, just consider whether _all_ the hosts are previously-failing
in their corresponding slots (*_host runvars).  It doesn't make sense
to make the bonus for using failing hosts depend on the number of
hosts used by the test.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
v2: Improve commit message.

10 years agots-hosts-allocate-Executive: Clarify an expression with //
Ian Jackson [Tue, 11 Nov 2014 19:28:24 +0000 (19:28 +0000)]
ts-hosts-allocate-Executive: Clarify an expression with //

No functional change.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agots-hosts-allocate-Executive: Do not prefer fast hosts for tests
Ian Jackson [Tue, 11 Nov 2014 18:30:56 +0000 (18:30 +0000)]
ts-hosts-allocate-Executive: Do not prefer fast hosts for tests

Introduce $duration_for_cost and set it to the previous formula for
build jobs, or 0 for test jobs.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agots-hosts-allocate-Executive: Move $variation_age setting
Ian Jackson [Tue, 11 Nov 2014 18:28:07 +0000 (18:28 +0000)]
ts-hosts-allocate-Executive: Move $variation_age setting

We are going to want to put more stuff in here which depends on
$duration_rightaway_adjust.

No functional change in this commit.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agoOsstest/Executive.pm: Debug log same-host status (in duration estimator)
Ian Jackson [Tue, 11 Nov 2014 18:22:44 +0000 (18:22 +0000)]
Osstest/Executive.pm: Debug log same-host status (in duration estimator)

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agots-hosts-allocate-Executive: allow uncompressed log
Ian Jackson [Tue, 11 Nov 2014 18:13:37 +0000 (18:13 +0000)]
ts-hosts-allocate-Executive: allow uncompressed log

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agocs-adjust-flight: Fix doc about /<pcre> to match implementation
Ian Jackson [Tue, 11 Nov 2014 19:27:44 +0000 (19:27 +0000)]
cs-adjust-flight: Fix doc about /<pcre> to match implementation

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agots-host-install: Ensure $dtbs is always a valid string
Ian Campbell [Sun, 9 Nov 2014 09:47:04 +0000 (09:47 +0000)]
ts-host-install: Ensure $dtbs is always a valid string

Otherwise on non-ARM platforms we get warnings about uninitialised values.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agomg-debian-installer-update: Use Packages.gz
Ian Campbell [Sun, 9 Nov 2014 09:43:07 +0000 (09:43 +0000)]
mg-debian-installer-update: Use Packages.gz

In Jessie Packages.bz2 is replaced by Packages.xz. Rather than implementing
per-suite handling just fallback to lowest-common-denominator gzip.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agoDebian: Install ethtool on the hosts
Ian Campbell [Sun, 9 Nov 2014 09:40:50 +0000 (09:40 +0000)]
Debian: Install ethtool on the hosts

It's very useful when debugging network issues.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agots-rumpuserxen-demo-xenstorels: set `on_poweroff="preserve"' flight-31549 flight-31598 flight-31639 flight-31640 flight-31641 flight-31642 flight-31643 flight-31644 flight-31645 flight-31647 flight-31648 flight-31649 flight-31650 flight-31651 flight-31652 flight-31655 flight-31656 flight-31657 flight-31658 flight-31659 flight-31660 flight-31661 flight-31662 flight-31663 flight-31664 flight-31665 flight-31666 flight-31667 flight-31668 flight-31669 flight-31670 flight-31671 flight-31672 flight-31673 flight-31674 flight-31675 flight-31676 flight-31679 flight-31680 flight-31681 flight-31682 flight-31683 flight-31684 flight-31685 flight-31686 flight-31688 flight-31689 flight-31690 flight-31691 flight-31692 flight-31693 flight-31694 flight-31695 flight-31715 flight-31716 flight-31717 flight-31718 flight-31719 flight-31720 flight-31721 flight-31722 flight-31723 flight-31724 flight-31725 flight-31726 flight-31727 flight-31728 flight-31729 flight-31730 flight-31731 flight-31732 flight-31733 flight-31734 flight-31735 flight-31736 flight-31737 flight-31738 flight-31739 flight-31740 flight-31741 flight-31742 flight-31743 flight-31744 flight-31745 flight-31746 flight-31747 flight-31748 flight-31749 flight-31750 flight-31751 flight-31752 flight-31753 flight-31754 flight-31755 flight-31757 flight-31758 flight-31759 flight-31760 flight-31761 flight-31762 flight-31763 flight-31764 flight-31765 flight-31766 flight-31767 flight-31768 flight-31769 flight-31770 flight-31771 flight-31772 flight-31773 flight-31774 flight-31775 flight-31776 flight-31777 flight-31778 flight-31779 flight-31780 flight-31781 flight-31782 flight-31783 flight-31784 flight-31785 flight-31786 flight-31787 flight-31788 flight-31789 flight-31790 flight-31791 flight-31792 flight-31793 flight-31794 flight-31795 flight-31796 flight-31797 flight-31798 flight-31799 flight-31800 flight-31801 flight-31802 flight-31804 flight-31805 flight-31806 flight-31807 flight-31808 flight-31809 flight-31810 flight-31811 flight-31812 flight-31813 flight-31814 flight-31815 flight-31816 flight-31817 flight-31818 flight-31819 flight-31821 flight-31822 flight-31823 flight-31824 flight-31825 flight-31826 flight-31827 flight-31828 flight-31829 flight-31831 flight-31832 flight-31833 flight-31838 flight-31840
Ian Jackson [Thu, 13 Nov 2014 15:53:20 +0000 (15:53 +0000)]
ts-rumpuserxen-demo-xenstorels: set `on_poweroff="preserve"'

We rely on the domain existing after xenstore-ls's main has called
exit, so that we can do our own xenstore-ls in dom0 and check the
results.

Previously, this happened by accident because the rump kernel would,
after _exit, call a minios function which crashes the domain.  New
rump kernels don't do this, and instead shut down cleanly.

Setting `on_poweroff="preserve"' has the desired effect.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agots-host-install: Honour linux-boot-append <suite> (host prop) flight-31425 flight-31432 flight-31433 flight-31434 flight-31435 flight-31436 flight-31437 flight-31438 flight-31439 flight-31440 flight-31441 flight-31442 flight-31443 flight-31444 flight-31445 flight-31446 flight-31448 flight-31450 flight-31451 flight-31452 flight-31453 flight-31454 flight-31455 flight-31456 flight-31457 flight-31458 flight-31459 flight-31460 flight-31461 flight-31462 flight-31463 flight-31464 flight-31465 flight-31466 flight-31467 flight-31468 flight-31469 flight-31470 flight-31471 flight-31472 flight-31473 flight-31474 flight-31475 flight-31476 flight-31477 flight-31478 flight-31479 flight-31481 flight-31482 flight-31483 flight-31484 flight-31485 flight-31486 flight-31487 flight-31488 flight-31489 flight-31490 flight-31491 flight-31492 flight-31493 flight-31494 flight-31495 flight-31497 flight-31498 flight-31499 flight-31500 flight-31503 flight-31504 flight-31505 flight-31506 flight-31507 flight-31508 flight-31509 flight-31510 flight-31511 flight-31512 flight-31513 flight-31514 flight-31515 flight-31516 flight-31517 flight-31518 flight-31519 flight-31520 flight-31521 flight-31522 flight-31523 flight-31524 flight-31525 flight-31526 flight-31527 flight-31528 flight-31529 flight-31530 flight-31531 flight-31532 flight-31533 flight-31534 flight-31535 flight-31536 flight-31537 flight-31538 flight-31539 flight-31540 flight-31542 flight-31543 flight-31544 flight-31545 flight-31546 flight-31547 flight-31548 flight-31550 flight-31551 flight-31552 flight-31553 flight-31554 flight-31555 flight-31556 flight-31557 flight-31558 flight-31559 flight-31560 flight-31561 flight-31562 flight-31563 flight-31564 flight-31565 flight-31566 flight-31567 flight-31568 flight-31569 flight-31570 flight-31571 flight-31572 flight-31573 flight-31574 flight-31575 flight-31576 flight-31577 flight-31578 flight-31579 flight-31580 flight-31581 flight-31582 flight-31583 flight-31584 flight-31585 flight-31586 flight-31587 flight-31588 flight-31589 flight-31590 flight-31591 flight-31592 flight-31593 flight-31594 flight-31595 flight-31596 flight-31597 flight-31599 flight-31600 flight-31601 flight-31602 flight-31603 flight-31604 flight-31605 flight-31606 flight-31607 flight-31608 flight-31609 flight-31610 flight-31611 flight-31612 flight-31613 flight-31614 flight-31615 flight-31616 flight-31617 flight-31618 flight-31619 flight-31620 flight-31621 flight-31622 flight-31623 flight-31624 flight-31625 flight-31626 flight-31627 flight-31628 flight-31629 flight-31630 flight-31631 flight-31632 flight-31633 flight-31634 flight-31635 flight-31636 flight-31637 flight-31638
Ian Jackson [Thu, 6 Nov 2014 16:14:18 +0000 (16:14 +0000)]
ts-host-install: Honour linux-boot-append <suite> (host prop)

We have `install-append <suite>' but that goes before d-i's -- so only
applies during installation.  Provide an option that applies
post-installation too.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agostandalone: Handle multiple configuration files.
Ian Campbell [Wed, 5 Nov 2014 10:41:24 +0000 (10:41 +0000)]
standalone: Handle multiple configuration files.

OSSTEST_CONFIG can actually be a colon separate list of files, so take this
into account when sanity checking it.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agoosstest-confirm-booted: Log processes
Ian Jackson [Tue, 4 Nov 2014 17:35:09 +0000 (17:35 +0000)]
osstest-confirm-booted: Log processes

Run a ps if osstest-confirm-booted does not exist, and stash the
output where we read it during log capture.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agopoll_loop: Restore diversion of logm
Ian Jackson [Tue, 4 Nov 2014 17:32:44 +0000 (17:32 +0000)]
poll_loop: Restore diversion of logm

poll_loop is supposed to divert the logging away so that you don't
have to see a pile of repetitive logging if the operation succeeds.

But this was broken when the code was moved from the perl module
Osstest to Osstest::TestSupport.  Fix it.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agoDhcpWatch::leases: Check errors
Ian Jackson [Fri, 31 Oct 2014 11:20:04 +0000 (11:20 +0000)]
DhcpWatch::leases: Check errors

Check error returns from connect() et al (which present as an undef
return from IO::Socket::INET), and from read() (which can be detected
via IO::Handle::error).

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agots-host-install: Add force-mac-address host flag flight-31256 flight-31275 flight-31293 flight-31328 flight-31329 flight-31330 flight-31331 flight-31332 flight-31333 flight-31334 flight-31335 flight-31336 flight-31337 flight-31338 flight-31339 flight-31340 flight-31341 flight-31342 flight-31343 flight-31344 flight-31345 flight-31346 flight-31347 flight-31348 flight-31349 flight-31350 flight-31351 flight-31352 flight-31353 flight-31355 flight-31356 flight-31357 flight-31358 flight-31359 flight-31362 flight-31363 flight-31364 flight-31365 flight-31366 flight-31367 flight-31368 flight-31369 flight-31370 flight-31371 flight-31372 flight-31373 flight-31374 flight-31375 flight-31376 flight-31377 flight-31378 flight-31379 flight-31380 flight-31381 flight-31382 flight-31384 flight-31385 flight-31386 flight-31387 flight-31388 flight-31389 flight-31390 flight-31391 flight-31392 flight-31393 flight-31394 flight-31395 flight-31396 flight-31397 flight-31399 flight-31400 flight-31401 flight-31402 flight-31403 flight-31404 flight-31405 flight-31406 flight-31407 flight-31408 flight-31409 flight-31410 flight-31411 flight-31412 flight-31413 flight-31414 flight-31415 flight-31416 flight-31417 flight-31418 flight-31419 flight-31420 flight-31421 flight-31422 flight-31423 flight-31424 flight-31426 flight-31427 flight-31428 flight-31429 flight-31430 flight-31431
Ian Campbell [Wed, 29 Oct 2014 10:41:30 +0000 (10:41 +0000)]
ts-host-install: Add force-mac-address host flag

This causes us to emit udev runes which force the device named in the host's
Interface_Force property to have the MAC address given in the host's Ether
property. This is the reverse of the behaviour of the Interface_Force property
without this flag, which is to rename the device with MAC address Ether to have
the requested name.

This is necessary because the arndale's USB Ethernet device has no burned in
MAC address and there is no mechanism to configure this e.g. via the bootloader
in a way which Linux will then notice.

Without this change Linux will pick a random mac address when loading the
driver, which breaks osstest's attempts to observe when the test host has
picked up its preseed file by watching the webserver logs, since DHCP will not
map a random mac address to the IP we are expecting.

This is only useful on systems which have exactly one Ethernet device,
otherwise there is no reliable way to determine which device is which.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agots-host-install: Add option to boot debian-installer in rescue mode
Ian Campbell [Wed, 29 Oct 2014 10:41:29 +0000 (10:41 +0000)]
ts-host-install: Add option to boot debian-installer in rescue mode

This is useful when trying to bootstrap onto a new platform, since you can log
in to an otherwise unbootable rootfs to figure out what is going wrong.

The procedure is the same as installing except "rescue/enabled=true" is added
to the command line, hence part of ts-host-install rather than separate.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agots-host-install: include console before *and* after the -- marker.
Ian Campbell [Wed, 29 Oct 2014 10:41:28 +0000 (10:41 +0000)]
ts-host-install: include console before *and* after the -- marker.

As of v3.15 Linux now stop parsing its command line at the -- mark and passes
the remainder to init. This has broken Debian Installer's feature where
anything after the -- is propagated to the installed system.

See also https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=762007

To work around this we need to pass console= twice, once before the -- for the
current kernel's use and then again after the -- which is propagated to the
installed system.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agots-host-install: Refactor code to construct a Linux console= for a host
Ian Campbell [Wed, 29 Oct 2014 10:41:27 +0000 (10:41 +0000)]
ts-host-install: Refactor code to construct a Linux console= for a host

And reuse it in when writing the u-boot script for initial boot. This was
previously hardcoded to ttyAMA which matches the production host DB for the
current set of hosts which use this script.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agots-host-install: Add fdtdir to PXE stanza if dtbs directory exists
Ian Campbell [Wed, 29 Oct 2014 10:41:26 +0000 (10:41 +0000)]
ts-host-install: Add fdtdir to PXE stanza if dtbs directory exists

u-boot's pxe client uses this together with $fdtfile in its local environment
to automatically load the fdt when pxe booting.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agomg-debian-installer-update: Add more modules when creating initrd overlay
Ian Campbell [Wed, 29 Oct 2014 10:41:25 +0000 (10:41 +0000)]
mg-debian-installer-update: Add more modules when creating initrd overlay

The arndale platform has a usb network device. In addition both the SATA and
NIC/USB hardware on this platform requires additional regulator (power), clk
and phy modules, which in turn require i2c support.

Add everything which is needed on this platform.

Sort the list of drivers while here.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agomg-debian-installer-update: Include any device tree blobs in the tftp dir
Ian Campbell [Wed, 29 Oct 2014 10:41:24 +0000 (10:41 +0000)]
mg-debian-installer-update: Include any device tree blobs in the tftp dir

We will need to supply these for some arm boards.

We provide both an unpacked version, which can be referenced via u-boot's
support for the "fdtdir" property in pxelinux.cfg and a tarball which is more
convenient for installing into the target filesystem on host install

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agostandalone: Provide a helper to clear the host runvar
Ian Campbell [Wed, 29 Oct 2014 10:41:23 +0000 (10:41 +0000)]
standalone: Provide a helper to clear the host runvar

This clears the host flag used for single-host test cases.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agoTftpDiVersion 2014-10-20 flight-30841 flight-30842 flight-30843 flight-30844 flight-30845 flight-30846 flight-30847 flight-30848 flight-30849 flight-30850 flight-30851 flight-30852 flight-30853 flight-30854 flight-30855 flight-30856 flight-30857 flight-30858 flight-30859 flight-30860 flight-30861 flight-30862 flight-30863 flight-30864 flight-30865 flight-30866 flight-30867 flight-30868 flight-30869 flight-30870 flight-30871 flight-30872 flight-30873 flight-30874 flight-30875 flight-30876 flight-30877 flight-30878 flight-30879 flight-30880 flight-30881 flight-30882 flight-30883 flight-30884 flight-30885 flight-30886 flight-30887 flight-30888 flight-30889 flight-30890 flight-30891 flight-30892 flight-30893 flight-30894 flight-30895 flight-30896 flight-30897 flight-30898 flight-30899 flight-30900 flight-30901 flight-30902 flight-30903 flight-30904 flight-30905 flight-30906 flight-30907 flight-30908 flight-30909 flight-30910 flight-30911 flight-30913 flight-30915 flight-30916 flight-30917 flight-30918 flight-30919 flight-30920 flight-30921 flight-30922 flight-30923 flight-30924 flight-30925 flight-30926 flight-30927 flight-30928 flight-30929 flight-30930 flight-30931 flight-30932 flight-30933 flight-30934 flight-30935 flight-30936 flight-30937 flight-30938 flight-30939 flight-30940 flight-30941 flight-30942 flight-30943 flight-30944 flight-30945 flight-30946 flight-30947 flight-30948 flight-30949 flight-30950 flight-30953 flight-30954 flight-30955 flight-30956 flight-30957 flight-30958 flight-30959 flight-30960 flight-30961 flight-30962 flight-30963 flight-30964 flight-30965 flight-30966 flight-30967 flight-30968 flight-30969 flight-30970 flight-30971 flight-30972 flight-30973 flight-30974 flight-30975 flight-30976 flight-30977 flight-30978 flight-30979 flight-30980 flight-30981 flight-30982 flight-30983 flight-30984 flight-30985 flight-30986 flight-30987 flight-30988 flight-30991 flight-30993 flight-30994 flight-30998 flight-30999 flight-31000 flight-31001 flight-31002 flight-31215 flight-31216 flight-31217 flight-31218 flight-31219 flight-31220 flight-31221 flight-31222 flight-31223 flight-31224 flight-31225 flight-31226 flight-31227 flight-31228 flight-31229 flight-31230 flight-31231 flight-31232 flight-31233 flight-31234 flight-31235 flight-31236 flight-31237 flight-31238 flight-31239 flight-31240 flight-31241 flight-31242 flight-31243 flight-31244 flight-31245 flight-31246 flight-31247 flight-31248 flight-31249 flight-31250 flight-31251 flight-31252 flight-31253 flight-31254 flight-31255 flight-31257 flight-31258 flight-31260 flight-31261 flight-31262 flight-31263 flight-31264 flight-31265 flight-31266 flight-31267 flight-31268 flight-31269 flight-31270 flight-31271 flight-31272 flight-31273 flight-31274 flight-31277 flight-31278 flight-31279 flight-31280 flight-31281 flight-31282 flight-31283 flight-31284 flight-31285 flight-31286 flight-31287 flight-31288 flight-31289 flight-31290 flight-31291 flight-31292 flight-31294 flight-31295 flight-31298 flight-31299 flight-31300 flight-31301 flight-31302 flight-31303 flight-31304 flight-31305 flight-31306 flight-31307 flight-31308 flight-31309 flight-31310 flight-31311 flight-31312 flight-31313 flight-31314 flight-31315 flight-31316 flight-31317 flight-31318 flight-31319 flight-31320 flight-31321 flight-31322 flight-31323 flight-31324 flight-31325 flight-31326 flight-31327
Ian Jackson [Mon, 20 Oct 2014 12:11:17 +0000 (13:11 +0100)]
TftpDiVersion 2014-10-20

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agocr-for-branches: Keep many more logs flight-30625 flight-30643 flight-30659 flight-30660 flight-30661 flight-30662 flight-30664 flight-30665 flight-30666 flight-30667 flight-30668 flight-30669 flight-30670 flight-30671 flight-30672 flight-30673 flight-30674 flight-30675 flight-30676 flight-30677 flight-30678 flight-30679 flight-30680 flight-30681 flight-30682 flight-30683 flight-30684 flight-30685 flight-30686 flight-30687 flight-30688 flight-30689 flight-30690 flight-30691 flight-30692 flight-30693 flight-30694 flight-30695 flight-30696 flight-30697 flight-30698 flight-30699 flight-30700 flight-30701 flight-30702 flight-30703 flight-30704 flight-30705 flight-30706 flight-30707 flight-30708 flight-30709 flight-30710 flight-30711 flight-30712 flight-30713 flight-30714 flight-30715 flight-30716 flight-30717 flight-30718 flight-30719 flight-30720 flight-30721 flight-30722 flight-30723 flight-30724 flight-30725 flight-30726 flight-30727 flight-30728 flight-30729 flight-30730 flight-30731 flight-30732 flight-30733 flight-30734 flight-30735 flight-30736 flight-30737 flight-30738 flight-30739 flight-30740 flight-30741 flight-30742 flight-30743 flight-30744 flight-30745 flight-30746 flight-30747 flight-30748 flight-30749 flight-30750 flight-30751 flight-30752 flight-30753 flight-30754 flight-30755 flight-30756 flight-30757 flight-30758 flight-30759 flight-30760 flight-30761 flight-30762 flight-30763 flight-30764 flight-30765 flight-30766 flight-30767 flight-30768 flight-30769 flight-30771 flight-30773 flight-30774 flight-30775 flight-30776 flight-30777 flight-30778 flight-30779 flight-30780 flight-30781 flight-30782 flight-30783 flight-30784 flight-30785 flight-30786 flight-30787 flight-30788 flight-30789 flight-30790 flight-30791 flight-30792 flight-30793 flight-30794 flight-30795 flight-30796 flight-30797 flight-30798 flight-30799 flight-30800 flight-30801 flight-30802 flight-30803 flight-30804 flight-30805 flight-30806 flight-30807 flight-30808 flight-30809 flight-30810 flight-30811 flight-30812 flight-30813 flight-30814 flight-30815 flight-30816 flight-30817 flight-30818 flight-30819 flight-30820 flight-30821 flight-30822 flight-30823 flight-30824 flight-30825 flight-30826 flight-30827 flight-30828 flight-30829 flight-30830 flight-30831 flight-30832 flight-30833 flight-30834 flight-30835 flight-30836 flight-30837 flight-30838 flight-30839
Ian Jackson [Mon, 6 Oct 2014 16:05:32 +0000 (17:05 +0100)]
cr-for-branches: Keep many more logs

Keep 300 cycles of cr-for-branches.log.

Also, remove the spurious `500' from the command line, which looks
like it was there because I thought that `-n' took a number argument
(but in fact that's -c), whereas it was actually interpreted as a
filename (which never exists so savelog silently ignores it).

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agobisection: Do not get bisection start points from broken flights
Ian Jackson [Mon, 6 Oct 2014 15:54:55 +0000 (16:54 +0100)]
bisection: Do not get bisection start points from broken flights

cs-bisection-step ignores any flight with broken steps, on the grounds
that the results in such a flight maybe unreliable.

Therefore, if a main flight has both broken steps and regressions, it
is wrong to take its mro as the new basis mro for bisections.  In the
worst case a newly failing job will be determined to be unbisectable
(since the only relevant failure is in a broken flight), have the
stamp file created, and then never be properly bisected.

So: in sg-report-flight, report `broken-step' for each broken step (in
the top-level flight we are reporting - broken jobs in flights we are
referring to to justify heisenbugs are OK); and, in cr-daily-branch,
do not install the new mro if such indications are present.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agocat-dhcp-leases: new script flight-30583 flight-30597 flight-30612 flight-30626 flight-30627 flight-30628 flight-30629 flight-30630 flight-30631 flight-30632 flight-30633 flight-30634 flight-30635 flight-30636 flight-30637 flight-30639 flight-30640 flight-30641 flight-30642 flight-30644 flight-30645 flight-30647 flight-30649 flight-30650 flight-30651 flight-30652 flight-30653 flight-30654 flight-30655 flight-30656 flight-30657 flight-30658
Ian Jackson [Fri, 3 Oct 2014 15:02:32 +0000 (16:02 +0100)]
cat-dhcp-leases: new script

ISC dhcpd treates /var/lib/dhcp3/leases as a log-structured database,
appending records to it and periodically rewriting it.  When it
decides to rewrite it it writes the new contents to a temporary file -
fine.

But rather than renaming the temporary file into place, over the top
of the old file, using rename(2), it first renames the old leases file
to leases~.  So briefly there is no leases file.

This means that the service used by Osstest/DhcpWatch/leases.pm when a
hostname and port is specified has to try various different files.

This is the appropriate shell script, which is most conveniently
maintained here in osstest.  It can be used by putting something like
this in inetd.conf:

5556 stream tcp nowait nobody /root/cat-dhcp-leases cat-dhcp-leases

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agosg-report-flight: Add a succcess/failure column header.
Ian Jackson [Thu, 2 Oct 2014 11:56:06 +0000 (12:56 +0100)]
sg-report-flight: Add a succcess/failure column header.

There are so many rows and columns that scrolling around trying to find the
column associated with a failure is getting pretty tricky. Finding all failing
columns is even harder.

Add a clue near the top: replicate the worst or most interesting step
result box contents and colour.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agots-rumpuserxen-build: Double the build timeout
Ian Jackson [Fri, 26 Sep 2014 15:35:18 +0000 (16:35 +0100)]
ts-rumpuserxen-build: Double the build timeout

The build is quite big and in particular configure is very iobound and
sensitive to other load on the box.  We have seen spurious timeouts.

CC: Jan Beulich <JBeulich@suse.com>
Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agoMerge branch 'pretest' of ssh://osstest/export/home/osstest/testing.git/ into pretest flight-30364 flight-30371 flight-30385 flight-30404 flight-30437 flight-30459 flight-30471 flight-30478 flight-30490 flight-30499 flight-30502 flight-30505 flight-30508 flight-30515 flight-30527 flight-30542 flight-30558 flight-30575 flight-30576 flight-30577 flight-30578 flight-30579 flight-30580 flight-30581 flight-30582 flight-30584 flight-30585 flight-30586 flight-30587 flight-30588 flight-30589 flight-30590 flight-30591 flight-30592 flight-30593 flight-30594 flight-30595 flight-30596 flight-30598 flight-30599 flight-30600 flight-30602 flight-30603 flight-30604 flight-30605 flight-30606 flight-30607 flight-30609 flight-30610 flight-30611 flight-30613 flight-30614 flight-30616 flight-30617 flight-30618 flight-30619 flight-30620 flight-30621 flight-30622 flight-30623 flight-30624
Ian Campbell [Tue, 23 Sep 2014 12:54:05 +0000 (13:54 +0100)]
Merge branch 'pretest' of ssh://osstest/export/home/osstest/testing.git/ into pretest

10 years agoSwitch armhf to use common default Linux.
Ian Campbell [Thu, 4 Sep 2014 14:16:39 +0000 (15:16 +0100)]
Switch armhf to use common default Linux.

Previous we had a v3.13 based branch which was used for ARM (because
v3.4 was too old). Now that the default is v3.14 we can use it.

standalone-generate-dump-flight-runvars before and after shows the
build-armhf-pvops jobs' linux_revision runvar changing from
95bfbee422b9b1cfe8c2d2e27edf17ce1cc99e04 (v3.13-63-g95bfbee) to
946de0e6b6ed49eacb03e3cddfcb1d774d6378ed (v3.14.17) for these branches:

libvirt
osstest
qemu-mainline
qemu-upstream-unstable
xen-4.3-testing
xen-4.4-testing
xen-unstable

This is as expected.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agoSwitch default Linux branch from 3.4 to 3.13
Ian Campbell [Thu, 4 Sep 2014 14:02:28 +0000 (15:02 +0100)]
Switch default Linux branch from 3.4 to 3.13

standalone-generate-dump-flight-runvars before and after shows revision_linux
changing from 9f089cfb4be27efe7c1cd1d6261da02496820441 (v3.4.103) to
946de0e6b6ed49eacb03e3cddfcb1d774d6378ed (v3.14.17) for the
build-{amd64,i386}-pvops jobs these branches:

osstest
rumpuserxen
xen-4.0-testing
xen-4.1-testing
xen-4.2-testing
xen-4.3-testing
xen-4.4-testing
xen-unstable
qemu-mainline
qemu-upstream-4.3-testing
qemu-upstream-4.4-testing
qemu-upstream-unstable
seabios
libvirt
qemu-upstream-4.2-testing

build-armhf-pvops and build-*-oldkern jobs as well as the linux-* branches are
unaffected. Which is as expected.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agomg-hosts mkpxedir: honour $OSSTEST_SUDO flight-29855 flight-29873 flight-29890 flight-29908 flight-29934 flight-29955 flight-29973 flight-29974 flight-29975 flight-29976 flight-29977 flight-29978 flight-29979 flight-29980 flight-29981 flight-29982 flight-29983 flight-29984 flight-29985 flight-29986 flight-29987 flight-29988 flight-29989 flight-29990 flight-29991 flight-29992 flight-29993 flight-29994 flight-29995 flight-29996 flight-29997 flight-29998 flight-29999 flight-30000 flight-30001 flight-30002 flight-30003 flight-30004 flight-30005 flight-30006 flight-30007 flight-30008 flight-30009 flight-30010 flight-30011 flight-30012 flight-30013 flight-30014 flight-30015 flight-30016 flight-30017 flight-30018 flight-30019 flight-30020 flight-30021 flight-30022 flight-30023 flight-30024 flight-30025 flight-30026 flight-30027 flight-30028 flight-30029 flight-30030 flight-30031 flight-30032 flight-30033 flight-30034 flight-30035 flight-30036 flight-30037 flight-30038 flight-30039 flight-30040 flight-30041 flight-30042 flight-30043 flight-30044 flight-30045 flight-30046 flight-30047 flight-30048 flight-30049 flight-30050 flight-30051 flight-30052 flight-30053 flight-30054 flight-30055 flight-30056 flight-30057 flight-30058 flight-30059 flight-30060 flight-30061 flight-30062 flight-30063 flight-30064 flight-30065 flight-30066 flight-30067 flight-30068 flight-30069 flight-30070 flight-30071 flight-30072 flight-30073 flight-30074 flight-30075 flight-30076 flight-30077 flight-30078 flight-30079 flight-30080 flight-30081 flight-30082 flight-30083 flight-30084 flight-30085 flight-30086 flight-30087 flight-30088 flight-30089 flight-30090 flight-30091 flight-30092 flight-30093 flight-30094 flight-30095 flight-30096 flight-30097 flight-30098 flight-30099 flight-30100 flight-30101 flight-30102 flight-30103 flight-30104 flight-30105 flight-30106 flight-30108 flight-30109 flight-30110 flight-30111 flight-30113 flight-30114 flight-30115 flight-30116 flight-30117 flight-30118 flight-30119 flight-30120 flight-30122 flight-30124 flight-30125 flight-30127 flight-30128 flight-30129 flight-30130 flight-30131 flight-30132 flight-30133 flight-30134 flight-30135 flight-30136 flight-30137 flight-30138 flight-30139 flight-30140 flight-30141 flight-30142 flight-30143 flight-30144 flight-30145 flight-30146 flight-30147 flight-30148 flight-30149 flight-30150 flight-30151 flight-30152 flight-30153 flight-30154 flight-30155 flight-30156 flight-30157 flight-30158 flight-30159 flight-30160 flight-30161 flight-30162 flight-30163 flight-30164 flight-30165 flight-30166 flight-30167 flight-30168 flight-30169 flight-30170 flight-30171 flight-30172 flight-30173 flight-30174 flight-30175 flight-30176 flight-30177 flight-30178 flight-30179 flight-30180 flight-30181 flight-30182 flight-30183 flight-30184 flight-30185 flight-30186 flight-30187 flight-30188 flight-30189 flight-30190 flight-30191 flight-30192 flight-30193 flight-30194 flight-30195 flight-30196 flight-30197 flight-30198 flight-30199 flight-30200 flight-30201 flight-30202 flight-30203 flight-30204 flight-30205 flight-30206 flight-30207 flight-30208 flight-30209 flight-30210 flight-30211 flight-30212 flight-30213 flight-30214 flight-30215 flight-30216 flight-30217 flight-30218 flight-30219 flight-30220 flight-30221 flight-30222 flight-30223 flight-30224 flight-30225 flight-30226 flight-30227 flight-30228 flight-30229 flight-30230 flight-30231 flight-30232 flight-30233 flight-30234 flight-30235 flight-30236 flight-30237 flight-30238 flight-30239 flight-30240 flight-30241 flight-30242 flight-30243 flight-30244 flight-30245 flight-30246 flight-30247 flight-30248 flight-30249 flight-30250 flight-30251 flight-30252 flight-30253 flight-30254 flight-30255 flight-30256 flight-30257 flight-30258 flight-30259 flight-30260 flight-30261 flight-30262 flight-30263 flight-30264 flight-30265 flight-30266 flight-30267 flight-30268 flight-30269 flight-30270 flight-30271 flight-30272 flight-30273 flight-30274 flight-30275 flight-30276 flight-30277 flight-30278 flight-30279 flight-30280 flight-30281 flight-30282 flight-30283 flight-30284 flight-30285 flight-30286 flight-30287 flight-30288 flight-30289 flight-30290 flight-30291 flight-30292 flight-30293 flight-30294 flight-30295 flight-30296 flight-30297 flight-30298 flight-30301 flight-30302 flight-30303 flight-30304 flight-30305 flight-30306 flight-30307 flight-30308 flight-30309 flight-30310 flight-30311 flight-30312 flight-30313 flight-30314 flight-30315 flight-30316 flight-30317 flight-30318 flight-30319 flight-30320 flight-30321 flight-30322 flight-30323 flight-30324 flight-30325 flight-30326 flight-30327 flight-30328 flight-30331 flight-30332 flight-30333 flight-30334 flight-30335 flight-30336 flight-30337 flight-30338 flight-30339 flight-30340 flight-30341 flight-30342 flight-30343 flight-30344 flight-30345 flight-30346 flight-30347 flight-30348 flight-30349 flight-30350 flight-30351 flight-30352 flight-30353 flight-30354 flight-30355 flight-30356 flight-30357 flight-30358 flight-30359 flight-30360 flight-30361 flight-30362 flight-30363 flight-30365 flight-30366 flight-30367 flight-30368 flight-30369 flight-30370 flight-30372 flight-30373 flight-30374 flight-30375 flight-30376 flight-30377 flight-30378 flight-30379 flight-30380 flight-30381 flight-30382 flight-30383 flight-30384 flight-30387 flight-30388 flight-30389 flight-30390 flight-30391 flight-30392 flight-30393 flight-30394 flight-30395 flight-30396 flight-30397 flight-30399 flight-30400 flight-30401 flight-30402 flight-30403 flight-30405 flight-30406 flight-30407 flight-30408 flight-30409 flight-30410 flight-30411 flight-30412 flight-30413 flight-30414 flight-30415 flight-30416 flight-30417 flight-30418 flight-30419 flight-30420 flight-30421 flight-30422 flight-30423 flight-30424 flight-30425 flight-30426 flight-30427 flight-30428 flight-30429 flight-30430 flight-30431 flight-30432 flight-30433 flight-30434 flight-30435 flight-30436 flight-30438 flight-30439 flight-30440 flight-30441 flight-30442 flight-30443 flight-30444 flight-30445 flight-30446 flight-30448 flight-30454 flight-30458 flight-30460 flight-30461 flight-30463 flight-30464 flight-30465 flight-30466 flight-30468 flight-30469 flight-30470 flight-30472 flight-30473 flight-30474 flight-30475 flight-30476 flight-30477 flight-30479 flight-30480 flight-30481 flight-30482 flight-30483 flight-30484 flight-30485 flight-30486 flight-30487 flight-30488 flight-30489 flight-30491 flight-30492 flight-30494 flight-30495 flight-30496 flight-30497 flight-30498 flight-30500 flight-30501 flight-30503 flight-30504 flight-30506 flight-30507 flight-30509 flight-30510 flight-30511 flight-30512 flight-30513 flight-30514 flight-30516 flight-30517 flight-30518 flight-30519 flight-30520 flight-30521 flight-30522 flight-30523 flight-30524 flight-30525 flight-30526 flight-30528 flight-30529 flight-30530 flight-30531 flight-30532 flight-30533 flight-30534 flight-30535 flight-30536 flight-30537 flight-30538 flight-30539 flight-30540 flight-30541 flight-30543 flight-30544 flight-30545 flight-30546 flight-30548 flight-30549 flight-30550 flight-30551 flight-30552 flight-30553 flight-30554 flight-30555 flight-30556 flight-30557 flight-30559 flight-30560 flight-30561 flight-30563 flight-30564 flight-30565 flight-30566 flight-30567 flight-30568 flight-30569 flight-30570 flight-30571 flight-30572 flight-30573 flight-30574
Ian Jackson [Tue, 19 Aug 2014 10:33:15 +0000 (11:33 +0100)]
mg-hosts mkpxedir: honour $OSSTEST_SUDO

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agoFix mg-hosts mkpxedir
Ian Jackson [Tue, 19 Aug 2014 10:31:17 +0000 (11:31 +0100)]
Fix mg-hosts mkpxedir

 * Have selecthost no longer demand that $job is set; if it is not,
   simply do not set Suite (which of course ultimately comes from
   runvars and hence the job).

 * Add missing use Osstest::TestSupport.

 * Mention the need to run it in README.dev.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agosg-report-flight: New --branches-also option
Ian Jackson [Thu, 31 Jul 2014 15:26:55 +0000 (16:26 +0100)]
sg-report-flight: New --branches-also option

This allows easy comparison of relevant flights (specified by tree
versions) from one branch with relevant flights from another.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agorump kernel tests: Get upstream from rumprun-xen
Ian Jackson [Thu, 31 Jul 2014 14:42:56 +0000 (15:42 +0100)]
rump kernel tests: Get upstream from rumprun-xen

Replace https://github.com/rumpkernel/rumpuser-xen
with https://github.com/rumpkernel/rumprun-xen
as the source for the pre-test version.  The repo has been renamed
upstream.

We do not change, at this time:

 * The name of the post-test output repo on xenbits,
     git://xenbits.xen.org/rumpuser-xen.git#xen-tested-master

Changing those would be a bit fiddly.

And we don't change the following, which contain `rumpuserxen':

 * osstest `branch', `recipe', and `jobs' which are used to correlate
   and specify aspects of the different production test runs of
   different versions of the code.  The branch name appears in the
   Subject lines of email reports, and the job names in the body (and
   as column names in the html test report matrix).

 * The osstest `tree' names (which are used to specify and correlate
   the different versions and urls of the `same' codebase in the
   various tests).  Also, we leave unchanged the corresponding
   osstest tree plumbing environment variable names.

 * The osstest build output identifiers from ts-rumpuser-xen-build
   including the runvar name and the dist part name.  (These are used
   to communicate between the build and test jobs.)

Changing those would break cross-change comparison of test results and
osstest's automatic bisection across the change.

We also don't change:

  * The names of the ts-rumpuserxen-* test scripts.

While this could be changed by renaming the files and editing
sg-run-job to match, it doesn't seem sensible to rename these while
leaving everything else unchanged.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agoTestSupport: Set DISTCC_FALLBACK=0 when using distcc flight-29510 flight-29525 flight-29544 flight-29571 flight-29583 flight-29584 flight-29585 flight-29586 flight-29587 flight-29588 flight-29589 flight-29590 flight-29591 flight-29592 flight-29593 flight-29594 flight-29595 flight-29596 flight-29597 flight-29598 flight-29599 flight-29600 flight-29601 flight-29602 flight-29603 flight-29604 flight-29605 flight-29606 flight-29607 flight-29608 flight-29609 flight-29610 flight-29612 flight-29615 flight-29616 flight-29617 flight-29618 flight-29619 flight-29620 flight-29621 flight-29622 flight-29623 flight-29624 flight-29625 flight-29626 flight-29627 flight-29628 flight-29629 flight-29630 flight-29631 flight-29632 flight-29633 flight-29634 flight-29635 flight-29636 flight-29637 flight-29638 flight-29639 flight-29640 flight-29641 flight-29642 flight-29643 flight-29644 flight-29645 flight-29646 flight-29647 flight-29648 flight-29649 flight-29650 flight-29651 flight-29652 flight-29653 flight-29654 flight-29655 flight-29656 flight-29657 flight-29658 flight-29659 flight-29661 flight-29662 flight-29664 flight-29665 flight-29666 flight-29667 flight-29668 flight-29669 flight-29670 flight-29671 flight-29672 flight-29673 flight-29674 flight-29675 flight-29676 flight-29677 flight-29678 flight-29679 flight-29680 flight-29681 flight-29682 flight-29683 flight-29684 flight-29685 flight-29686 flight-29687 flight-29688 flight-29691 flight-29692 flight-29693 flight-29694 flight-29695 flight-29696 flight-29697 flight-29698 flight-29700 flight-29701 flight-29702 flight-29711 flight-29712 flight-29713 flight-29714 flight-29715 flight-29716 flight-29717 flight-29718 flight-29719 flight-29720 flight-29721 flight-29722 flight-29723 flight-29724 flight-29725 flight-29726 flight-29727 flight-29728 flight-29729 flight-29730 flight-29731 flight-29732 flight-29733 flight-29734 flight-29735 flight-29736 flight-29737 flight-29738 flight-29739 flight-29740 flight-29741 flight-29742 flight-29743 flight-29744 flight-29745 flight-29746 flight-29747 flight-29748 flight-29749 flight-29750 flight-29751 flight-29752 flight-29753 flight-29754 flight-29755 flight-29756 flight-29757 flight-29758 flight-29759 flight-29760 flight-29761 flight-29762 flight-29763 flight-29764 flight-29765 flight-29767 flight-29768 flight-29769 flight-29770 flight-29771 flight-29772 flight-29773 flight-29777 flight-29778 flight-29779 flight-29780 flight-29781 flight-29782 flight-29783 flight-29784 flight-29785 flight-29786 flight-29787 flight-29788 flight-29789 flight-29790 flight-29791 flight-29792 flight-29793 flight-29795 flight-29796 flight-29797 flight-29798 flight-29799 flight-29800 flight-29801 flight-29802 flight-29803 flight-29804 flight-29806 flight-29807 flight-29808 flight-29809 flight-29810 flight-29811 flight-29812 flight-29813 flight-29814 flight-29815 flight-29816 flight-29817 flight-29818 flight-29819 flight-29820 flight-29821 flight-29822 flight-29823 flight-29824 flight-29825 flight-29826 flight-29827 flight-29828 flight-29829 flight-29830 flight-29831 flight-29832 flight-29833 flight-29834 flight-29835 flight-29836 flight-29837 flight-29838 flight-29839 flight-29840 flight-29841 flight-29842 flight-29843 flight-29844 flight-29845 flight-29846 flight-29847 flight-29848 flight-29849 flight-29850 flight-29851 flight-29852 flight-29853 flight-29854 flight-29856 flight-29857 flight-29858 flight-29860 flight-29861 flight-29862 flight-29863 flight-29864 flight-29865 flight-29866 flight-29867 flight-29868 flight-29869 flight-29870 flight-29871 flight-29872 flight-29874 flight-29875 flight-29876 flight-29877 flight-29878 flight-29879 flight-29880 flight-29881 flight-29882 flight-29884 flight-29885 flight-29886 flight-29887 flight-29888 flight-29889 flight-29891 flight-29892 flight-29893 flight-29894 flight-29895 flight-29896 flight-29898 flight-29899 flight-29900 flight-29903 flight-29904 flight-29905 flight-29906 flight-29907 flight-29909 flight-29910 flight-29911 flight-29912 flight-29913 flight-29914 flight-29915 flight-29916 flight-29917 flight-29918 flight-29919 flight-29920 flight-29921 flight-29922 flight-29923 flight-29924 flight-29925 flight-29926 flight-29927 flight-29928 flight-29929 flight-29930 flight-29931 flight-29932 flight-29933 flight-29935 flight-29936 flight-29937 flight-29938 flight-29939 flight-29940 flight-29941 flight-29942 flight-29943 flight-29944 flight-29945 flight-29946 flight-29947 flight-29948 flight-29949 flight-29950 flight-29951 flight-29952 flight-29953 flight-29954 flight-29956 flight-29957 flight-29958 flight-29959 flight-29960 flight-29961 flight-29962 flight-29963 flight-29964 flight-29965 flight-29966 flight-29967 flight-29968 flight-29969 flight-29970 flight-29971 flight-29972
Ian Campbell [Mon, 28 Jul 2014 13:01:20 +0000 (14:01 +0100)]
TestSupport: Set DISTCC_FALLBACK=0 when using distcc

This will show up issues with the distcc infrastructure immediately
instead of limping on with reduced performance.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agocr-for-branches: add linux-3.14 flight-29474 flight-29485 flight-29486 flight-29487 flight-29488 flight-29489 flight-29490 flight-29491 flight-29492 flight-29493 flight-29494 flight-29495 flight-29496 flight-29497 flight-29498 flight-29499 flight-29500 flight-29501 flight-29502 flight-29503 flight-29504 flight-29505 flight-29506 flight-29507 flight-29509 flight-29511 flight-29512 flight-29513 flight-29514 flight-29516 flight-29517 flight-29518 flight-29519 flight-29520 flight-29521 flight-29522 flight-29523 flight-29524 flight-29526 flight-29529 flight-29532 flight-29533 flight-29534 flight-29535 flight-29536 flight-29537 flight-29538 flight-29539 flight-29540 flight-29541 flight-29542 flight-29543 flight-29545 flight-29546 flight-29547 flight-29548 flight-29549 flight-29550 flight-29551 flight-29552 flight-29553 flight-29554 flight-29555 flight-29557 flight-29558 flight-29559 flight-29560 flight-29561 flight-29562 flight-29563 flight-29564 flight-29565 flight-29566 flight-29567 flight-29568 flight-29569 flight-29570 flight-29572 flight-29573 flight-29574 flight-29575 flight-29576 flight-29577 flight-29578 flight-29579 flight-29580 flight-29582
Ian Jackson [Fri, 25 Jul 2014 16:23:52 +0000 (17:23 +0100)]
cr-for-branches: add linux-3.14

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agoREADME.dev: Slightly tart up the new branch instructions
Ian Jackson [Fri, 25 Jul 2014 16:23:40 +0000 (17:23 +0100)]
README.dev: Slightly tart up the new branch instructions

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agomake-flight: Enable qemu tests for 4.5 onwards flight-29370 flight-29373 flight-29380 flight-29381 flight-29382 flight-29383 flight-29384 flight-29385 flight-29386 flight-29387 flight-29388 flight-29389 flight-29390 flight-29391 flight-29392 flight-29393 flight-29394 flight-29395 flight-29396 flight-29397 flight-29398 flight-29399 flight-29400 flight-29401 flight-29402 flight-29403 flight-29404 flight-29405 flight-29406 flight-29407 flight-29408 flight-29409 flight-29410 flight-29411 flight-29412 flight-29413 flight-29414 flight-29415 flight-29416 flight-29417 flight-29418 flight-29419 flight-29420 flight-29421 flight-29422 flight-29423 flight-29424 flight-29425 flight-29426 flight-29427 flight-29428 flight-29429 flight-29430 flight-29431 flight-29432 flight-29433 flight-29434 flight-29435 flight-29436 flight-29437 flight-29438 flight-29439 flight-29440 flight-29441 flight-29442 flight-29443 flight-29444 flight-29445 flight-29447 flight-29449 flight-29450 flight-29451 flight-29452 flight-29453 flight-29454 flight-29455 flight-29456 flight-29457 flight-29458 flight-29459 flight-29460 flight-29462 flight-29464 flight-29465 flight-29466 flight-29467 flight-29468 flight-29469 flight-29470 flight-29471 flight-29472 flight-29473 flight-29475 flight-29476 flight-29477 flight-29478 flight-29479 flight-29480 flight-29481 flight-29482 flight-29483 flight-29484
Ian Campbell [Wed, 16 Jul 2014 11:45:05 +0000 (12:45 +0100)]
make-flight: Enable qemu tests for 4.5 onwards

Stefano is about to enable qemu support on ARM, we should test it.

standalone-generate-dump-flight-runvars verifies that the affect of this change
is to add armhf jobs/runvars to qemu-mainline and qemu-upstream-unstable as
desired.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Cc: Stefano.Stabellini@eu.citrix.com
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agostandalone-generate-dump-flight-runvars: allow 26 chars for branch name
Ian Campbell [Wed, 16 Jul 2014 11:44:46 +0000 (12:44 +0100)]
standalone-generate-dump-flight-runvars: allow 26 chars for branch name

qemu-upstream-X.Y-testing is 25 characters. Also add a space.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agorump kernel tests: Run xenstore-ls demo
Ian Jackson [Mon, 14 Jul 2014 12:08:58 +0000 (13:08 +0100)]
rump kernel tests: Run xenstore-ls demo

We can use the newly-generalised ts-rumpuserxen-demo-setup to set up
the config file etc. to run xenstore-ls from the xen.git build.

We have a bespoke script to actually execute it: we extract the actual
program output from the guest console log, and compare the results to
those we expect (based on running xenstore-ls in dom0).

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
v2: Fix copyright date in new script.

10 years agots-guest-destroy-hard: New script
Ian Jackson [Tue, 15 Jul 2014 14:18:00 +0000 (15:18 +0100)]
ts-guest-destroy-hard: New script

This just calls xl destroy; it doesn't check that the guest is
running, or on the network, or anything.  (It also doesn't check that
the guest is down afterwards.)

We are going to want this to be able to destroy the rumpuserxen
xenstorels domain, which is short-lived (and will normally have
terminated by the time we want to destroy it).

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
---
v2: Fix copyright date in new script.

10 years agorump kernel tests: Specify cmdline via runvar
Ian Jackson [Mon, 14 Jul 2014 11:58:57 +0000 (12:58 +0100)]
rump kernel tests: Specify cmdline via runvar

The runvar <gn>_cmdline is used for the rumpuserxen guest command
line.  Previously "3" (a binary flags word meaningful to the test/demo
program included in rumpuser-xen.git) was hardcoded.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agorump kernel tests: Specify kernel via runvar
Ian Jackson [Tue, 15 Jul 2014 14:40:08 +0000 (15:40 +0100)]
rump kernel tests: Specify kernel via runvar

The runvar <gn>_builtimage is set to <distpart>:<distpath>.
Previously we hardcoded `/usr/local/lib/xen/rump-kernel' in
`rumpuserxen'.

The ffs filesystem images, and the demo config template, still come
from a single particular build, which we find from the
`guests_rumpuserxenbuildjob' runvar.  This runvar is then doing double
duty as the build job for the ffs filesystem images and example
configs, and the `default' build job for guest kernels.

The subpath /usr/local/lib/xen/rump-kernel is duplicated.  It
now appears:
 1. To find the demo guest's kernel: in make-flight, setting a runvar,
    with the actual rump-kernel kernel image leafname appended.
 2. For the filesystem images and config file: hardcoded in
    ts-rumpuserxen-demo-setup.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
---
v2: Fix demo application kernel image filename.
    Disentangle wording of last para of commit message.

10 years agorump kernel tests: Use guest-specific fs images location
Ian Jackson [Tue, 15 Jul 2014 14:38:11 +0000 (15:38 +0100)]
rump kernel tests: Use guest-specific fs images location

We are going to want to have multiple different guests in the same
job.  Don't use the same locations for all of their fs images.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agorump kernel tests: Do a xen.git tools build
Ian Jackson [Mon, 14 Jul 2014 12:04:35 +0000 (13:04 +0100)]
rump kernel tests: Do a xen.git tools build

Having laid the groundwork, we can now:

* In make-flight, for the rumpuserxen builds, set the runvars that
  specify which xen.git bits etc. to build.  (We pass qemuu now,
  because we intend that eventually we will want to build that too.)

* In ts-rumpuserxen-build, record the locations of the app-tools
  configure and make wrappers in the runvars which will be honoured by
  ts-xen-build.  Thus ts-xen-build in rumpuserxen build jobs will use
  these app-tools and do a rump cross build.

* Add a ts-xen-build step to the build-rumpuserxen recipe, passing
  `tools' as the target to build.

ts-rumpuserxen-build does not generate a formal set of build outputs.
Instead, the ts-xen-build step references the files generated by
ts-rumpuserxen-build directly (and is told where to find them via the
new command prefix runvars).

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
---
v2: Improve commit message.

10 years agots-xen-build: Honour cmdprefix_configure, cmdprefix_make
Ian Jackson [Mon, 14 Jul 2014 12:03:16 +0000 (13:03 +0100)]
ts-xen-build: Honour cmdprefix_configure, cmdprefix_make

These runvars can be set to specify a string (containing shell code)
to be prefixed to the executions of ./configure and make.

If not set, the behaviour is as as before.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agots-xen-build: Allow specification of make targets
Ian Jackson [Mon, 14 Jul 2014 12:01:37 +0000 (13:01 +0100)]
ts-xen-build: Allow specification of make targets

This allows sg-run-job (or a manual caller of ts-xen-build) to specify
which target(s) to pass to `make'.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agomake-flight: rumpuserxen tests: use same buildjob for all guests
Ian Jackson [Mon, 14 Jul 2014 11:52:28 +0000 (12:52 +0100)]
make-flight: rumpuserxen tests: use same buildjob for all guests

Change the name of the runvar for the build job to be
guests_rumpuserxenbuildjob, which is the default (fallback) for
guest_var.

(We are going to introduce another step which uses another guest but
wants the same build job.)

No resulting change in the system's overall behaviour.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
---
v2: Fix stray leftover in commit message.

10 years agobuilding: Delete when cloning, not when preparing $builddir
Ian Jackson [Mon, 14 Jul 2014 11:37:43 +0000 (12:37 +0100)]
building: Delete when cloning, not when preparing $builddir

Make prepbuilddirs no longer delete $builddir; instead:
 - have prepbuilddirs delete *-stamp files and dist/;
 - have build_clone delete the specific source directories;
 - any individual ts-*-build scripts that use other things
   would have to delete them (but searching for $builddir
   reveals none).

This makes it possible for later steps within a build job to look at
the build trees from previous steps.  This is helpful if for any
reason it isn't easy or desirable to package up a formal set of build
outputs for reuse.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
v2: Provide motivation in the commit message.

10 years agosg-run-job: Support toggling `adding' by repeating `+'
Ian Jackson [Mon, 14 Jul 2014 12:07:30 +0000 (13:07 +0100)]
sg-run-job: Support toggling `adding' by repeating `+'

Specifying `+' as an argument to spawn-ts suppresses the automatic
addition of subsequent arguments to the testid.  Make it possible to
toggle this by repeating `+'.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agoBuildSupport: make selectbuildhost modify @ARGV
Ian Jackson [Fri, 11 Jul 2014 14:49:10 +0000 (15:49 +0100)]
BuildSupport: make selectbuildhost modify @ARGV

We pass it \@ARGV everywhere now, and it eats the argument (if it
finds one).  This allows build scripts to take extra arguments.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agoselectguest: log a message
Ian Jackson [Tue, 15 Jul 2014 14:15:02 +0000 (15:15 +0100)]
selectguest: log a message

Print the guest's name and the host it's on; this can help with
interpreting the logs.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agots-rumpuserxen-build: Cope with new layout, disabling bodges flight-29255 flight-29275 flight-29276 flight-29277 flight-29278 flight-29279 flight-29280 flight-29281 flight-29282 flight-29283 flight-29284 flight-29285 flight-29286 flight-29287 flight-29288 flight-29289 flight-29290 flight-29291 flight-29292 flight-29293 flight-29294 flight-29295 flight-29296 flight-29297 flight-29298 flight-29299 flight-29300 flight-29301 flight-29302 flight-29303 flight-29304 flight-29305 flight-29306 flight-29307 flight-29308 flight-29309 flight-29310 flight-29311 flight-29312 flight-29313 flight-29314 flight-29315 flight-29316 flight-29317 flight-29319 flight-29329 flight-29330 flight-29331 flight-29332 flight-29333 flight-29334 flight-29335 flight-29336 flight-29337 flight-29338 flight-29339 flight-29340 flight-29341 flight-29343 flight-29345 flight-29346 flight-29347 flight-29350 flight-29351 flight-29352 flight-29353 flight-29354 flight-29355 flight-29356 flight-29357 flight-29358 flight-29359 flight-29360 flight-29361 flight-29362 flight-29363 flight-29364 flight-29365 flight-29366 flight-29367 flight-29368 flight-29369 flight-29371 flight-29372 flight-29374 flight-29375 flight-29376 flight-29377 flight-29378 flight-29379
Ian Jackson [Fri, 11 Jul 2014 14:27:11 +0000 (15:27 +0100)]
ts-rumpuserxen-build: Cope with new layout, disabling bodges

The rumpsrc psuedo-submodule has been integrated with the nblibs
submodule and made into a proper submodule.

Also, in the intervening time, rumpuserxen/Config.mk now uses ?= when
setting XEN_HEADERS.

So if we detect that we have a new rumpuser-xen, we can disable:
 - ad-hoc arrangements for rumpsrc
 - grievous-bodge
 - patching Config.mk

We consider a rumpuserxen old iff it has nblibs as a submodule and
lacks rumpsrc as a submodule.

We have to have a different name for the rumpsrc submodule (rather
than using rumpsrc), because in the new arrangements it needs to be
fetched from the location specified in rumpuserxen's .gitmodules
rather than our own configured location for the old rumpsrc.  (And the
local name is in the runvars etc.)

The old runvars etc. for rumpsrc need to stay around to cope with old
rumpuserxen, for now, but are going to be obsolete.  Leave some
comments about this in relevant places.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agoBuildSupport: provide submodule_have
Ian Jackson [Fri, 11 Jul 2014 14:13:03 +0000 (15:13 +0100)]
BuildSupport: provide submodule_have

Convenience function.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agoadhoc-revtuple-generator: Explicitly specify refs to fetch flight-29176 flight-29177 flight-29178 flight-29179 flight-29180 flight-29181 flight-29182 flight-29183 flight-29184 flight-29185 flight-29186 flight-29187 flight-29188 flight-29189 flight-29190 flight-29191 flight-29192 flight-29193 flight-29194 flight-29195 flight-29196 flight-29197 flight-29198 flight-29199 flight-29202 flight-29203 flight-29204 flight-29205 flight-29206 flight-29207 flight-29208 flight-29209 flight-29210 flight-29211 flight-29212 flight-29213 flight-29214 flight-29215 flight-29216 flight-29217 flight-29218 flight-29219 flight-29220 flight-29221 flight-29222 flight-29223 flight-29224 flight-29225 flight-29226 flight-29227 flight-29228 flight-29229 flight-29230 flight-29231 flight-29232 flight-29233 flight-29234 flight-29235 flight-29236 flight-29237 flight-29238 flight-29239 flight-29240 flight-29241 flight-29242 flight-29243 flight-29244 flight-29245 flight-29246 flight-29247 flight-29248 flight-29249 flight-29250 flight-29251 flight-29256 flight-29257 flight-29258 flight-29259 flight-29260 flight-29261 flight-29262 flight-29263 flight-29264 flight-29265 flight-29266 flight-29267 flight-29268 flight-29269 flight-29270 flight-29271 flight-29272 flight-29273 flight-29274
Ian Jackson [Tue, 8 Jul 2014 10:27:59 +0000 (11:27 +0100)]
adhoc-revtuple-generator: Explicitly specify refs to fetch

Some of the git trees in $c{Repos} may have been created (eg by
earlier versions of git or earlier versions of osstest) without the
usual
  remote.origin.fetch = +refs/heads/*:refs/remotes/origin/*
git config setting.

Pass this refspec explicitly, instead of relying on it being set as
the default.

Amongst other things, this will prevent a possible error during
bisection
  git fetch -p origin
  [stuff]
  fatal: bad object 3e3d5f6146c3f684f4b7bd71feffc31e1c668754
which is currently appearing in our cron mail.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agoexecutive-postgresql-schema: Schema dump flight-27830 flight-27839 flight-27852 flight-28807 flight-28808 flight-28809 flight-28810 flight-28811 flight-28812 flight-28813 flight-28814 flight-28815 flight-28816 flight-28817 flight-28818 flight-28819 flight-28820 flight-28821 flight-28822 flight-28823 flight-28824 flight-28825 flight-28826 flight-28827 flight-28828 flight-28829 flight-28830 flight-28831 flight-28832 flight-28833 flight-28834 flight-28835 flight-28836 flight-28837 flight-28838 flight-28839 flight-28840 flight-28841 flight-28842 flight-28843 flight-28844 flight-28845 flight-28846 flight-28847 flight-28848 flight-28849 flight-28850 flight-28851 flight-28852 flight-28853 flight-28854 flight-28855 flight-28856 flight-28857 flight-28858 flight-28859 flight-28860 flight-28861 flight-28862 flight-28863 flight-28864 flight-28865 flight-28866 flight-28869 flight-28870 flight-28871 flight-28872 flight-28873 flight-28874 flight-28875 flight-28876 flight-28877 flight-28878 flight-28879 flight-28880 flight-28881 flight-28882 flight-28884 flight-28885 flight-28886 flight-28888 flight-28889 flight-28890 flight-28891 flight-28892 flight-28893 flight-28894 flight-28895 flight-28896 flight-28897 flight-28898 flight-28899 flight-28900 flight-28901 flight-28902 flight-28903 flight-28905 flight-28906 flight-28907 flight-28908 flight-28911 flight-28912 flight-28913 flight-28914 flight-28915 flight-28916 flight-28917 flight-28918 flight-28919 flight-28920 flight-28921 flight-28922 flight-28923 flight-28924 flight-28925 flight-28926 flight-28927 flight-28928 flight-28929 flight-28930 flight-28931 flight-28932 flight-28935 flight-28937 flight-28938 flight-28940 flight-28943 flight-28945 flight-28947 flight-28949 flight-28953 flight-28955 flight-28979 flight-28988 flight-29009 flight-29031 flight-29052 flight-29081 flight-29086 flight-29087 flight-29138 flight-29151
Ian Jackson [Mon, 30 Jun 2014 10:13:37 +0000 (11:13 +0100)]
executive-postgresql-schema: Schema dump

We really ought to have a proper schema script.  But for now, include
the output of pg_dump --schema-only on the osstestdb, for the benefit
of anyone trying to set up a hosted (rather than standalone) instance
(or just trying to see how the code works).

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
v2: New patch in v2 of the series.

10 years agomake-flight: Test rump kernels only when needed
Ian Jackson [Fri, 27 Jun 2014 10:20:19 +0000 (11:20 +0100)]
make-flight: Test rump kernels only when needed

Introduce a new subroutine branch_wants_rumpkernel_tests and call it
before making the rumpuserxen build and test jobs.

The default is not to include a rumpuserxen test.  We include it for
rumpuserxen itself, xen, linux (in case there is a frontend/backend
incompatibility), and osstest.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agomake-flight: Break out do_rumpkernel_tests
Ian Jackson [Fri, 27 Jun 2014 10:19:47 +0000 (11:19 +0100)]
make-flight: Break out do_rumpkernel_tests

No functional change in this patch.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agostandalone-generate-dump-flight-runvars: New utility
Ian Jackson [Fri, 27 Jun 2014 14:40:57 +0000 (15:40 +0100)]
standalone-generate-dump-flight-runvars: New utility

This is helpful for showing the effect of changes to make-flight,
cr-daily-branch, et al.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
v2: Do not set DAILY_BRANCH_POSTMAKE_HOOK, since standalone now does
    that.

10 years agomg-list-all-branches: New script.
Ian Jackson [Fri, 27 Jun 2014 11:45:11 +0000 (12:45 +0100)]
mg-list-all-branches: New script.

The approach here is a little unpleasant but it has the virtue of
getting the ones out of crontab too, and of not depending on the
production database (which will in any case contain obsolete flights).

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agostandalone-config-example: Provide a setting of Repos
Ian Jackson [Fri, 27 Jun 2014 15:51:46 +0000 (16:51 +0100)]
standalone-config-example: Provide a setting of Repos

Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agostandalone: Use DAILY_BRANCH_POSTMAKE_HOOK
Ian Jackson [Mon, 30 Jun 2014 10:12:08 +0000 (11:12 +0100)]
standalone: Use DAILY_BRANCH_POSTMAKE_HOOK

DAILY_BRANCH_PREEXEC_HOOK is after we have made half the prospective
email, but this is not useful for standalone users.

Reported-by: Ian Campbell <Ian.Campbell@citrix.com>
Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
v2: New patch in v2 of the series.

10 years agostandalone: Honour OSSTEST_CONFIG
Ian Jackson [Fri, 27 Jun 2014 15:51:27 +0000 (16:51 +0100)]
standalone: Honour OSSTEST_CONFIG

If OSSTEST_CONFIG is set in the environment, do not default it
to ~/.xen-osstest/config.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agosubmodulefixup: Tell git cache [fetch=try]
Ian Jackson [Fri, 27 Jun 2014 10:42:31 +0000 (11:42 +0100)]
submodulefixup: Tell git cache [fetch=try]

Make git_massage_url take an optional %xopts list, currently with
only GitFetchBestEffort as a possible key.

Use that in submodulefixup, unconditionally.  Often the submodule
update will work fine with an older version of the submodule, and if
the submodule we get is out of date then the submodule update will
fail anyway.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agoadhoc-revtuple-generator: Do not always reclone
Ian Jackson [Fri, 27 Jun 2014 14:24:18 +0000 (15:24 +0100)]
adhoc-revtuple-generator: Do not always reclone

Instead, try setting the `origin' remote's URL and fetching.  If that
fails it may be that the local repo is corrupted, so then we try
recloning.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agoadhoc-revtuple-generator: Avoid an undefined variable warning
Ian Jackson [Fri, 27 Jun 2014 13:44:58 +0000 (14:44 +0100)]
adhoc-revtuple-generator: Avoid an undefined variable warning

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agoadhoc-revtuple-generator: Include $treename in some error messages flight-27575 flight-27576 flight-27578 flight-27579 flight-27580 flight-27582 flight-27587 flight-27774 flight-27775 flight-27776 flight-27777 flight-27778 flight-27779 flight-27781 flight-27782 flight-27783 flight-27784 flight-27785 flight-27786 flight-27787 flight-27788 flight-27789 flight-27790 flight-27791 flight-27792 flight-27793 flight-27794 flight-27797 flight-27798 flight-27799 flight-27800 flight-27801 flight-27802 flight-27803 flight-27804 flight-27805 flight-27806 flight-27807 flight-27808 flight-27809 flight-27810 flight-27811 flight-27812 flight-27814 flight-27815 flight-27816 flight-27817 flight-27818 flight-27819 flight-27820 flight-27821 flight-27822 flight-27823 flight-27824 flight-27826 flight-27827 flight-27828 flight-27829 flight-27831 flight-27832 flight-27833 flight-27834 flight-27836 flight-27837 flight-27838 flight-27840 flight-27841 flight-27842 flight-27843 flight-27845 flight-27846 flight-27847 flight-27848 flight-27849 flight-27850 flight-27851 flight-27853 flight-27854 flight-27855 flight-27856 flight-27857 flight-27858 flight-27860 flight-27861 flight-27867 flight-27868 flight-27869 flight-27870
Ian Jackson [Fri, 27 Jun 2014 11:30:35 +0000 (12:30 +0100)]
adhoc-revtuple-generator: Include $treename in some error messages

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agoadhoc-revtuple-generator: Cope with parentless git commits
Ian Jackson [Fri, 27 Jun 2014 11:30:13 +0000 (12:30 +0100)]
adhoc-revtuple-generator: Cope with parentless git commits

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agots-xen-install: Correct mlog to logm flight-27471 flight-27483 flight-27484 flight-27490 flight-27491 flight-27508 flight-27525 flight-27538 flight-27546 flight-27553 flight-27569
Ian Campbell [Mon, 16 Jun 2014 08:31:03 +0000 (09:31 +0100)]
ts-xen-install: Correct mlog to logm

Only logm exists.

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
10 years agomg-debian-installer-update: Print messages to stderr.
Anthony PERARD [Mon, 9 Jun 2014 15:16:50 +0000 (16:16 +0100)]
mg-debian-installer-update: Print messages to stderr.

This fix standalone-reset which rely on the output of this script.

Signed-off-by: Anthony PERARD <anthony.perard@citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Dario Faggioli <dario.faggioli@citrix.com>
10 years agomg-hosts: Usage documentation.
Ian Jackson [Wed, 25 Jun 2014 14:05:34 +0000 (15:05 +0100)]
mg-hosts: Usage documentation.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agomg-hosts: Allow spaces in setflagexpr exprs
Ian Jackson [Wed, 25 Jun 2014 14:05:21 +0000 (15:05 +0100)]
mg-hosts: Allow spaces in setflagexpr exprs

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agocr-for-branches: clean up tmp/
Ian Jackson [Wed, 25 Jun 2014 09:33:01 +0000 (10:33 +0100)]
cr-for-branches: clean up tmp/

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
10 years agoImplement direct IPMI power control. flight-27153 flight-27158 flight-27159 flight-27160 flight-27161 flight-27164 flight-27165 flight-27166 flight-27168 flight-27169 flight-27171 flight-27173 flight-27201 flight-27203 flight-27218 flight-27248 flight-27249 flight-27280 flight-27282 flight-27293 flight-27300 flight-27315 flight-27316 flight-27321 flight-27330 flight-27352 flight-27357 flight-27358 flight-27380 flight-27391 flight-27392 flight-27393 flight-27394 flight-27395 flight-27396 flight-27401 flight-27402 flight-27403 flight-27404 flight-27405 flight-27406 flight-27407 flight-27408 flight-27409 flight-27410 flight-27411 flight-27412 flight-27413 flight-27414 flight-27415 flight-27416 flight-27417 flight-27418 flight-27419 flight-27420 flight-27421 flight-27422 flight-27423 flight-27424 flight-27425 flight-27426 flight-27427 flight-27428 flight-27429 flight-27430 flight-27431 flight-27432 flight-27433 flight-27434 flight-27435 flight-27436 flight-27437 flight-27438 flight-27439 flight-27440 flight-27441 flight-27442 flight-27443 flight-27444 flight-27445 flight-27446 flight-27447 flight-27448 flight-27449 flight-27450 flight-27452 flight-27456 flight-27462 flight-27463 flight-27464 flight-27465 flight-27466 flight-27467 flight-27468 flight-27469 flight-27473 flight-27474 flight-27475 flight-27476 flight-27477 flight-27478 flight-27479 flight-27480 flight-27481 flight-27482
Ian Campbell [Mon, 16 Jun 2014 08:51:21 +0000 (09:51 +0100)]
Implement direct IPMI power control.

The xenuse module currently used to control some machines (specifically the ARM
marilith machines) is unreliable and subject to breakages on the xenrt server
side.

Since xenuse/xenrt is just wrapping IPMI for these machines implement direct
control via a new Osstest::PDI::impi module.

This is distinct from the existing impiextra (arbitrary ipmi commands on power
status change) because IPMI power control is not idempotent, therefore it is
necessary to query the current status before turning the machine on or off.

After this change the correct power method for a marilith node is:
    ipmiextra on marilith-n0-mgmt.uk.xensource.com <user> <pass> chassis bootdev pxe;ipmi marilith-n0-mgmt.uk.xensource.com <user> <pass>

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
Ian, when we discussed this on IRC you expressed a preference for using
freeipmitools, but since the existing ipmiextra module uses ipmitool I figured
it would be better to be consistent.

10 years agocrontab: reduce frequency of linux-next flight-27064 flight-27066 flight-27067 flight-27068 flight-27070 flight-27072 flight-27073 flight-27074 flight-27075 flight-27077 flight-27079 flight-27080 flight-27081 flight-27082 flight-27083 flight-27084 flight-27086 flight-27087 flight-27088 flight-27089 flight-27090 flight-27092 flight-27093 flight-27094 flight-27095 flight-27096 flight-27097 flight-27098 flight-27099 flight-27100 flight-27101 flight-27102 flight-27103 flight-27104 flight-27105 flight-27106 flight-27107 flight-27109 flight-27110 flight-27111 flight-27112 flight-27113 flight-27114 flight-27116 flight-27117 flight-27118 flight-27119 flight-27120 flight-27121 flight-27122 flight-27123 flight-27124 flight-27126 flight-27127 flight-27128 flight-27129 flight-27130 flight-27132 flight-27133 flight-27138 flight-27141 flight-27142 flight-27144 flight-27145 flight-27146 flight-27147 flight-27148 flight-27149 flight-27151 flight-27152 flight-27154 flight-27155 flight-27156 flight-27157
Ian Jackson [Mon, 9 Jun 2014 14:29:52 +0000 (15:29 +0100)]
crontab: reduce frequency of linux-next

10 years agomake-flight: Do not filter the qemu-upstream-* jobs
Ian Jackson [Mon, 9 Jun 2014 14:20:05 +0000 (15:20 +0100)]
make-flight: Do not filter the qemu-upstream-* jobs

When "qemu-xen-traditional" was the default, this filtering was
correct.  But now, "qemu-xen" is the default, and that version may
also be used in other tests for ancillary functions (eg, in dom0 for
the bootloader).

So simply do all of the jobs when testing qemu-upstream-*.

Retain the old behaviour for qemu-xen-4.2-testing, which has
qemu-xen-traditional as the default.  (There is no
qemu-xen-4.1-testing, and 4.3 has the change to the default.)

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agobuild_clone: When guessing vcs from url suffix, strip cache info flight-26977 flight-26997 flight-27012 flight-27031 flight-27032 flight-27033 flight-27034 flight-27038 flight-27042 flight-27043 flight-27044 flight-27045 flight-27047 flight-27048 flight-27049 flight-27050 flight-27051 flight-27052 flight-27055 flight-27056 flight-27057 flight-27060 flight-27061 flight-27062 flight-27063
Ian Jackson [Thu, 5 Jun 2014 10:15:46 +0000 (11:15 +0100)]
build_clone: When guessing vcs from url suffix, strip cache info

We assume that anything not containing `/'s after `%20' is
uninteresting.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
10 years agoap-common: Use besteffort_repo for rumpsrc flight-26968
Ian Jackson [Wed, 4 Jun 2014 13:47:54 +0000 (14:47 +0100)]
ap-common: Use besteffort_repo for rumpsrc

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>