Red Hat joins CI party,

brings cookies

Linux Plumbers 2019

Nikolai
Kondrashov

Sr. Software Engineer @ Red Hat

Electronics/embedded enthusiast

DIGImend maintainer

Veronika
Kabatova

Software Engineer @ Red Hat

PyCon CZ organizer

Wannabe mentor

A team from Red Hat's
Base Operating Systems

and Global QE

China
Czech Republic
Finland
Norway
United States

"cookie"

Not That Long Ago...

Developers

Maintainers

 

 

 

 

 

 

 

 

 

 

Upstream

Git

Maintainers

Git

Release

QA

RH TESTS

Maillist

Maillist

Git

Maintainers

 

 

 

 

 

 

 

 

 

 

Red Hat

Developers

Maillist

Wait for me!

Release

Developers

Maintainers

 

 

 

 

 

 

 

 

 

 

Upstream

Git

Maintainers

Git

Release

QA

Release

RH TESTS

Maillist

Maillist

Git

Maintainers

 

 

 

 

 

 

 

 

 

 

 

Red Hat

Developers

Maillist

Release

RH TESTS

Release

RH TESTS

Developers

Maintainers

 

 

 

 

 

 

 

 

 

 

 

 

Upstream

Git

Maintainers

Git

Maillist

Maillist

RH TESTS

Release

RH TESTS

Release

RH TESTS

Release

Release

QA

Release

RH TESTS

Git

Maintainers

 

 

 

 

 

 

 

 

 

 

 

Red Hat

Developers

Maillist

Release

RH TESTS

Release

RH TESTS

About those cookies...

x86_64

aarch64

ppc64

ppc64le

s390x

VMs

Laptops

PCs

Servers

Mainframes

GPUs

NICs

Storage controllers

Audio cards

Infiniband adapters

and more!

Hardware

Tests

iSCSI params

Thinpool sanity

PCI utils sanity

kdump

Socket fuzzing

Routing tests

Firewall tests

xfstests

Realtime kernel tests

LTPLite

USEX

Connectathon NFS

KVM Unit Tests

KVM Self Tests

Libhugetlbfs tests

stress-ng

blocktests

SystemTap tracepoints

and more!

Jan Stancek

Fendy Tjahjadi

Jianhong Yin

Marcelo Condotta

Marcelo Condotta

Li Wang

Jeff Bastian

Yi Zhang

Jeff Bastian

and more!

Filip Suba

Jakub Krysl

William Gomeringer

Xiaowu Wu

Xiumei Mu

Jianlin Shi

Yi Chen

Xiong Zhou

Qiao Zhao

Maintainers

Stable Baseline Report - Overview

Stable Baseline Report - Compile

Stable Baseline Report - Files

Stable Baseline Report - Tests

Stable Baseline Report - Sources

Stable Baseline Report - Logs

Stable Queue Report - Overview

Stable Queue Report - MergE

Stable Queue Report - Tests

Stable Queue Report - Logs

Stable Queue Report - Response

Real BUGS!

LTP COLLABORATION - TEST BUGS

POSSIBLE ISSUES FOUND DURING LTP COLLABORATION

Kernel Bug - LTP migrate_pages12

Kernel Bug - LTP mtest06

Kernel Bug - LTP mtest06

Kernel Bug - KVM unit tests

Kernel Bug - KVM unit tests

Kernel Bug -blktests/006 #1

Kernel Bug -BLKTESTS/006 #2

ZIPL Bug - kdump

Beating Greg at his game

Stable patching gotchas

Accident in The Mine

And more...

Pipelines

🔔 Triggers

Lint

Merge

Build

Test

Patchwork

Git

Koji

Report

Mail

 

 

 

GitLab

Review

QA

Publish

 

 

Beaker

GitHub

GitLab

COPR

Lint

Merge

Build

Test

Review

Publish

Lint

Merge

Build

Publish

Test

Review

Baseline 🔔TRIGGER

master

🔔 Trigger

linux-5.2.y

rhel-8.1

rhel-7.7

 

 

 

Configuration

 

 

 

 

GitLab

 

 

 

 

GitLab

Git Repo A

 

Git Repo B

 

Git Repo C

 

Merge

Build

Test

Patchwork 🔔TRIGGER

🔔 Trigger

 

 

 

 

 

Configuration

 

 

 

 

GitLab

Patchwork 1

 

linux-block

qemu-devel

Patchwork 2

 

rhel-8.1

rhel-7.7

Merge

Build

Test

master

master

rhel-8.1

rhel-7.7

Git Repo A

 

Git Repo B

 

Git Repo C

 

Lint

Stable Queue 🔔TRIGGER

🔔 Trigger

 

 

 

Configuration

 

 

 

 

GitLab

Merge

Build

Test

stable/linux.git

 

 

 

linux-4.14.y

stable/stable-queue.git

 

 

 

queue-5.2

 

linux-4.19.y

linux-5.2.y

series

001.patch

002.patch

queue-4.14.y

queue-4.19.y

Koji/COPR 🔔TRIGGER

🔔 Trigger

 

 

 

 

 

 

Configuration

 

 

 

GitLab

COPR

 

 

 

Test

kernel

KOJI

 

 

 

Fedora Infrastructure Message Bus (ZeroMQ)

kernel

mariadb

nodejs

bazel

qgis

python

tkn

kscreen

mame

ceph

ksh

GitHub/GitLab Bot 🔔TRIGGER

 

 

 

 

 

 

 

 

 

 

GitHub/GitLab repo

PR/MR

 

 

 

 

 

 

 

 

 👩 fix foo

 🤖 ask me to test!

 👩 test please, 🤖!

 🤖 testing now!

 👩 ... 🍴 ...

 🤖 passed, ACK👍

RHEL7

 

Merge

Build

Test

RHEL8

 

Merge

Build

Test

stable

 

Merge

Build

Test

🔔TRIGGERing

 

 

 

 

 

 

 

 

 

 

Pipeline Repo

  stable

 

 

 

🔔 Baseline Trigger

         Stable queue: queue-5.2

🔔 Stable Queue Trigger

         Baseline: stable linux-5.2.y

         Retrigger: test-kpet-c1c4f1

  rhel7

 

 

 

         Baseline: rhel7 master

         Patch: rhel77: Fix that ...

         Retrigger: test-kpet-c1c4f1

🔔 Patchwork Trigger

🔔 GitHub Bot Trigger

🔒

🔔TRIGGERing

 

 

 

 

 

 

 

 

 

 

Pipeline Repo

  stable

 

 

 

         Stable queue: queue-5.2

         Baseline: stable linux-5.2.y

         Retrigger: test-kpet-c1c4f1

  rhel7

 

 

 

         Baseline: rhel7 master

         Patch: rhel77: Fix that ...

         Retrigger: test-kpet-c1c4f1

  stable

 

 

 

  rhel7

 

 

 

         Baseline: stable linux-5.2.y

         Stable queue: queue-5.2

         Retrigger: test-kpet-c1c4f1

         Baseline: rhel7 master

         Patch: rhel77: Fix that ...

         Retrigger: test-kpet-c1c4f1

🔒

🔔TRIGGERing

 

 

 

 

 

 

 

 

 

 

Pipeline Repo

  stable

 

 

 

         Stable queue: queue-5.2

         Baseline: stable linux-5.2.y

         Retrigger: test-kpet-c1c4f1

  rhel7

 

 

 

         Baseline: rhel7 master

         Patch: rhel77: Fix that ...

         Retrigger: test-kpet-c1c4f1

         Baseline: stable linux-5.2.y

         Baseline: rhel7 master

         Stable queue: queue-5.2

         Retrigger: test-kpet-c1c4f1

         Patch: rhel77: Fix that ...

         Retrigger: test-kpet-c1c4f1

🔒

🔔TRIGGERing

 

 

 

 

 

 

 

 

Pipeline Repo

 

 

 

 

 

 

 

 

Definition Repo

     rhel7

 

⚙️ rhel7.yml

📄 cki_pipeline.yml

⚙️ rhel8.yml

⚙️ ...

Trees

 

 

 

 

 

⚙️ stable.yml

⚙️ .gitlab-ci.yml

     rhel8

 

⚙️ .gitlab-ci.yml

    stable

 

⚙️ .gitlab-ci.yml

🔒

Testing

 

 

KPET-DB

🔒

🔒

YAML

XML

 

 

 

 

 

 

 

 

 

 

KPET-DB

Arches

 

 

 

 

 

Host Types

 

 

 

 

 

x86_64

ppc64le

aarch64

+2

bare_metal

rdma

megaraid

+...

Suites

 

 

LTPLite

kdump

KVM

xfstests

USEX

firewall

stress-ng

realtime

blocktests

+66

Trees

 

 

 

 

 

Comps

 

 

 

 

 

Sets

 

 

 

 

 

rhel7

stable

rhel8

+15

headers

debug

devel

+2

net

mem

fs

+5

Suite data

Suite data

Reporting

Lint

Merge

Build

Test

 

 

 

 

Pipeline

Review

Publish

 

 

 

 

 

 

GitLab

      rc

      log

      rc

      log

      src

Lint

Merge

Build

      rc

      log

      bin

Publish

      rc

      rc

      log

      json

Test

 

 

 

 

Reporter

Webhook

Webhook

Webhook

Webhook

Webhook

Collaboration

  • Kernel maintainers
    • We can test your tree and send you results
  • Test maintainers
    • We can run your tests
  • Other CI systems
    • Common place to look for test results
    • Linux Foundation kernelCI.org membership
    • Hackfest coming up!

Hackfest

Sana Lisboa Hotel

Av. Fontes Pereira de Melo 8, 1069-310 Lisboa

Thu, Sep 12

09:30-10:00  Breakfast (provided)
10:00-10:30  Introductions
10:30-11:00  Test data standardization
11:10-12:00  Common place for
             upstream results
12:10-13:30  How to avoid effort duplication
13:30-14:30  Lunch break
14:30-16:00  Open testing philosophy
16:10-17:00  Common hardware pools
09:30-10:00  Breakfast (provided)
10:00-11:20  Getting results to
             developers/maintainers
11:30-12:30  Onboarding new trees and tests
12:40-13:30  CI bug tracking
13:30-14:30  Lunch break
14:30-16:00  Bugs and result interpretation
16:10-17:30  Security when testing
             untrusted patches

Thu, Sep 13

Thank you!

Get our Stickers!

AND Your COOKIES!

🍪

🍪

🍪

Icons from Font Awesome licensed under Creative Commons Attribution 4.0

Icons from Octicons (c) GitHub, Inc

"A Bug" by h&b { Lea } is licensed under CC BY-NC-ND 2.0

"Sugar cookies two ways-1" by Dana McMahan is licensed under CC BY-NC 2.0

"Self-Operating Napkin", Copyright Heirs of Rube Goldberg

"Perfect Chocolate Chip Cookies" by Kimberly Vardeman is licensed under CC BY 2.0

Credits

Red Hat joins CI party, brings cookies 🍪

By Nikolai Kondrashov

Private

Red Hat joins CI party, brings cookies 🍪