Commit 706451d4 authored by Linus Torvalds's avatar Linus Torvalds

Merge tag 'linux-kselftest-kunit-5.11-rc1' of...

Merge tag 'linux-kselftest-kunit-5.11-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/shuah/linux-kselftest

Pull Kunit updates from Shuah Khan:

 - documentation update and fix to kunit_tool to parse diagnostic
   messages correctly from David Gow

 - Support for Parameterized Testing and fs/ext4 test updates to use
   KUnit parameterized testing feature from Arpitha Raghunandan

 - Helper to derive file names depending on --build_dir argument from
   Andy Shevchenko

* tag 'linux-kselftest-kunit-5.11-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/shuah/linux-kselftest:
  fs: ext4: Modify inode-test.c to use KUnit parameterized testing feature
  kunit: Support for Parameterized Testing
  kunit: kunit_tool: Correctly parse diagnostic messages
  Documentation: kunit: provide guidance for testing many inputs
  kunit: Introduce get_file_path() helper
parents 7194850e 5f6b99d0
...@@ -15,10 +15,10 @@ project, see :doc:`start`. ...@@ -15,10 +15,10 @@ project, see :doc:`start`.
Organization of this document Organization of this document
============================= =============================
This document is organized into two main sections: Testing and Isolating This document is organized into two main sections: Testing and Common Patterns.
Behavior. The first covers what unit tests are and how to use KUnit to write The first covers what unit tests are and how to use KUnit to write them. The
them. The second covers how to use KUnit to isolate code and make it possible second covers common testing patterns, e.g. how to isolate code and make it
to unit test code that was otherwise un-unit-testable. possible to unit test code that was otherwise un-unit-testable.
Testing Testing
======= =======
...@@ -218,8 +218,11 @@ test was built in or not). ...@@ -218,8 +218,11 @@ test was built in or not).
For more information on these types of things see the :doc:`api/test`. For more information on these types of things see the :doc:`api/test`.
Common Patterns
===============
Isolating Behavior Isolating Behavior
================== ------------------
The most important aspect of unit testing that other forms of testing do not The most important aspect of unit testing that other forms of testing do not
provide is the ability to limit the amount of code under test to a single unit. provide is the ability to limit the amount of code under test to a single unit.
...@@ -233,7 +236,7 @@ implementer, and architecture-specific functions which have definitions selected ...@@ -233,7 +236,7 @@ implementer, and architecture-specific functions which have definitions selected
at compile time. at compile time.
Classes Classes
------- ~~~~~~~
Classes are not a construct that is built into the C programming language; Classes are not a construct that is built into the C programming language;
however, it is an easily derived concept. Accordingly, pretty much every project however, it is an easily derived concept. Accordingly, pretty much every project
...@@ -451,6 +454,74 @@ We can now use it to test ``struct eeprom_buffer``: ...@@ -451,6 +454,74 @@ We can now use it to test ``struct eeprom_buffer``:
destroy_eeprom_buffer(ctx->eeprom_buffer); destroy_eeprom_buffer(ctx->eeprom_buffer);
} }
Testing against multiple inputs
-------------------------------
Testing just a few inputs might not be enough to have confidence that the code
works correctly, e.g. for a hash function.
In such cases, it can be helpful to have a helper macro or function, e.g. this
fictitious example for ``sha1sum(1)``
.. code-block:: c
/* Note: the cast is to satisfy overly strict type-checking. */
#define TEST_SHA1(in, want) \
sha1sum(in, out); \
KUNIT_EXPECT_STREQ_MSG(test, (char *)out, want, "sha1sum(%s)", in);
char out[40];
TEST_SHA1("hello world", "2aae6c35c94fcfb415dbe95f408b9ce91ee846ed");
TEST_SHA1("hello world!", "430ce34d020724ed75a196dfc2ad67c77772d169");
Note the use of ``KUNIT_EXPECT_STREQ_MSG`` to give more context when it fails
and make it easier to track down. (Yes, in this example, ``want`` is likely
going to be unique enough on its own).
The ``_MSG`` variants are even more useful when the same expectation is called
multiple times (in a loop or helper function) and thus the line number isn't
enough to identify what failed, like below.
In some cases, it can be helpful to write a *table-driven test* instead, e.g.
.. code-block:: c
int i;
char out[40];
struct sha1_test_case {
const char *str;
const char *sha1;
};
struct sha1_test_case cases[] = {
{
.str = "hello world",
.sha1 = "2aae6c35c94fcfb415dbe95f408b9ce91ee846ed",
},
{
.str = "hello world!",
.sha1 = "430ce34d020724ed75a196dfc2ad67c77772d169",
},
};
for (i = 0; i < ARRAY_SIZE(cases); ++i) {
sha1sum(cases[i].str, out);
KUNIT_EXPECT_STREQ_MSG(test, (char *)out, cases[i].sha1,
"sha1sum(%s)", cases[i].str);
}
There's more boilerplate involved, but it can:
* be more readable when there are multiple inputs/outputs thanks to field names,
* E.g. see ``fs/ext4/inode-test.c`` for an example of both.
* reduce duplication if test cases can be shared across multiple tests.
* E.g. if we wanted to also test ``sha256sum``, we could add a ``sha256``
field and reuse ``cases``.
.. _kunit-on-non-uml: .. _kunit-on-non-uml:
KUnit on non-UML architectures KUnit on non-UML architectures
......
...@@ -80,6 +80,145 @@ struct timestamp_expectation { ...@@ -80,6 +80,145 @@ struct timestamp_expectation {
bool lower_bound; bool lower_bound;
}; };
static const struct timestamp_expectation test_data[] = {
{
.test_case_name = LOWER_BOUND_NEG_NO_EXTRA_BITS_CASE,
.msb_set = true,
.lower_bound = true,
.extra_bits = 0,
.expected = {.tv_sec = -0x80000000LL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NEG_NO_EXTRA_BITS_CASE,
.msb_set = true,
.lower_bound = false,
.extra_bits = 0,
.expected = {.tv_sec = -1LL, .tv_nsec = 0L},
},
{
.test_case_name = LOWER_BOUND_NONNEG_NO_EXTRA_BITS_CASE,
.msb_set = false,
.lower_bound = true,
.extra_bits = 0,
.expected = {0LL, 0L},
},
{
.test_case_name = UPPER_BOUND_NONNEG_NO_EXTRA_BITS_CASE,
.msb_set = false,
.lower_bound = false,
.extra_bits = 0,
.expected = {.tv_sec = 0x7fffffffLL, .tv_nsec = 0L},
},
{
.test_case_name = LOWER_BOUND_NEG_LO_1_CASE,
.msb_set = true,
.lower_bound = true,
.extra_bits = 1,
.expected = {.tv_sec = 0x80000000LL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NEG_LO_1_CASE,
.msb_set = true,
.lower_bound = false,
.extra_bits = 1,
.expected = {.tv_sec = 0xffffffffLL, .tv_nsec = 0L},
},
{
.test_case_name = LOWER_BOUND_NONNEG_LO_1_CASE,
.msb_set = false,
.lower_bound = true,
.extra_bits = 1,
.expected = {.tv_sec = 0x100000000LL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NONNEG_LO_1_CASE,
.msb_set = false,
.lower_bound = false,
.extra_bits = 1,
.expected = {.tv_sec = 0x17fffffffLL, .tv_nsec = 0L},
},
{
.test_case_name = LOWER_BOUND_NEG_HI_1_CASE,
.msb_set = true,
.lower_bound = true,
.extra_bits = 2,
.expected = {.tv_sec = 0x180000000LL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NEG_HI_1_CASE,
.msb_set = true,
.lower_bound = false,
.extra_bits = 2,
.expected = {.tv_sec = 0x1ffffffffLL, .tv_nsec = 0L},
},
{
.test_case_name = LOWER_BOUND_NONNEG_HI_1_CASE,
.msb_set = false,
.lower_bound = true,
.extra_bits = 2,
.expected = {.tv_sec = 0x200000000LL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NONNEG_HI_1_CASE,
.msb_set = false,
.lower_bound = false,
.extra_bits = 2,
.expected = {.tv_sec = 0x27fffffffLL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NONNEG_HI_1_NS_1_CASE,
.msb_set = false,
.lower_bound = false,
.extra_bits = 6,
.expected = {.tv_sec = 0x27fffffffLL, .tv_nsec = 1L},
},
{
.test_case_name = LOWER_BOUND_NONNEG_HI_1_NS_MAX_CASE,
.msb_set = false,
.lower_bound = true,
.extra_bits = 0xFFFFFFFF,
.expected = {.tv_sec = 0x300000000LL,
.tv_nsec = MAX_NANOSECONDS},
},
{
.test_case_name = LOWER_BOUND_NONNEG_EXTRA_BITS_1_CASE,
.msb_set = false,
.lower_bound = true,
.extra_bits = 3,
.expected = {.tv_sec = 0x300000000LL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NONNEG_EXTRA_BITS_1_CASE,
.msb_set = false,
.lower_bound = false,
.extra_bits = 3,
.expected = {.tv_sec = 0x37fffffffLL, .tv_nsec = 0L},
}
};
static void timestamp_expectation_to_desc(const struct timestamp_expectation *t,
char *desc)
{
strscpy(desc, t->test_case_name, KUNIT_PARAM_DESC_SIZE);
}
KUNIT_ARRAY_PARAM(ext4_inode, test_data, timestamp_expectation_to_desc);
static time64_t get_32bit_time(const struct timestamp_expectation * const test) static time64_t get_32bit_time(const struct timestamp_expectation * const test)
{ {
if (test->msb_set) { if (test->msb_set) {
...@@ -101,166 +240,35 @@ static time64_t get_32bit_time(const struct timestamp_expectation * const test) ...@@ -101,166 +240,35 @@ static time64_t get_32bit_time(const struct timestamp_expectation * const test)
*/ */
static void inode_test_xtimestamp_decoding(struct kunit *test) static void inode_test_xtimestamp_decoding(struct kunit *test)
{ {
const struct timestamp_expectation test_data[] = {
{
.test_case_name = LOWER_BOUND_NEG_NO_EXTRA_BITS_CASE,
.msb_set = true,
.lower_bound = true,
.extra_bits = 0,
.expected = {.tv_sec = -0x80000000LL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NEG_NO_EXTRA_BITS_CASE,
.msb_set = true,
.lower_bound = false,
.extra_bits = 0,
.expected = {.tv_sec = -1LL, .tv_nsec = 0L},
},
{
.test_case_name = LOWER_BOUND_NONNEG_NO_EXTRA_BITS_CASE,
.msb_set = false,
.lower_bound = true,
.extra_bits = 0,
.expected = {0LL, 0L},
},
{
.test_case_name = UPPER_BOUND_NONNEG_NO_EXTRA_BITS_CASE,
.msb_set = false,
.lower_bound = false,
.extra_bits = 0,
.expected = {.tv_sec = 0x7fffffffLL, .tv_nsec = 0L},
},
{
.test_case_name = LOWER_BOUND_NEG_LO_1_CASE,
.msb_set = true,
.lower_bound = true,
.extra_bits = 1,
.expected = {.tv_sec = 0x80000000LL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NEG_LO_1_CASE,
.msb_set = true,
.lower_bound = false,
.extra_bits = 1,
.expected = {.tv_sec = 0xffffffffLL, .tv_nsec = 0L},
},
{
.test_case_name = LOWER_BOUND_NONNEG_LO_1_CASE,
.msb_set = false,
.lower_bound = true,
.extra_bits = 1,
.expected = {.tv_sec = 0x100000000LL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NONNEG_LO_1_CASE,
.msb_set = false,
.lower_bound = false,
.extra_bits = 1,
.expected = {.tv_sec = 0x17fffffffLL, .tv_nsec = 0L},
},
{
.test_case_name = LOWER_BOUND_NEG_HI_1_CASE,
.msb_set = true,
.lower_bound = true,
.extra_bits = 2,
.expected = {.tv_sec = 0x180000000LL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NEG_HI_1_CASE,
.msb_set = true,
.lower_bound = false,
.extra_bits = 2,
.expected = {.tv_sec = 0x1ffffffffLL, .tv_nsec = 0L},
},
{
.test_case_name = LOWER_BOUND_NONNEG_HI_1_CASE,
.msb_set = false,
.lower_bound = true,
.extra_bits = 2,
.expected = {.tv_sec = 0x200000000LL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NONNEG_HI_1_CASE,
.msb_set = false,
.lower_bound = false,
.extra_bits = 2,
.expected = {.tv_sec = 0x27fffffffLL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NONNEG_HI_1_NS_1_CASE,
.msb_set = false,
.lower_bound = false,
.extra_bits = 6,
.expected = {.tv_sec = 0x27fffffffLL, .tv_nsec = 1L},
},
{
.test_case_name = LOWER_BOUND_NONNEG_HI_1_NS_MAX_CASE,
.msb_set = false,
.lower_bound = true,
.extra_bits = 0xFFFFFFFF,
.expected = {.tv_sec = 0x300000000LL,
.tv_nsec = MAX_NANOSECONDS},
},
{
.test_case_name = LOWER_BOUND_NONNEG_EXTRA_BITS_1_CASE,
.msb_set = false,
.lower_bound = true,
.extra_bits = 3,
.expected = {.tv_sec = 0x300000000LL, .tv_nsec = 0L},
},
{
.test_case_name = UPPER_BOUND_NONNEG_EXTRA_BITS_1_CASE,
.msb_set = false,
.lower_bound = false,
.extra_bits = 3,
.expected = {.tv_sec = 0x37fffffffLL, .tv_nsec = 0L},
}
};
struct timespec64 timestamp; struct timespec64 timestamp;
int i;
struct timestamp_expectation *test_param =
for (i = 0; i < ARRAY_SIZE(test_data); ++i) { (struct timestamp_expectation *)(test->param_value);
timestamp.tv_sec = get_32bit_time(&test_data[i]);
ext4_decode_extra_time(&timestamp, timestamp.tv_sec = get_32bit_time(test_param);
cpu_to_le32(test_data[i].extra_bits)); ext4_decode_extra_time(&timestamp,
cpu_to_le32(test_param->extra_bits));
KUNIT_EXPECT_EQ_MSG(test,
test_data[i].expected.tv_sec, KUNIT_EXPECT_EQ_MSG(test,
timestamp.tv_sec, test_param->expected.tv_sec,
CASE_NAME_FORMAT, timestamp.tv_sec,
test_data[i].test_case_name, CASE_NAME_FORMAT,
test_data[i].msb_set, test_param->test_case_name,
test_data[i].lower_bound, test_param->msb_set,
test_data[i].extra_bits); test_param->lower_bound,
KUNIT_EXPECT_EQ_MSG(test, test_param->extra_bits);
test_data[i].expected.tv_nsec, KUNIT_EXPECT_EQ_MSG(test,
timestamp.tv_nsec, test_param->expected.tv_nsec,
CASE_NAME_FORMAT, timestamp.tv_nsec,
test_data[i].test_case_name, CASE_NAME_FORMAT,
test_data[i].msb_set, test_param->test_case_name,
test_data[i].lower_bound, test_param->msb_set,
test_data[i].extra_bits); test_param->lower_bound,
} test_param->extra_bits);
} }
static struct kunit_case ext4_inode_test_cases[] = { static struct kunit_case ext4_inode_test_cases[] = {
KUNIT_CASE(inode_test_xtimestamp_decoding), KUNIT_CASE_PARAM(inode_test_xtimestamp_decoding, ext4_inode_gen_params),
{} {}
}; };
......
...@@ -94,6 +94,9 @@ struct kunit; ...@@ -94,6 +94,9 @@ struct kunit;
/* Size of log associated with test. */ /* Size of log associated with test. */
#define KUNIT_LOG_SIZE 512 #define KUNIT_LOG_SIZE 512
/* Maximum size of parameter description string. */
#define KUNIT_PARAM_DESC_SIZE 128
/* /*
* TAP specifies subtest stream indentation of 4 spaces, 8 spaces for a * TAP specifies subtest stream indentation of 4 spaces, 8 spaces for a
* sub-subtest. See the "Subtests" section in * sub-subtest. See the "Subtests" section in
...@@ -107,6 +110,7 @@ struct kunit; ...@@ -107,6 +110,7 @@ struct kunit;
* *
* @run_case: the function representing the actual test case. * @run_case: the function representing the actual test case.
* @name: the name of the test case. * @name: the name of the test case.
* @generate_params: the generator function for parameterized tests.
* *
* A test case is a function with the signature, * A test case is a function with the signature,
* ``void (*)(struct kunit *)`` * ``void (*)(struct kunit *)``
...@@ -141,6 +145,7 @@ struct kunit; ...@@ -141,6 +145,7 @@ struct kunit;
struct kunit_case { struct kunit_case {
void (*run_case)(struct kunit *test); void (*run_case)(struct kunit *test);
const char *name; const char *name;
const void* (*generate_params)(const void *prev, char *desc);
/* private: internal use only. */ /* private: internal use only. */
bool success; bool success;
...@@ -163,6 +168,27 @@ static inline char *kunit_status_to_string(bool status) ...@@ -163,6 +168,27 @@ static inline char *kunit_status_to_string(bool status)
*/ */
#define KUNIT_CASE(test_name) { .run_case = test_name, .name = #test_name } #define KUNIT_CASE(test_name) { .run_case = test_name, .name = #test_name }
/**
* KUNIT_CASE_PARAM - A helper for creation a parameterized &struct kunit_case
*
* @test_name: a reference to a test case function.
* @gen_params: a reference to a parameter generator function.
*
* The generator function::
*
* const void* gen_params(const void *prev, char *desc)
*
* is used to lazily generate a series of arbitrarily typed values that fit into
* a void*. The argument @prev is the previously returned value, which should be
* used to derive the next value; @prev is set to NULL on the initial generator
* call. When no more values are available, the generator must return NULL.
* Optionally write a string into @desc (size of KUNIT_PARAM_DESC_SIZE)
* describing the parameter.
*/
#define KUNIT_CASE_PARAM(test_name, gen_params) \
{ .run_case = test_name, .name = #test_name, \
.generate_params = gen_params }
/** /**
* struct kunit_suite - describes a related collection of &struct kunit_case * struct kunit_suite - describes a related collection of &struct kunit_case
* *
...@@ -208,6 +234,10 @@ struct kunit { ...@@ -208,6 +234,10 @@ struct kunit {
const char *name; /* Read only after initialization! */ const char *name; /* Read only after initialization! */
char *log; /* Points at case log after initialization */ char *log; /* Points at case log after initialization */
struct kunit_try_catch try_catch; struct kunit_try_catch try_catch;
/* param_value is the current parameter value for a test case. */
const void *param_value;
/* param_index stores the index of the parameter in parameterized tests. */
int param_index;
/* /*
* success starts as true, and may only be set to false during a * success starts as true, and may only be set to false during a
* test case; thus, it is safe to update this across multiple * test case; thus, it is safe to update this across multiple
...@@ -1742,4 +1772,25 @@ do { \ ...@@ -1742,4 +1772,25 @@ do { \
fmt, \ fmt, \
##__VA_ARGS__) ##__VA_ARGS__)
/**
* KUNIT_ARRAY_PARAM() - Define test parameter generator from an array.
* @name: prefix for the test parameter generator function.
* @array: array of test parameters.
* @get_desc: function to convert param to description; NULL to use default
*
* Define function @name_gen_params which uses @array to generate parameters.
*/
#define KUNIT_ARRAY_PARAM(name, array, get_desc) \
static const void *name##_gen_params(const void *prev, char *desc) \
{ \
typeof((array)[0]) *__next = prev ? ((typeof(__next)) prev) + 1 : (array); \
if (__next - (array) < ARRAY_SIZE((array))) { \
void (*__get_desc)(typeof(__next), char *) = get_desc; \
if (__get_desc) \
__get_desc(__next, desc); \
return __next; \
} \
return NULL; \
}
#endif /* _KUNIT_TEST_H */ #endif /* _KUNIT_TEST_H */
...@@ -325,39 +325,72 @@ static void kunit_catch_run_case(void *data) ...@@ -325,39 +325,72 @@ static void kunit_catch_run_case(void *data)
* occur in a test case and reports them as failures. * occur in a test case and reports them as failures.
*/ */
static void kunit_run_case_catch_errors(struct kunit_suite *suite, static void kunit_run_case_catch_errors(struct kunit_suite *suite,
struct kunit_case *test_case) struct kunit_case *test_case,
struct kunit *test)
{ {
struct kunit_try_catch_context context; struct kunit_try_catch_context context;
struct kunit_try_catch *try_catch; struct kunit_try_catch *try_catch;
struct kunit test;
kunit_init_test(&test, test_case->name, test_case->log); kunit_init_test(test, test_case->name, test_case->log);
try_catch = &test.try_catch; try_catch = &test->try_catch;
kunit_try_catch_init(try_catch, kunit_try_catch_init(try_catch,
&test, test,
kunit_try_run_case, kunit_try_run_case,
kunit_catch_run_case); kunit_catch_run_case);
context.test = &test; context.test = test;
context.suite = suite; context.suite = suite;
context.test_case = test_case; context.test_case = test_case;
kunit_try_catch_run(try_catch, &context); kunit_try_catch_run(try_catch, &context);
test_case->success = test.success; test_case->success = test->success;
kunit_print_ok_not_ok(&test, true, test_case->success,
kunit_test_case_num(suite, test_case),
test_case->name);
} }
int kunit_run_tests(struct kunit_suite *suite) int kunit_run_tests(struct kunit_suite *suite)
{ {
char param_desc[KUNIT_PARAM_DESC_SIZE];
struct kunit_case *test_case; struct kunit_case *test_case;
kunit_print_subtest_start(suite); kunit_print_subtest_start(suite);
kunit_suite_for_each_test_case(suite, test_case) kunit_suite_for_each_test_case(suite, test_case) {
kunit_run_case_catch_errors(suite, test_case); struct kunit test = { .param_value = NULL, .param_index = 0 };
bool test_success = true;
if (test_case->generate_params) {
/* Get initial param. */
param_desc[0] = '\0';
test.param_value = test_case->generate_params(NULL, param_desc);
}
do {
kunit_run_case_catch_errors(suite, test_case, &test);
test_success &= test_case->success;
if (test_case->generate_params) {
if (param_desc[0] == '\0') {
snprintf(param_desc, sizeof(param_desc),
"param-%d", test.param_index);
}
kunit_log(KERN_INFO, &test,
KUNIT_SUBTEST_INDENT
"# %s: %s %d - %s",
test_case->name,
kunit_status_to_string(test.success),
test.param_index + 1, param_desc);
/* Get next param. */
param_desc[0] = '\0';
test.param_value = test_case->generate_params(test.param_value, param_desc);
test.param_index++;
}
} while (test.param_value);
kunit_print_ok_not_ok(&test, true, test_success,
kunit_test_case_num(suite, test_case),
test_case->name);
}
kunit_print_subtest_end(suite); kunit_print_subtest_end(suite);
......
...@@ -23,6 +23,11 @@ DEFAULT_KUNITCONFIG_PATH = 'arch/um/configs/kunit_defconfig' ...@@ -23,6 +23,11 @@ DEFAULT_KUNITCONFIG_PATH = 'arch/um/configs/kunit_defconfig'
BROKEN_ALLCONFIG_PATH = 'tools/testing/kunit/configs/broken_on_uml.config' BROKEN_ALLCONFIG_PATH = 'tools/testing/kunit/configs/broken_on_uml.config'
OUTFILE_PATH = 'test.log' OUTFILE_PATH = 'test.log'
def get_file_path(build_dir, default):
if build_dir:
default = os.path.join(build_dir, default)
return default
class ConfigError(Exception): class ConfigError(Exception):
"""Represents an error trying to configure the Linux kernel.""" """Represents an error trying to configure the Linux kernel."""
...@@ -97,9 +102,7 @@ class LinuxSourceTreeOperations(object): ...@@ -97,9 +102,7 @@ class LinuxSourceTreeOperations(object):
def linux_bin(self, params, timeout, build_dir): def linux_bin(self, params, timeout, build_dir):
"""Runs the Linux UML binary. Must be named 'linux'.""" """Runs the Linux UML binary. Must be named 'linux'."""
linux_bin = './linux' linux_bin = get_file_path(build_dir, 'linux')
if build_dir:
linux_bin = os.path.join(build_dir, 'linux')
outfile = get_outfile_path(build_dir) outfile = get_outfile_path(build_dir)
with open(outfile, 'w') as output: with open(outfile, 'w') as output:
process = subprocess.Popen([linux_bin] + params, process = subprocess.Popen([linux_bin] + params,
...@@ -108,22 +111,13 @@ class LinuxSourceTreeOperations(object): ...@@ -108,22 +111,13 @@ class LinuxSourceTreeOperations(object):
process.wait(timeout) process.wait(timeout)
def get_kconfig_path(build_dir): def get_kconfig_path(build_dir):
kconfig_path = KCONFIG_PATH return get_file_path(build_dir, KCONFIG_PATH)
if build_dir:
kconfig_path = os.path.join(build_dir, KCONFIG_PATH)
return kconfig_path
def get_kunitconfig_path(build_dir): def get_kunitconfig_path(build_dir):
kunitconfig_path = KUNITCONFIG_PATH return get_file_path(build_dir, KUNITCONFIG_PATH)
if build_dir:
kunitconfig_path = os.path.join(build_dir, KUNITCONFIG_PATH)
return kunitconfig_path
def get_outfile_path(build_dir): def get_outfile_path(build_dir):
outfile_path = OUTFILE_PATH return get_file_path(build_dir, OUTFILE_PATH)
if build_dir:
outfile_path = os.path.join(build_dir, OUTFILE_PATH)
return outfile_path
class LinuxSourceTree(object): class LinuxSourceTree(object):
"""Represents a Linux kernel source tree with KUnit tests.""" """Represents a Linux kernel source tree with KUnit tests."""
......
...@@ -135,8 +135,8 @@ def parse_ok_not_ok_test_case(lines: List[str], test_case: TestCase) -> bool: ...@@ -135,8 +135,8 @@ def parse_ok_not_ok_test_case(lines: List[str], test_case: TestCase) -> bool:
else: else:
return False return False
SUBTEST_DIAGNOSTIC = re.compile(r'^[\s]+# .*?: (.*)$') SUBTEST_DIAGNOSTIC = re.compile(r'^[\s]+# (.*)$')
DIAGNOSTIC_CRASH_MESSAGE = 'kunit test case crashed!' DIAGNOSTIC_CRASH_MESSAGE = re.compile(r'^[\s]+# .*?: kunit test case crashed!$')
def parse_diagnostic(lines: List[str], test_case: TestCase) -> bool: def parse_diagnostic(lines: List[str], test_case: TestCase) -> bool:
save_non_diagnositic(lines, test_case) save_non_diagnositic(lines, test_case)
...@@ -146,7 +146,8 @@ def parse_diagnostic(lines: List[str], test_case: TestCase) -> bool: ...@@ -146,7 +146,8 @@ def parse_diagnostic(lines: List[str], test_case: TestCase) -> bool:
match = SUBTEST_DIAGNOSTIC.match(line) match = SUBTEST_DIAGNOSTIC.match(line)
if match: if match:
test_case.log.append(lines.pop(0)) test_case.log.append(lines.pop(0))
if match.group(1) == DIAGNOSTIC_CRASH_MESSAGE: crash_match = DIAGNOSTIC_CRASH_MESSAGE.match(line)
if crash_match:
test_case.status = TestStatus.TEST_CRASHED test_case.status = TestStatus.TEST_CRASHED
return True return True
else: else:
......
Markdown is supported
0%
or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment