• Pedro Tammela's avatar
    selftests/tc-testing: implement tdc parallel test run · ac9b8293
    Pedro Tammela authored
    Use a Python process pool to run the tests in parallel.
    Not all tests can run in parallel, for instance tests that are not
    namespaced and tests that use netdevsim, as they can conflict with one
    another.
    
    The code logic will split the tests into serial and parallel.
    For the parallel tests, we build batches of 32 tests and queue each
    batch on the process pool. For the serial tests, they are queued as a
    whole into the process pool, which in turn executes them concurrently
    with the parallel tests.
    
    Even though the tests serialize on rtnl_lock in the kernel, this feature
    showed results with a ~3x speedup on the wall time for the entire test suite
    running in a VM:
       Before - 4m32.502s
       After - 1m19.202s
    
    Examples:
       In order to run tdc using 4 processes:
          ./tdc.py -J4 <...>
       In order to run tdc using 1 process:
          ./tdc.py -J1 <...> || ./tdc.py <...>
    
    Note that the kernel configuration will affect the speed of the tests,
    especially if such configuration slows down process creation and/or
    fork().
    Tested-by: default avatarDavide Caratti <dcaratti@redhat.com>
    Signed-off-by: default avatarPedro Tammela <pctammela@mojatatu.com>
    Acked-by: default avatarJamal Hadi Salim <jhs@mojatatu.com>
    Signed-off-by: default avatarPaolo Abeni <pabeni@redhat.com>
    ac9b8293
nsPlugin.py 7.51 KB