Lines Matching +full:- +full:runs

33     """Benchmark one test-case
35     test_func   -- benchmarking function with prototype
43     test_env    -- test environment - opaque first argument for test_func
44     test_case   -- test case - opaque second argument for test_func
45     count       -- how many times to call test_func, to calculate average
46     initial_run -- do initial run of test_func, which don't get into result
47     slow_limit  -- stop at slow run (that exceedes the slow_limit by seconds).
49     drop_caches -- drop caches before each run
52         'runs':     list of test_func results
58         'n-failed': number of failed runs (exists only if at least one run
66     runs = []
74         runs.append(res)
76         if time.time() - t > slow_limit:
77             print('    - run is too slow, stop here')
80     count = len(runs)
82     result = {'runs': runs}
84     succeeded = [r for r in runs if ('seconds' in r or 'iops' in r)]
101         result['n-failed'] = count - len(succeeded)
109     test_func -- benchmarking function, see bench_one for description
110     test_envs -- list of test environments, see bench_one
111     test_cases -- list of test cases, see bench_one
112     args, vargs -- additional arguments for bench_one