b517f2e13b
Add regression test for #366 to the testsuite
7 years ago
9b08354aca
Add reproducer for #365 to the testsuite
7 years ago
653814afb0
[testsuite] Allow setting the binary location for make tests
7 years ago
35e7037f86
[testsuite] Change the calling order of setUp & tearDown in decorator
...
The FileDecoratorBase injects a new setUp & tearDown function. These new
functions would call the old setUp & tearDown in an inconvenient order: e.g. the
child class CopyFiles would at first call the user provided setUp and then copy
the files. This makes it impossible to perform some action on the file copy in
setUp.
=> This commit changes the call order, so that setUp & tearDown always "see" the
finished environment after file copies are in place and before any cleanup took
place.
7 years ago
39b7151b2e
[testsuite] Port redmine issues 831 to 937 to the new testsuite
7 years ago
7e1cd7d1b6
[testsuite] Fix name of regression test #283
...
issue got a CVE assigned
7 years ago
5bd26ee82b
Port redmine issues 1179-1305
...
- Authorship: Luis Díaz Más & Dan Čermák
7 years ago
d7f4453dbd
[testsuite] Remove usage of $cat via hooks
7 years ago
41ac25c4f4
[testsuite] Add hooks & documentation for hooks
7 years ago
23e29e9527
[testsuite] Use system_tests.path() in some test cases
7 years ago
4e32929956
[testsuite] Add notes concerning escaping in commands
7 years ago
53c265f8a7
[testsuite] Add path conversion function
7 years ago
300b1dc0ef
[testsuite] Testsuite injects config file values into its namespace
7 years ago
8eca055058
Add POC + regression test.
...
Note that we override here the method check_no_ASAN_UBSAN_errors to also
analyze the last two lines of got_stderr.
7 years ago
b8b94dc67a
Escape characters properly once we started using python literals
7 years ago
48078e9c8b
Fix tests on windows by using os.path.join
7 years ago
72faa7331d
Fix issues with python strings & literals
7 years ago
90c8d754b7
[testsuite] Call subprocess.Popen() with shell=True on Windows
7 years ago
939ded283f
[testsuite] check stderr before stdout
...
That way you get to see error messages about wrong filenames instead of an
empty stdout
7 years ago
f55cdce761
[testsuite] Port redmine issues 498-825
7 years ago
2356984274
[testsuite] Ported redmine bugfixes 426-495
7 years ago
2fb00c8a16
Analyze minimum needed number of null separators in PngChunk::parseTXTChunk
...
This commit fixes the heap-buffer-overflow in PngChunk::parseTXTChunk.
According to the specification:
http://www.libpng.org/pub/png/spec/1.2/PNG-Chunks.html
There must be 2 null separators when we start to analyze the language tag.
7 years ago
234e5794f6
Add tests for #306
7 years ago
cb5135f772
Add test for Canon M100 ModelID
7 years ago
4239ff6734
Test for Tamron SP AF 150-600mm F/5-6.3 VC USD G2 (A022) for Nikon
7 years ago
b364e075c6
[testsuite] Implement DeleteFiles decorator
...
- Refactor FileDecoratorBase to use an arbitrary property in the decorated
class where the list of files is saved
- Add DeleteFiles decorator which deletes all files passed to it after the test
finished
7 years ago
d1714f6564
[testsuite] Fix typo and obsolete syntax
7 years ago
fe98936375
[testsuite] Fixed infinite iteration in CaseMeta.__new__
...
The loop condition in the variable expansion loop was faulty and caused an
infinite loop when no change occured (i.e. no variables were expanded)
7 years ago
740e4ecad1
[testsuite] Improve output in case of errors
...
use the msg= option of unittest.assertXyz() to improve the error
reporting
7 years ago
b6d93558ee
[testsuite] Added option to use different encodings for the output
7 years ago
dd3bcaf41f
[testsuite] Added check that test list have same length
...
commands, retval, stdout & stderr are lists
if they don't have the same length, they are truncated to the smallest list
thereby silently dropping test cases
=> now a ValueError is raised preventing that
7 years ago
11cd1eabf8
[testsuite] Addapt tests to new test suite structure
7 years ago
c40c90141f
[testsuite] Add debug mode & search directory to runner
7 years ago
4656af73bc
[testsuite] Fix variable names in suite config
...
The variables contained a minus which must not be used in template string
variables.
=> Use underscores instead
7 years ago
cac0bc9656
[testsuite] Adapt documentation to recent changes
...
- change from {var} => $var
- use metaclass instead of direct inheritance
7 years ago
bd9d085141
[testsuite] Refactor test suite to use metaclasses & template module
...
The testsuite now uses python's template module for string substitutions which
allows for a more natural substitution syntax known from the shell. Also, it
allows to run the substitutions multiple times, which is not possible with
string.format().
The heavy-lifting is now performed via a metaclass, which expands all variables
on the class creation.
7 years ago
ffab622633
Add reproducer for #247
7 years ago
08aa27ae37
Add reproducers for #253 and #246
7 years ago
1f32207271
[testsuite] rename test_issue_208 -> test_CVE_2017_17722
...
the issue got a CVE assigned
7 years ago
4533d60e74
[testsuite] Added helper function for system_tests.Case.compare_stderr
7 years ago
02f60f11ae
[testsuite] Reimplemented a part of system_tests.CopyFiles
...
- main file handling functionality is performed by a base class => can
be easier extended if required
7 years ago
3b01d5205a
[testsuite] Port all regression tests for github issues
7 years ago
3cbb031442
[testsuite] Unified CVE test cases
7 years ago
e597e5b811
[testsuite] Fixed CVE number
7 years ago
c754ca6d14
[testsuite] Corrected class name, issue had no CVE assigned
7 years ago
71f9a24027
[testsuite] Unified variable names
7 years ago
48982697b0
Add reproducer for CVE-2017-1000126 to the test suite
7 years ago
59b148aee9
Add regression test for CVE-2017-18005
7 years ago
cabf756553
Add reproducer for #170 to the test suite
7 years ago
73ac02d7f2
Added test for Sigma lenses
7 years ago
3965a44df2
Replace error variable names in test suite with enum error codes
7 years ago
a15f090f81
Modified test suite so that case sensitive keys are possible
7 years ago
ead7f309b0
Added reproducer for CVE-2017-1000127
7 years ago
72de0f96f3
Added reproducer for CVE-2018-4868 to the test suite
7 years ago
a1f1989cb5
Merge branch 'master' into master
7 years ago
80c4d95171
Add regression test for CVE 2017-17669
8 years ago
e0ab5aaa87
Add error 14 text as a variable to the test suite
8 years ago
421c6d6723
improvements for issue #208
8 years ago
dba9fba725
test for issue #208
8 years ago
9900f523fe
Added reproducer for #201 to the test suite
8 years ago
5267123186
Ported tiff-test.sh
8 years ago
085c9715fc
Added some example test cases to the new test suite
8 years ago
2e745b0b26
Added replacement for the current regression test suite
8 years ago
Dan Čermák
Luis Diaz Mas
Daniel Zucchetto
Robin Mills
Michał Walenciak