Post new topic Reply to topic  [ 1 post ] 
Author Message
 Post subject: howto discover bugs
PostPosted: Tue Nov 25, 2014 9:51 pm 

during last months using random input 21 bugs were discovered in 'libfactory'. 20 of them were fixed( by Martin Lee and Hans Schoenemann).
Statistic data from other software projects/studies suggests that there are more undiscovered bugs,
but how to detect them?

The random testing method from above has its issues:
- meanwhile a lot of examples are required to discover the next bug
- the input examples may be not random enough or do not cover interesting use cases.

It is known and I can confirm from own experience that applying different test methods
will not detect the same set of defects, so testing methods may used complementary.

following additional methods could be applied (to factory)
- code review (AFAIK was not done for 'libfactory') The expected cost is about an hour for 100-200 loc for a reviewer who is familiar with 'libfactory'
- writing tests for every routine (not only for the interfaces) using a framework like googletest
- others?


Report this post
Reply with quote  
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 1 post ] 

You can post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

It is currently Sat Mar 23, 2019 6:51 am
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group