The purpose of this study is to develop and analyse a grammar test, focusing on validity, reliability and fairness. Effective test development requires a systematic, well-organized approach, thus ensuring the veracity of the proposed inferences from the test scores, (Downing, 2006a). This systematic approach is outlined in the paper, expounding on how the test developed from the initial stage of identifying the construct to be measured, to the final stages of administering the test. This is followed by a detailed analysis of the test results which highlights possible threats to the test‘s validity, reliability and fairness. It also places the construct map under scrutiny, and questions whether the construct was successfully tested. The test was developed utilizing the four building blocks propounded by Wilson (2005). Each building block is explained in detail which gives insight into the process undertaken to write and analyse the test.