Asking the Right Questions
At Aspeq, we understand that high-quality assessments start with well-crafted questions. When we welcome a new client, one of our first priorities is to collaborate on developing or migrating a comprehensive question bank.
A robust question bank is essential for delivering assessments with integrity, and it’s at the core of what we do. Aspeq manages question banks for over 25 international clients, offering flexible solutions tailored to each organisation’s needs.
At Aspeq, we understand that high-quality assessments start with well-crafted questions. When we welcome a new client, one of our first priorities is to collaborate on developing or migrating a comprehensive question bank.
A robust question bank is essential for delivering assessments with integrity, and it’s at the core of what we do. Aspeq manages question banks for over 25 international clients, offering flexible solutions tailored to each organisation’s needs.
Global Expertise, Local Knowledge
From sourcing subject matter experts (SMEs) to crafting new questions from scratch, to maintaining and delivering high-stakes assessments through a secure online portal, we provide end-to-end support.
Aspeq’s global network includes more than 80 technical and non-technical SMEs who write, review, and test questions. These experts are leaders in their respective fields, with the necessary qualifications and experience to ensure industry and regulatory compliance. Many hold active practising licences, and all undergo a rigorous recruitment process, including security and conflict of interest checks, to ensure they meet our high standards.
New SMEs are paired with experienced professionals who have a longstanding relationship with Aspeq, ensuring quality and consistency throughout the question development process. Because our experts are based worldwide, we can leverage both local knowledge and global expertise to create the best possible assessments.
Rebecca Premraj, Aspeq’s Assessment Coordinator, explains, “We work with SMEs across the globe, each with a deep understanding of their country’s regulatory requirements. This ensures our assessments meet local needs while also benefiting from a global perspective. We’re not restricted by geography, which means we can always engage the best person for the job.”
The Art of Question Writing
No matter a client’s specific requirements, Aspeq follows a rigorous process for writing, editing, reviewing, and testing exam questions.
“A new question goes through at least six pairs of hands—four technical SMEs and two non-technical SMEs—before it is finalised,” says Rebecca.
The process begins with a syllabus that defines the topics to be tested. The exam structure is then mapped out in a blueprint, which determines how questions are allocated across different subject areas.
Each question is reviewed by a non-technical editor specialising in copywriting and style guides, who works with the SME to ensure clarity and consistency. New SMEs also have their work evaluated by senior technical SMEs to confirm their aptitude for question writing.
After multiple iterations, an independent technical moderator reviews the question, followed by a proofreader who ensures grammatical accuracy and adherence to industry style guides.
“This step is crucial,” Rebecca explains. “For example, we check how units of measurement are represented to ensure consistency and avoid confusion.”
Before a question is used in a live assessment, it undergoes a final test by a technical expert who was not involved in its development.
“At this stage, the SME sits the exam as a candidate would, to identify any ambiguities or technical issues before it goes live,” Rebecca adds.
Ensuring Quality Through Data
Once new questions are introduced into an assessment, Aspeq’s in-house statistician closely monitor performance.
Candidates can also provide feedback on questions, which helps us refine and improve the question bank. All findings are compiled into a comprehensive report, which we share with our clients as part of our ongoing quality assurance process. Most clients update a portion of their question bank annually.
“This keeps assessments fresh and minimises the risk of questions being shared between candidates over time,” says Rebecca. “It also helps us identify problematic questions early, ensuring that candidates are treated fairly and clients receive assessments they can trust.”
Meet the Team
Aspeq’s question banks are managed by our dedicated Assessment Services Team, based in our Lower Hutt office. Led by Manager Duncan Macgregor, the team includes ten specialists, covering assessment coordination, technical expertise, statistical analysis, and client support.
While our team members specialise in different industries, such as aviation or health, they work closely together to ensure seamless service for our clients.
“This structure allows us to develop strong relationships with our clients, building an in-depth understanding of their subject matter and assessment needs,” Rebecca says. “At the same time, we support each other as a close-knit team.”
“I’m proud to be part of this team. We uphold the highest standards of integrity in everything we do, while always keeping our clients and candidates at the heart of our work.”