Have you ever wondered how the NCIDQ test questions for IDFX and IDPX are created?
It's a common question we receive here at Qpractice and in the study group, especially during exam season.
Learn about the Practice Analysis
Every 5 years, CIDQ conducts a practice analysis.
First, a panel of testing and industry experts work with interior design professionals to develop an overall plan for the exam.
Next, they conduct a survey of professional interior designers and NCIDQ Certificate holders. This survey determines the actual knowledge, tasks and skills used on-the job, so that the test reflects current interior design practice.
CIDQ uses this feedback to define which subjects or areas of practice are most important to measure. These topics align with skills relevant to current practice and important to daily job tasks. This knowledge distinguishes a NCIDQ certificate holder as a competent professional interior designer.
The NCIDQ Exam Blueprint
CIDQ uses the results of the practice analysis to develop the weight and scoring of different content areas on the exam, called a blueprint.
Questions are developed following standards and guidelines for professional certification exams. These standards include those set by the American Educational Research Association, the American Psychological Association, the National Council on Measurement in Education and the American Educational Research Association.
How NCIDQ Test Questions are Developed
Writing questions is an involved and time consuming process. CIDQ assembles a team of volunteer interior designers who work together with testing and subject matter experts to make sure that the questions are valid and fair.
From Bradley Moore, NCIDQ Item writer
I was selected to serve on a prior Writer's Workshop and I can attest to the fact that creating the questions is a laborious task.
One's initial thought for a question may come relatively easy, but the steps involved in insuring that it is both fair and well-documented can be most trying. An individual could easily spend in excess of two hours on a single item, have it judged, write a revision submittal and still not have it be approved for entry into the exam.
It was an extremely rewarding experience and at times a bit humbling. The one point I would like to make is how very proud I was to see the effort that went into the process and the high standards that were required. The result is an amazing exam.
He also noted that a relatively small percentage of questions that passed through the criteria required to finally be accepted.
The workshop process lasted about 3-5 months and can be exhausting due to
- creating the question
- putting into an accurate/fair multiple choice format
- assigning it to a particular category
- having it reviewed
- revising it for yet another review
- finally learn if it was one of few chosen for the exam
Most importantly, he said it was worth the effort.
Distribution of NCIDQ Test Questions
The tests are composed of questions in the quantity and weight as listed in the exam blueprint, or distribution of questions:
Test administrator Prometric estimates that this process may cost from $250 to $1000 per single test item*.
So for example, on IDFX and IDPX with 150 to 175 questions, this means the range can be from $37,500 – $175,00 per exam!
CIDQ also pretests all new questions on exams as experimental questions. These questions aren't scored, and may not fit the distribution of content for current exam, so don't let this throw you off.
If you took the NCIDQ exam before, you've taken an experimental pretest question. Click To Tweet
Pretesting is important because it helps them discover flaws in a question. But it may leave you feeling a little rattled when you come across something you don't know, or you haven't studied at all. CIDQ may find that a topic they thought was suitable for IDFX might actually be more appropriate for IDPX.
Keep in mind that a variety of professionals collaborate on these questions. These interior designers may also have vastly different work experience than you. Even when you meet the minimum work experience requirements, you often need more exposure to other systems and processes.
The test questions must meet 8 standards to be included in the NCIDQ Exam. Here's a simplified list:
They can only be used in the exam when all test writers agree that the question tests knowledge and skills that:
- Protect the health, safety, and welfare of the public.
- Is essential and appropriate knowledge for a competent interior designer.
- Getting the answer correct would clearly distinguish one designer from another who is not qualified
- The correct answer or solution is defensible which means it can be documented by an outside source. This is key, see some of the sources that we recommend here, and view the CIDQ reference list. Qpractice uses many of these verified references in our course material and to create our practice test explanations.
- The incorrect answers are written in such a way that might seem correct to an an unqualified designer. This is why you might sometimes feel like a question is deliberately tricky. The purpose is to weed those who really don't understand the subject out.
Once you know this, it can help you frame the question in your mind in a way that you are more likely to choose the same answer that CIDQ does.
The key is to think about how to best achieve the goal that the question is asking for (how do you do this, what should you do in this situation) in a way that:
- is protecting the occupants' safety
- is ethical and does not conflict with the client's best interest
- is most cost-effective of the given choices
- is sustainable and not wasteful of natural resources
- is not necessarily the way you do things in your firm or practice, but again — can be validated through outside sources
In all cases you want to choose the best answer of the given choices, the other answer options may not be 100% wrong, but only 1 is the very best choice.
Grading the Exam
If you took the LEED Exam and have gotten your scores right away, it can be hard to understand why it takes so long to get your NCIDQ Exam results. That's because there is just as much work that goes into processing your answers after the exam as there is before the exam.
Simply put, the exam is scored from 200 to 800. This is NOT a 100 point exam, throw all your expectations out the window.
- 200 = 0% or none correct
- 800= 100% all correct
- 500 = the minimum passing point*
This is not the same as 50%. And the experimental questions don't count.
You want to aim for as high as score as possible, because you are also graded against others. Remember the exam has different questions or drawings each year, but the test must be equally difficult for everyone.
Meaning that it should be:
- just as hard as the exam that designers took 5 years ago
- just as hard as the one I took
- just as hard as last year
and will be equally difficult for those who take 5 years from now.
Prometric uses statistical analysis to account for that. They also use psychometric analysis to compare scores across different candidates. It's not just your raw score, it needs to be processed against others who took the same exam you did and those who took it before you.
So, How Can You Do Better on the NCIDQ?
While talking with our new Qpractice experts panel this season (we're adding 25 to our page :), I noticed that designers who scored 100% in any of the NCIDQ content areas, had experience with that specific topic in their job — yep, they did this at work. That's why we're working with these designers to add on detailed exam questions reflecting the new exam changes.
So here's what you can do:
Review Your Past Scores vs. The 2016 NCIDQ Exam
Review your past scores against your worksheet in the Pass the NCIDQ Exam in 2016. You'll be able to compare the number of questions you got right or wrong against the number in the new exam. You'll see exactly where your shortcomings are.
Beef Up Your Work Experience
Go to your boss, and ask to work on a project where you can develop those skills.
Yes, part of the best way you can prepare is to connect what you're studying to your work. It can be very difficult to learn something from a book without any actual practical experience, so do this now. This is why approximately 2 years of work experience are required before you are eligible to take the exam.
Know Your Why
You're much more likely to succeed when you get very specific about the steps you'll take to pass the exam, and your reasons for taking the exam.
When you connect this to an outcome — both positive and negative, this can be the missing piece of your NCIDQ Exam puzzle.