View Issue Details

This bug affects 1 person(s).
 10
IDProjectCategoryView StatusLast Update
14734Feature requestsStatisticspublic2019-05-17 08:29
Reporterkelseysutton18 Assigned To 
PrioritynormalSeverityfeature 
Status closedResolutionduplicate 
Summary14734: knowing presentation order of randomized questions can be important
Description

Randomization of questions is a great feature included in LimeSurvey 1.91. For people using LimeSurvey in psychological research, however, knowing the order in which randomized trials are presented can be important. In the analysis of psychological data, trial number is often included as an additional variable, to account for learning or fatigue effects.

Additional Information

A possible solution: store presentation order of randomized questions
Although I don't know myself how to implement this, it does not seem that hard to me to store the presentation order with the survey results. A trial number variable can be added to the results, with a value for each question whenever the survey administrator chooses to randomize the order of the questions. Same goes for the randomization of answers within a question.

TagsNo tags attached.
Bug heat10
Story point estimate
Users affected %

Relationships

duplicate of 07486 acknowledged knowing presentation order of randomized questions can be important 

Users monitoring this issue

emrys, kelseysutton18

Activities

user20760

2012-07-07 11:55

  ~51324

Alternative solution: Store presentation order in a string before presentation of first question
As a professional researcher in psychology I definietely subscribe to the notion that the current implementation of the randomization option lacks one central feature needed, i.e. that the very order of presentation for each response is logged. However, this is needed for subsequent item analyses (i.e. halo effects etc.)!

I therefore propse an alternative solution, namely, that for each group (or, indeed, across groups or all survey items?) the order of question presentation is determined before the first question is presented.

For example, this could easily be done by creating and writing to a long string field within the limesurvey[number] table which determines the order of presentation for each respondent. (Ideally, this should work for both randomized and nonrandom questions!!)

Then, for each group or question presented, the order can easily be determined by reading of the substrings of this field.

emrys

emrys

2014-05-28 18:53

reporter   ~51325

I agree. For psychological research this is critical. We need to know the presentation order for randomized questions.

Another situation where this would be needed. Imagine I want to present a set of randomized items, in separated screens. I want to ask two types of questions for each item in different screens (e.g. First answer Yes/No to a question, then tell me how confident you are in your response). As far as I see, there is no way to do this right now.

Storing the presentation order for the items would solve this type of problem.

DenisChenu

DenisChenu

2019-05-16 11:48

developer   ~51960

getQuestionOrder : «Fill a question with the final order of question and/or group in any survey»

DenisChenu

DenisChenu

2019-05-17 08:29

developer   ~51977

https://bugs.limesurvey.org/view.php?id=7486

Issue History

Date Modified Username Field Change
2019-04-03 19:05 kelseysutton18 New Issue
2019-04-03 19:05 kelseysutton18 Issue generated from: 07486
2019-04-03 19:24 kelseysutton18 Issue Monitored: kelseysutton18
2019-05-16 11:48 DenisChenu Note Added: 51960
2019-05-17 08:29 DenisChenu Relationship added duplicate of 07486
2019-05-17 08:29 DenisChenu Status acknowledged => closed
2019-05-17 08:29 DenisChenu Resolution open => duplicate
2019-05-17 08:29 DenisChenu Note Added: 51977
2021-08-02 20:55 guest Bug heat 6 => 10