View Issue Details

IDProjectCategoryView StatusLast Update
15138Bug reports[All Projects] Import/Exportpublic2019-08-12 20:49
Reporterpnickel Assigned Tomarkusfluer  
PrioritynoneSeveritymajor 
Status feedbackResolutionopen 
Product Version3.17.x 
Target VersionFixed in Version 
Summary15138: Imports complete, but add no structure
Description

Sometimes when I import a survey created in Excel (saved in TSV) the import will complete, but the summary shows "0" for everything except name (blank) and survey number (generated by import even when the import includes a number).

Steps To Reproduce

I repeatedly imported files, starting with only a few records and expanding, until one failed. Further imports with more records confirmed the problem. If any "text" column includes an advanced character (as generated in Word) such as em-dash or slanted quote, the whole import fails.

Additional Information

I have not tested to see if the problem occurs only with specific symbols or with all ASCII characters above a given number (eg: 127).

TagsNo tags attached.
Complete LimeSurvey version number (& build)Version 3.17.5+190604
I will donate to the project if issue is resolvedNo
BrowserFirefox
Database & DB-Versionwhatever Limesurvey sets up
Server OS (if known)
Webserver software & version (if known)
PHP Versionnot using Php as far as I know

Activities

DenisChenu

DenisChenu

2019-08-06 19:13

developer   ~53139

I think it's due to UTF8.
Can you send a light survey broken files please ?

pnickel

pnickel

2019-08-12 20:49

reporter  

limesurvey_survey_example import error.txt (27,431 bytes)
id	related_id	class	type/scale	name	relevance	text	help	language	validation	mandatory	other	default	same_default	allowed_filetypes	alphasort	answer_width	answer_width_bycolumn	array_filter	array_filter_exclude	array_filter_style	assessment_value	category_separator	choice_input_columns	choice_title	code_filter	commented_checkbox	commented_checkbox_auto	cssclass	date_format	date_max	date_min	display_columns	display_rows	display_type	dropdown_dates	dropdown_dates_minute_step	dropdown_dates_month_style	dropdown_prefix	dropdown_prepostfix	dropdown_separators	dropdown_size	dualscale_headerA	dualscale_headerB	em_validation_q	em_validation_q_tip	em_validation_sq	em_validation_sq_tip	equals_num_value	equation	exclude_all_others	exclude_all_others_auto	hidden	hide_tip	input_boxes	input_size	label_input_columns	location_city	location_country	location_defaultcoordinates	location_mapheight	location_mapservice	location_mapwidth	location_mapzoom	location_nodefaultfromip	location_postal	location_state	max_answers	max_filesize	max_num_of_files	max_num_value	max_num_value_n	max_subquestions	maximum_chars	min_answers	min_num_of_files	min_num_value	min_num_value_n	multiflexible_checkbox	multiflexible_max	multiflexible_min	multiflexible_step	num_value_int_only	numbers_only	other_comment_mandatory	other_numbers_only	other_replace_text	page_break	parent_order	prefix	printable_help	public_statistics	question_template	random_group	random_order	rank_title	repeat_headings	reverse	samechoiceheight	samelistheight	scale_export	show_comment	show_grand_total	show_title	show_totals	showpopups	slider_accuracy	slider_custom_handle	slider_default	slider_default_set	slider_handle	slider_layout	slider_max	slider_middlestart	slider_min	slider_orientation	slider_rating	slider_reset	slider_reversed	slider_separator	slider_showminmax	statistics_graphtype	statistics_showgraph	statistics_showmap	suffix	text_input_columns	text_input_width	time_limit	time_limit_action	time_limit_countdown_message	time_limit_disable_next	time_limit_disable_prev	time_limit_message	time_limit_message_delay	time_limit_message_style	time_limit_timer_style	time_limit_warning	time_limit_warning_2	time_limit_warning_2_display_time	time_limit_warning_2_message	time_limit_warning_2_style	time_limit_warning_display_time	time_limit_warning_message	time_limit_warning_style	use_dropdown	value_range_allows_missing
		S		sid		2																																																																																																																																											
		S		admin		Administrator																																																																																																																																											
		S		adminemail		pnickelsd@gmail.com																																																																																																																																											
		S		anonymized		N																																																																																																																																											
		S		faxto																																																																																																																																													
		S		format		G																																																																																																																																											
		S		savetimings		Y																																																																																																																																											
		S		template		extends_vanilla																																																																																																																																											
		S		language		en																																																																																																																																											
		S		additional_languages																																																																																																																																													
		S		datestamp		Y																																																																																																																																											
		S		usecookie		Y																																																																																																																																											
		S		allowregister		Y																																																																																																																																											
		S		allowsave		Y																																																																																																																																											
		S		autonumber_start		2																																																																																																																																											
		S		autoredirect		Y																																																																																																																																											
		S		allowprev		Y																																																																																																																																											
		S		printanswers		N																																																																																																																																											
		S		ipaddr		N																																																																																																																																											
		S		refurl		Y																																																																																																																																											
		S		publicstatistics		N																																																																																																																																											
		S		publicgraphs		N																																																																																																																																											
		S		listpublic		N																																																																																																																																											
		S		htmlemail		Y																																																																																																																																											
		S		sendconfirmation		Y																																																																																																																																											
		S		tokenanswerspersistence		N																																																																																																																																											
		S		assessments		Y																																																																																																																																											
		S		usecaptcha		N																																																																																																																																											
		S		usetokens		N																																																																																																																																											
		S		bounce_email		pnickelsd@gmail.com																																																																																																																																											
		S		emailresponseto		pnickel@communityempowermentresearch.com																																																																																																																																											
		S		emailnotificationto		pnickel@communityempowermentresearch.com																																																																																																																																											
		S		tokenlength		15																																																																																																																																											
		S		showxquestions		N																																																																																																																																											
		S		showgroupinfo		D																																																																																																																																											
		S		shownoanswer		N																																																																																																																																											
		S		showqnumcode		X																																																																																																																																											
		S		bounceprocessing		N																																																																																																																																											
		S		showwelcome		Y																																																																																																																																											
		S		showprogress		N																																																																																																																																											
		S		questionindex		0																																																																																																																																											
		S		navigationdelay		0																																																																																																																																											
		S		nokeyboard		N																																																																																																																																											
		S		alloweditaftercompletion		N																																																																																																																																											
		S		googleanalyticsstyle		0																																																																																																																																											
		S		googleanalyticsapikey																																																																																																																																													
		S		gsid		3																																																																																																																																											
		S		showsurveypolicynotice		0																																																																																																																																											
		SL		surveyls_survey_id		2		en																																																																																																																																									
		SL		surveyls_language		en		en																																																																																																																																									
		SL		surveyls_title		Example of a Survey That Will Not Import		en																																																																																																																																									
		SL		surveyls_description		"<span style=""font-size:17px;font-family:Trebuchet MS,Helvetica,sans-serif;color: rgb(0, 51, 102)><p align=""left"">This survey is a pilot test of what is hoped to be a short measure.  Your assistance in pilot-testing this measure is deeply appreciated.</p></span>…"		en																																																																																																																																									
		SL		surveyls_welcometext		"<div class=""row survey-welcome""><div class=""col-sm-12""><p> </p><p align=left style=""font-size:16px;font-family:Verdana,Geneva,sans-serif;color: rgb(0, 51, 102)"">Community Empowerment Research will take your answers, combine then with answers from hundreds of other people and statistically analyze the data to identify the questions that best assess the knowledge of people like you.</p><p align=left style=""font-size:16px;font-family:Verdana,Geneva,sans-serif;color: rgb(0, 51, 102)"">The final set of questions will form an assessment that can be used to identify one aspect of people's personalities.</p><p align=""left"">Watch for other tests and assessments being developed by Community Empowerment Research.</p></div></div>"		en																																																																																																																																									
		SL		surveyls_endtext		"<p><span style=""color:#003366;font-family:Verdana,Geneva,sans-serif;font-size:14px"">Thank you for taking the time to complete this survey.  As soon as we have a few dozen responses we will add a summary of how each person compares.</span><br /> </p><p><span style=""color:#003366;font-family:Verdana,Geneva,sans-serif;font-size:14px"">Your answers have already been saved.  If you want to erase your answers, click the link that says ""Erase and Close"", otherwise simply close this window or tab.</span></p><p> </p><p> </p><p> </p>"		en																																																																																																																																									
		SL		surveyls_url		http://www.communityempowermentresearch.com/		en																																																																																																																																									
		SL		surveyls_urldescription		"To return to the Community Empowerment Research home page, click here."		en																																																																																																																																									
		SL		surveyls_email_invite_subj		Invitation to participate in a survey		en																																																																																																																																									
		SL		surveyls_email_invite		"Dear {FIRSTNAME},<br /><br />you have been invited to participate in a survey.<br /><br />The survey is titled:<br />""{SURVEYNAME}""<br /><br />""{SURVEYDESCRIPTION}""<br /><br />To participate, please click on the link below.<br /><br />Sincerely,<br /><br />{ADMINNAME} ({ADMINEMAIL})<br /><br />----------------------------------------------<br />Click here to do the survey:<br />{SURVEYURL}<br /><br />If you do not want to participate in this survey and don't want to receive any more invitations please click the following link:<br />{OPTOUTURL}<br /><br />If you are blacklisted but want to participate in this survey and want to receive invitations please click the following link:<br />{OPTINURL}"		en																																																																																																																																									
		SL		surveyls_email_remind_subj		Reminder to participate in a survey		en																																																																																																																																									
		SL		surveyls_email_remind		"Dear {FIRSTNAME},<br /><br />Recently we invited you to participate in a survey.<br /><br />We note that you have not yet completed the survey, and wish to remind you that the survey is still available should you wish to take part.<br /><br />The survey is titled:<br />""{SURVEYNAME}""<br /><br />""{SURVEYDESCRIPTION}""<br /><br />To participate, please click on the link below.<br /><br />Sincerely,<br /><br />{ADMINNAME} ({ADMINEMAIL})<br /><br />----------------------------------------------<br />Click here to do the survey:<br />{SURVEYURL}<br /><br />If you do not want to participate in this survey and don't want to receive any more invitations please click the following link:<br />{OPTOUTURL}"		en																																																																																																																																									
		SL		surveyls_email_register_subj		Survey registration confirmation		en																																																																																																																																									
		SL		surveyls_email_register		"Dear {FIRSTNAME},<br /><br />You, or someone using your email address, have registered to participate in an online survey titled {SURVEYNAME}.<br /><br />To complete this survey, click on the following URL:<br /><br />{SURVEYURL}<br /><br />If you have any questions about this survey, or if you did not register to participate and believe this email is in error, please contact {ADMINNAME} at {ADMINEMAIL}."		en																																																																																																																																									
		SL		surveyls_email_confirm_subj		Confirmation of your participation in our survey		en																																																																																																																																									
		SL		surveyls_email_confirm		"Dear {FIRSTNAME},<br /><br />this email is to confirm that you have completed the survey titled {SURVEYNAME} and your response has been saved. Thank you for participating.<br /><br />If you have any further questions about this email, please contact {ADMINNAME} on {ADMINEMAIL}.<br /><br />Sincerely,<br /><br />{ADMINNAME}"		en																																																																																																																																									
		SL		surveyls_dateformat		11		en																																																																																																																																									
		SL		email_admin_notification_subj		Response submission for survey {SURVEYNAME}		en																																																																																																																																									
		SL		email_admin_notification		"Hello,<br /><br />A new response was submitted for your survey '{SURVEYNAME}'.<br /><br />Click the following link to see the individual response:<br />{VIEWRESPONSEURL}<br /><br />Click the following link to edit the individual response:<br />{EDITRESPONSEURL}<br /><br />View statistics by clicking here:<br />{STATISTICSURL}"		en																																																																																																																																									
		SL		email_admin_responses_subj		Response submission for survey {SURVEYNAME} with results		en																																																																																																																																									
		SL		email_admin_responses		"Hello,<br /><br />A new response was submitted for your survey '{SURVEYNAME}'.<br /><br />Click the following link to see the individual response:<br />{VIEWRESPONSEURL}<br /><br />Click the following link to edit the individual response:<br />{EDITRESPONSEURL}<br /><br />View statistics by clicking here:<br />{STATISTICSURL}<br /><br /><br />The following answers were given by the participant:<br />{ANSWERTABLE}"		en																																																																																																																																									
		SL		surveyls_numberformat		0		en																																																																																																																																									
147		G	5	Demographics		"<strong><span style=""color:#006666;font-size:16px;margin:0 0 5 0"">Thank you for completing the survey.  Before we give you your results, we would like to know a little about you.  All information is kept strickly confidential and used only for analysis of questions to aid the decision of which questions to keep in the final form.</strong></span><p></p><p>Elipsis: …</p>"		en																																																																																																																																									
1904		Q	S	D2002	1	"<span style=""font-family:Verdana,Geneva;sans-serif';font-size:16px;margin:0 0 0 0"">City:</span>"		en		N	N		0																																										25																																																																							25																			
1906		Q	L	C1009	1	"<span style=""font-size:16px;margin:0 0 0 0;font-family:Verdana,Geneva,sans-serif"">How old are you?</span><p>em  �  dash</p>"		en		N	N		0																			6																					1																																																																																												
2454		A	0	A1		"<span style=""font-size:12px;margin:0 0 0 0"">Under 20</span>"		en													1																																																																																																																												
2454		A	0	A2		"<span style=""font-size:12px;margin:0 0 0 0"">20 - 24</span>"		en													2																																																																																																																												
2454		A	0	A3		"<span style=""font-size:12px;margin:0 0 0 0"">25 - 29</span>"		en													3																																																																																																																												
2454		A	0	A4		"<span style=""font-size:12px;margin:0 0 0 0"">30 - 34</span>"		en													4																																																																																																																												
2454		A	0	A5		"<span style=""font-size:12px;margin:0 0 0 0"">35 - 39</span>"		en													5																																																																																																																												
2454		A	0	A6		"<span style=""font-size:12px;margin:0 0 0 0"">40 - 44</span>"		en													6																																																																																																																												
2454		A	0	A7		"<span style=""font-size:12px;margin:0 0 0 0"">45 - 49</span>"		en													7																																																																																																																												
2454		A	0	A8		"<span style=""font-size:12px;margin:0 0 0 0"">50 - 54</span>"		en													8																																																																																																																												
2454		A	0	A9		"<span style=""font-size:12px;margin:0 0 0 0"">55 - 59</span>"		en													9																																																																																																																												
2454		A	0	A10		"<span style=""font-size:12px;margin:0 0 0 0"">60 - 64</span>"		en													10																																																																																																																												
2454		A	0	A11		"<span style=""font-size:12px;margin:0 0 0 0"">65 - 69</span>"		en													11																																																																																																																												
2454		A	0	A12		"<span style=""font-size:12px;margin:0 0 0 0"">70 - 74</span>"		en													12																																																																																																																												
2454		A	0	A13		"<span style=""font-size:12px;margin:0 0 0 0"">75 or older</span>"		en													13																																																																																																																												
1907		Q	M	C1159	1	"<span style=""font-size:16px;margin:0 0 0 0;font-family:Verdana,Geneva,sans-serif"">What do you consider to be your race or ethnicity <span style=""font-style:italic"">(mark all that apply):</span></span><p>�single quotes�</p>"		en		N	Y		0																			5																					1		18																																																																																										
2467		SQ		SQ001	1	"<span style=""font-size:12px;margin:0 0 0 0"">American Indian/Alaska Native</span>"		en		N	N		0																																																																																																																																				
2468		SQ		SQ002	1	"<span style=""font-size:12px;margin:0 0 0 0"">Asian</span>"		en		N	N		0																																																																																																																																				
2469		SQ		SQ003	1	"<span style=""font-size:12px;margin:0 0 0 0"">Black/African American</span>"		en		N	N		0																																																																																																																																				
2470		SQ		SQ004	1	"<span style=""font-size:12px;margin:0 0 0 0"">Hispanic</span>"		en		N	N		0																																																																																																																																				
2471		SQ		SQ005	1	"<span style=""font-size:12px;margin:0 0 0 0"">Pacific Islander</span>"		en		N	N		0																																																																																																																																				
2472		SQ		SQ006	1	"<span style=""font-size:12px;margin:0 0 0 0"">White/Anglo</span>"		en		N	N		0																																																																																																																																				
1914		Q	L	C1050	1	"<span style=""font-size:16px;margin:0 0 0 0;font-family:Verdana,Geneva,sans-serif"">Gender:</span>"		en		N	Y		0																			5																					1																																																																																												
2456		A	0	A1		"<span style=""font-size:12px;margin:0 0 0 0"">Female</span>"		en													0																																																																																																																												
2456		A	0	A2		"<span style=""font-size:12px;margin:0 0 0 0"">Male</span>"		en													1																																																																																																																												
1915		Q	L	C0483	1	"<span style=""font-size:16px;margin:0 0 0 0;font-family:Verdana,Geneva,sans-serif"">What is your highest level of formal education?</span><p>�double quotes�</p>"		en		N	N		0																			4																					1																																																																																												
2457		A	0	SQ001		"<span style=""font-size:12px;margin:0 0 0 0"">Less than high school</span>"		en													1																																																																																																																												
2457		A	0	SQ002		"<span style=""font-size:12px;margin:0 0 0 0"">High school, GED, or equivalent</span>"		en													2																																																																																																																												
2457		A	0	SQ003		"<span style=""font-size:12px;margin:0 0 0 0"">Associate's degree, trade school, or some college</span>"		en													3																																																																																																																												
2457		A	0	SQ004		"<span style=""font-size:12px;margin:0 0 0 0"">Bachelor's degree</span>"		en													4																																																																																																																												
2457		A	0	SQ005		"<span style=""font-size:12px;margin:0 0 0 0"">Master's degree</span>"		en													5																																																																																																																												
2457		A	0	SQ006		"<span style=""font-size:12px;margin:0 0 0 0"">MD, JD, or similar professional degree</span>"		en													6																																																																																																																												
2457		A	0	SQ007		"<span style=""font-size:12px;margin:0 0 0 0"">PhD or similar advanced degree</span>"		en													7																																																																																																																												

Issue History

Date Modified Username Field Change
2019-08-06 18:17 pnickel New Issue
2019-08-06 19:13 DenisChenu Note Added: 53139
2019-08-08 16:53 markusfluer Assigned To => markusfluer
2019-08-08 16:53 markusfluer Status new => feedback
2019-08-12 20:49 pnickel File Added: limesurvey_survey_example import error.txt