View Issue Details

IDProjectCategoryView StatusLast Update
15388Bug reports[All Projects] Otherpublic2019-10-30 11:16
ReporterHQINTEGRATION Assigned Toeddylackmann  
PrioritynoneSeveritymajor 
Status assignedResolutionopen 
Product Version3.18.0 
Target VersionFixed in Version 
Summary15388: Asian characters stored in back end but not in front end
Description

While having a survey in any asian language (Korean, Japanese, Chinese,...) when a customer answers the survey the asian characters are stored in database as question marks (????), but when you edit these responses in the administration side of the application, these are properly stored with the correct asian characters.

Steps To Reproduce
  1. Create a survey in some languanges, for example english default language and Japanese.
  2. Answer this survey in Japanese.
    --> here you will get the question mark as Japanese characters.
  3. Go to the administration side and access the survey.
  4. Look for the survey answer.
  5. Edit the answers with Japanese characters.
    --> here you will get the answers properly stored.
Additional Information
  • Limesurvey 3.18
  • Windows server (xammp)
  • SQL SERVER 2008 in production SQL SERVER 2017 in test
TagsNo tags attached.
Complete LimeSurvey version number (& build)Version 3.18.0+190923
I will donate to the project if issue is resolvedNo
BrowserFirefox
Database & DB-VersionMSSQL 2008 and MSSQL 2018
Server OS (if known)Windows Server 2012 R2
Webserver software & version (if known)
PHP VersionPHP Version 5.5.37

Activities

eddylackmann

eddylackmann

2019-10-08 15:11

developer   ~53950

@HQINTEGRATION did you check the charset configuration of your database / tables ?

DenisChenu

DenisChenu

2019-10-08 15:23

developer   ~53952

Maybe related to

SQL SERVER 2008 in production SQL SERVER 2017 in test

HQINTEGRATION

HQINTEGRATION

2019-10-09 11:42

reporter   ~53963

Hi,

@eddylackmann, I have checked it. But it dont looks like a database problem, because if you save the data in the respones viewer, it works fine. If it will be a database/table problem, would file from all pages.

HQINTEGRATION

HQINTEGRATION

2019-10-09 16:24

reporter   ~53976

Hi,

thinking about this issue the problem can be resumed as when a insert is done, the characters are saved as ????, but in update operations is saved properly.

Perhaps can be a workaround starting point....

HQINTEGRATION

HQINTEGRATION

2019-10-30 11:16

reporter   ~54272

Hallo Denis und Eddy,

I have tracked the queries sended from limesurvey to our database and got the traces for you.

You can see that both updates, the one that work and the one that don't have two different formats, so they are no calling the same procedure. This can be the point.

Please can you have a look at these?

Thanks,

Victor



DBTraceInfo.txt (5,427 bytes)
-- Trace sequence not working properly

-- network protocol: TCP/IP
set quoted_identifier on
set arithabort off
set numeric_roundabort off
set ansi_warnings on
set ansi_padding on
set ansi_nulls on
set concat_null_yields_null on
set cursor_close_on_commit off
set implicit_transactions off
set language us_english
set dateformat mdy
set datefirst 7
set transaction isolation level read committed

SET DATEFORMAT ymd;
SET DATEFORMAT ymd;

SET QUOTED_IDENTIFIER ON;
SET QUOTED_IDENTIFIER ON;

declare @p1 int
set @p1=2435
exec sp_prepexec @p1 output,NULL,

N'UPDATE 
	lime_survey_38733 
  SET 
	[lastpage]=1, 
	[datestamp]=''2019-10-30 09:49:27'', 
	[ipaddr]=''172.16.10.246'', 
	[38733X1X1]=''4'', 
	[38733X1X5]=NULL, 
	[38733X1X13]=''価 '', 
	[38733X1X9SQ001]=''9'', 
	[38733X1X10]=NULL, 
	[38733X1X11]=''価 '', 
	[38733X1X12]=NULL, 
	[38733X1X14SQ001]=''Y'', 
	[38733X1X14SQ002]='''', 
	[38733X1X14SQ003]='''', 
	[38733X1X14SQ004]='''', 
	[38733X1X14SQ005]='''', 
	[38733X1X14SQ006]='''', 
	[38733X1X14SQ007]='''', 
	[38733X1X14other]='''', 
	[38733X1X16]='''', 
	[38733X1X15]=''価 '', 
	[38733X2X7]=NULL, 
	[38733X2X18]=NULL 
WHERE 
	ID=6488'

select @p1

declare @p1 int
set @p1=42
exec sp_prepexec @p1 output,NULL,

N'UPDATE 
	lime_survey_38733 
SET 
	[lastpage]=2, 
	[datestamp]=''2019-10-30 09:56:12'', 
	[ipaddr]=''172.16.10.246'', 
	[38733X2X31]=''4'', 
	[38733X2X32]=''4'', 
	[38733X2X33]=''4'', 
	[38733X2X34]=''4'', 
	[38733X2X35]=''4'', 
	[38733X2X36]=''4'', 
	[38733X2X37]=''4'', 
	[38733X2X38]='''', 
	[38733X2X39]='''', 
	[38733X2X4]=''大変満足 '', 
	[38733X2X6]=''Y'', 
	[38733X2X7]=''1'', 
	[38733X2X8]=''大変満足 '', 
	[38733X2X17]=''Y'', 
	[38733X2X18]=''1'', 
	[38733X2X19]=''大変満足 '' 
WHERE 
	ID=6488'
select @p1


-- Trace sequence working properly

-- network protocol: TCP/IP
set quoted_identifier on
set arithabort off
set numeric_roundabort off
set ansi_warnings on
set ansi_padding on
set ansi_nulls on
set concat_null_yields_null on
set cursor_close_on_commit off
set implicit_transactions off
set language us_english
set dateformat mdy
set datefirst 7
set transaction isolation level read committed

SET DATEFORMAT ymd;
SET DATEFORMAT ymd;

SET QUOTED_IDENTIFIER ON;
SET QUOTED_IDENTIFIER ON;

declare @p1 int
set @p1=937
exec sp_prepexec @p1 output,N'@P1 nvarchar(3),@P2 nvarchar(16),@P3 int,@P4 nvarchar(2),@P5 char(1),@P6 nvarchar(16),@P7 nvarchar(16),@P8 nvarchar(13),@P9 nvarchar(81),@P10 nvarchar(1),@P11 nvarchar(3),
				 @P12 nvarchar(3),@P13 nvarchar(1),@P14 nvarchar(3),@P15 nvarchar(3),@P16 nvarchar(3),@P17 nvarchar(1),@P18 char(1),@P19 char(1),@P20 char(1),@P21 char(1),@P22 char(1),@P23 char(1),
				 @P24 nvarchar(max),@P25 nvarchar(3),@P26 nvarchar(3),@P27 nvarchar(1),@P28 nvarchar(1),@P29 nvarchar(1),@P30 nvarchar(1),@P31 nvarchar(1),@P32 nvarchar(1),@P33 nvarchar(1),@P34 nvarchar(max),
				 @P35 nvarchar(max),@P36 nvarchar(12),@P37 nvarchar(1),@P38 nvarchar(1),@P39 nvarchar(12),@P40 nvarchar(1),@P41 nvarchar(1),@P42 nvarchar(12),@P43 char(1),@P44 nvarchar(1),@P45 char(1),@P46 char(1),
				 @P47 char(1),@P48 char(1),@P49 char(1),@P50 nvarchar(1),@P51 char(1),@P52 char(1),@P53 char(1),@P54 char(1),@P55 char(1),@P56 char(1),@P57 char(1),@P58 char(1),@P59 char(1)',

N'UPDATE 
	[dbo].[lime_survey_38733] 
SET 
	[token]=@P1, 
	[submitdate]=@P2, 
	[lastpage]=@P3, 
	[startlanguage]=@P4, 
	[seed]=@P5, 
	[startdate]=@P6, 
	[datestamp]=@P7, 
	[ipaddr]=@P8, 
	[refurl]=@P9, 
	[38733X1X1]=@P10, 
	[38733X1X5]=@P11, 
	[38733X1X13]=@P12, 
	[38733X1X9SQ001]=@P13, 
	[38733X1X10]=@P14, 
	[38733X1X11]=@P15, 
	[38733X1X12]=@P16, 
	[38733X1X14SQ001]=@P17, 
	[38733X1X14SQ002]=@P18, 
	[38733X1X14SQ003]=@P19, 
	[38733X1X14SQ004]=@P20, 
	[38733X1X14SQ005]=@P21, 
	[38733X1X14SQ006]=@P22, 
	[38733X1X14SQ007]=@P23, 
	[38733X1X14other]=@P24, 
	[38733X1X16]=@P25, 
	[38733X1X15]=@P26, 
	[38733X2X31]=@P27, 
	[38733X2X32]=@P28, 
	[38733X2X33]=@P29, 
	[38733X2X34]=@P30, 
	[38733X2X35]=@P31, 
	[38733X2X36]=@P32, 
	[38733X2X37]=@P33, 
	[38733X2X38]=@P34, 
	[38733X2X39]=@P35, 
	[38733X2X4]=@P36, 
	[38733X2X6]=@P37, 
	[38733X2X7]=@P38, 
	[38733X2X8]=@P39, 
	[38733X2X17]=@P40, 
	[38733X2X18]=@P41, 
	[38733X2X19]=@P42, 
	[38733X3X216]=@P43, 
	[38733X3X22]=@P44, 
	[38733X3X21]=@P45, 
	[38733X3X23]=@P46, 
	[38733X3X24]=@P47, 
	[38733X3X25]=@P48, 
	[38733X3X26]=@P49, 
	[38733X3X27]=@P50, 
	[38733X3X28]=@P51, 
	[38733X3X29]=@P52, 
	[38733X3X210]=@P53, 
	[38733X3X211]=@P54, 
	[38733X3X212]=@P55, 
	[38733X3X213]=@P56, 
	[38733X3X214]=@P57, 
	[38733X3X215]=@P58, 
	[38733X3X217]=@P59 
WHERE 
	[dbo].[lime_survey_38733].[id]=6488',
	N'999',
	N'2019-10-30 09:56',
	3,
	N'ja',
	NULL,
	N'2019-10-30 09:49',
	N'2019-10-30 09:56',
	N'172.16.10.246',
	N'http://hq-survey-pre01/limesurvey/index.php/admin/tokens/sa/browse/surveyid/38733',
	N'4',
	N'価',
	N'価',
	N'9',
	N'価',
	N'価',
	N'価',
	N'Y',
	NULL,
	NULL,
	NULL,
	NULL,
	NULL,
	NULL,
	N'',
	N'価',
	N'価',
	N'4',
	N'4',
	N'4',
	N'4',
	N'4',
	N'4',
	N'4',
	N'',
	N'',
	N'価価価価',
	N'Y',
	N'1',
	N'価価価価',
	N'Y',
	N'1',
	N'価価価価',
	NULL,
	N'Y',
	NULL,
	NULL,
	NULL,
	NULL,
	NULL,
	N'Y',
	NULL,
	NULL,
	NULL,
	NULL,
	NULL,
	NULL,
	NULL,
	NULL,
	NULL
select @p1
DBTraceInfo.txt (5,427 bytes)

Issue History

Date Modified Username Field Change
2019-10-08 12:08 HQINTEGRATION New Issue
2019-10-08 15:09 eddylackmann Assigned To => eddylackmann
2019-10-08 15:09 eddylackmann Status new => assigned
2019-10-08 15:11 eddylackmann Note Added: 53950
2019-10-08 15:23 DenisChenu Note Added: 53952
2019-10-09 11:42 HQINTEGRATION Note Added: 53963
2019-10-09 16:24 HQINTEGRATION Note Added: 53976
2019-10-30 11:16 HQINTEGRATION File Added: DBTraceInfo.txt
2019-10-30 11:16 HQINTEGRATION Note Added: 54272