View Issue Details

This issue affects 3 person(s).
 26
IDProjectCategoryView StatusLast Update
19558Bug reportsCentral participant databasepublic2026-03-06 17:33
Reporterkhfischbach Assigned Totibor.pacalat  
PriorityhighSeveritypartial_block 
Status ready for testingResolutionopen 
Product Version6.5.x 
Summary19558: import csv created duplicates
Description

when importing a csv-file and selecting the option to avoid duplicates, the entry still shows up in the CPDB as duplicate.
This is reproducable.

Steps To Reproduce

Steps to reproduce

import csv
select option to identify duplicates
import same csv a second time
select option to identify duplicates

Expected result

existing entry to be updated only

Actual result

entry is added as duplicate (firstname, lastname, email)

TagsNo tags attached.
Bug heat26
Complete LimeSurvey version number (& build)6.5.6
I will donate to the project if issue is resolvedNo
BrowserFirefox
Database type & versionunknown
Server OS (if known)hosted at limesurvey.net
Webserver software & version (if known)
PHP Versionunknown

Users monitoring this issue

lavamind, khfischbach

Activities

DenisChenu

DenisChenu

2024-06-13 10:39

developer   ~80297

Replace csv file without real email

t_liste_eigentuemer_export_d_20240327_test.csv (87 bytes)   
firstname,lastname,email,language
"Karl","Lastname","karl-Lastname@example.org","de"
khfischbach

khfischbach

2024-06-13 11:36

reporter   ~80303

@DennisChenu
Could you please explain what you mean with "without real email"?

DenisChenu

DenisChenu

2024-06-13 12:17

developer   ~80317

@example.org : http://example.org/
I think previously it's your email ?

khfischbach

khfischbach

2024-06-13 12:52

reporter   ~80320

No!
The example csv-file I added to this bug report contained:

firstname,lastname,email,language
Karl-Heinz,"Kallewirsch","karl-heinz@kallewirsch.de","de"

But this was only to reproduce the bug if you import this file twice (or more times). You will then have multiple entries.

I have done this with a larger file containing more entries. All of them were duplicated!

grafik.png (1,838 bytes)   
grafik.png (1,838 bytes)   
DenisChenu

DenisChenu

2024-06-13 18:22

developer   ~80347

Last edited: 2024-06-13 18:25

Ok, but i replace with

firstname,lastname,email,language
"Karl","Lastname","karl-Lastname@example.org","de"

John Doe in German ?

The previous website exist

khfischbach

khfischbach

2024-06-14 08:03

reporter   ~80352

sorry, but I think we are far away from the original bug-report topic.

It is !!not!! a question of the conding of the csv-file. The problem is, that any csv-import creates DUPLICATES.

The coding (UTF-8) of the file is O.K., because the import within limesurvey recognizes the content.

But if I import the file twice or more times it creates two or more DUPLICATES.

t_liste_eigentuemer_export_d_20240327_test-2.csv (94 bytes)   
firstname,lastname,email,language
"Karl-Heinz","Kallewirsch","karl-heinz@kallewirsch.de","de"
DenisChenu

DenisChenu

2024-06-14 09:45

developer   ~80358

But if I import the file twice or more times it creates two or more DUPLICATES.

It's exactly what i test : see the updated Way to reproduce

import csv
select option to identify duplicates
import same csv a second time
select option to identify duplicates

khfischbach

khfischbach

2024-06-14 09:56

reporter   ~80359

I am having problems to find out what you want to tell me!

I understand, you tested it with the file I provided and did !!not!! get any DUPLICATES?

And I can tell, that always I did it, I got DUPLICATES and I can repreduce it as often as you like with the same result.

DenisChenu

DenisChenu

2024-06-14 09:58

developer   ~80360

I just don't understand your point…
I confirm your issue.

I just update the CSV file to remove real name and real website.
You know GPDR ? W have domain name example.org and example.com managed by w3c for website example.

khfischbach

khfischbach

2024-06-14 10:03

reporter   ~80361

OK - sorry, I did not get your point so far!
So you confirm the bug - fine!

By the way: the example was not a real name and domain! Just test data! Anyhow, to replace with example.com is fine!

DenisChenu

DenisChenu

2024-06-14 10:45

developer   ~80365

kallewirsch/./de was a real website.

I found a website where there are link to some company. If company didn't pit website : website are x.com … Elon are happy ;)

khfischbach

khfischbach

2024-06-14 11:33

reporter   ~80370

you are right - din't test it. In future, I will use example.com - thanks for hint!

lavamind

lavamind

2024-07-06 16:13

reporter   ~80544

Just to mention that the issue still exists in 6.5.15: importing the same CSV file twice to CPDB creates duplicates of all contacts.

This makes it very inconvenient to keep the CPDB up to date from an external data source, because update-needing records have to be processed one by one.

Rafael Marinho

Rafael Marinho

2026-03-04 09:51

reporter   ~84385

Is there any news on this issue? I have the same problem and I'm using version 6.13.0+250415. When I submit a CSV, even with the "avoid duplicates" option enabled, the entry still shows up in the CPDB as a duplicate.

Thank in advance for any help.

gabrieljenik

gabrieljenik

2026-03-04 16:53

manager   ~84397

Will work on this. Thanks

gabrieljenik

gabrieljenik

2026-03-04 20:08

manager   ~84400

https://github.com/LimeSurvey/LimeSurvey/pull/4748

DenisChenu

DenisChenu

2026-03-05 09:43

developer   ~84401

New function, please, separating the current one.
And if current one is not used in LS core : set it at deprecated please :)

DenisChenu

DenisChenu

2026-03-06 16:57

developer   ~84412

Just see for last comment of coderabbit

Issue History

Date Modified Username Field Change
2024-05-12 11:33 khfischbach New Issue
2024-05-12 11:33 khfischbach File Added: t_liste_eigentuemer_export_d_20240327_test.csv
2024-05-12 11:33 khfischbach Issue Monitored: khfischbach
2024-05-12 11:33 khfischbach Bug heat 0 => 2
2024-05-20 04:15 truthslob Bug heat 2 => 4
2024-05-20 10:11 khfischbach Bug heat 4 => 6
2024-06-13 10:38 DenisChenu File Deleted: t_liste_eigentuemer_export_d_20240327_test.csv
2024-06-13 10:39 DenisChenu Status new => confirmed
2024-06-13 10:39 DenisChenu Note Added: 80297
2024-06-13 10:39 DenisChenu File Added: t_liste_eigentuemer_export_d_20240327_test.csv
2024-06-13 10:39 DenisChenu Bug heat 6 => 8
2024-06-13 10:40 DenisChenu Steps to Reproduce Updated
2024-06-13 11:36 khfischbach Note Added: 80303
2024-06-13 12:17 DenisChenu Note Added: 80317
2024-06-13 12:18 DenisChenu Bug heat 8 => 6
2024-06-13 12:52 khfischbach Note Added: 80320
2024-06-13 12:52 khfischbach File Added: grafik.png
2024-06-13 18:22 DenisChenu Note Added: 80347
2024-06-13 18:25 DenisChenu Note Edited: 80347
2024-06-14 08:03 khfischbach Note Added: 80352
2024-06-14 08:03 khfischbach File Added: t_liste_eigentuemer_export_d_20240327_test-2.csv
2024-06-14 09:45 DenisChenu Note Added: 80358
2024-06-14 09:56 khfischbach Note Added: 80359
2024-06-14 09:58 DenisChenu Note Added: 80360
2024-06-14 09:58 DenisChenu File Added: Capture d’écran du 2024-06-14 09-56-42.png
2024-06-14 10:03 khfischbach Note Added: 80361
2024-06-14 10:45 DenisChenu Note Added: 80365
2024-06-14 11:33 khfischbach Note Added: 80370
2024-07-06 16:07 guest Bug heat 6 => 12
2024-07-06 16:13 lavamind Note Added: 80544
2024-07-06 16:13 lavamind Bug heat 12 => 14
2024-07-06 16:15 lavamind Issue Monitored: lavamind
2024-07-06 16:15 lavamind Bug heat 14 => 16
2025-11-13 11:44 tibor.pacalat Assigned To => gabrieljenik
2025-11-13 11:44 tibor.pacalat Status confirmed => assigned
2026-03-04 09:51 Rafael Marinho Note Added: 84385
2026-03-04 09:51 Rafael Marinho Bug heat 16 => 18
2026-03-04 11:51 c_schmitz Priority none => high
2026-03-04 11:51 c_schmitz Severity minor => partial_block
2026-03-04 13:04 guest Bug heat 18 => 24
2026-03-04 16:53 gabrieljenik Note Added: 84397
2026-03-04 16:53 gabrieljenik Bug heat 24 => 26
2026-03-04 20:08 gabrieljenik Assigned To gabrieljenik => DenisChenu
2026-03-04 20:08 gabrieljenik Status assigned => ready for code review
2026-03-04 20:08 gabrieljenik Note Added: 84400
2026-03-05 09:43 DenisChenu Assigned To DenisChenu => gabrieljenik
2026-03-05 09:43 DenisChenu Status ready for code review => in code review
2026-03-05 09:43 DenisChenu Note Added: 84401
2026-03-06 16:57 DenisChenu Status in code review => ready for testing
2026-03-06 16:57 DenisChenu Note Added: 84412
2026-03-06 17:33 gabrieljenik Assigned To gabrieljenik => tibor.pacalat