Check duplicate

[guoyunhe]

From my understanding, RetroArch uses crc and/or serial to identify game roms. However, I found some duplicates in the same dat file. Not sure how the final compiled rdb is affected. This script can find duplicate entries with same crc & serial.

npm install
npm run check-duplicate

(Requires Node.js 22+)

[RobLoach]

What do you believe we should do with the duplicates. I'm unsure how the build script merges the duplicates together.

[guoyunhe]

dat/TIC-80.dat contains some duplicates because some games were re-uploaded. Except the cart id, everything is the same. I think it is safe to delete duplicates in this case. It is only a question of deleting old one or new one?

game (
	name "Quest for Glory"
	description "fantasy roguelike"
	homepage "https://tic80.com/play?cart=1369"
	developer "deck"
	download "https://tic80.com/cart/43db17567e7d6c37173dabec9bf7fc42/cart.tic"
	rom ( name "Quest for Glory.tic" size "67204" md5 "43db17567e7d6c37173dabec9bf7fc42" crc "89d1bc8a" )
)

game (
	name "Quest for Glory"
	description "fantasy roguelike"
	homepage "https://tic80.com/play?cart=6"
	developer "deck"
	download "https://tic80.com/cart/da211ce098094d65c3b99e4bb5f8778a/cart.tic"
	rom ( name "Quest for Glory.tic" size "67204" md5 "43db17567e7d6c37173dabec9bf7fc42" crc "89d1bc8a" )
)

metadat/redump/Sony - PlayStation.dat contains some games with same game roms. The only difference is that the retail box contains some premium extras. However, this difference can be safely ignored for emulation purpose. I guess keeping the one with shorter name makes sense?

game (
	name "Crash Bandicoot 2 - Cortex Strikes Back (Europe) (En,Fr,De,Es,It)"
	region "Europe"
	serial "SCES-00967"
	rom ( name "Crash Bandicoot 2 - Cortex Strikes Back (Europe) (En,Fr,De,Es,It).bin" size 259602000 crc F5E2EC49 md5 10DABEBD6A3EFC1E1E9DB4F8F3B864CB sha1 B077862D2C6E1B8060C2EAE2FE82E708B228DE7C serial "SCES-00967" )
)
game (
	name "Crash Bandicoot 2 - Cortex Strikes Back (Europe, Australia) (En,Fr,De,Es,It) (EDC)"
	region "Europe"
	serial "SCES-00967"
	rom ( name "Crash Bandicoot 2 - Cortex Strikes Back (Europe, Australia) (En,Fr,De,Es,It) (EDC).bin" size 259602000 crc 97395614 md5 BF7A55B9DB1EC43ABE00089BF6DA3C8B sha1 15136B951CADA96FF1D8B424BBE584A60AF09184 serial "SCES-00967" )
)