MD5 not working correctly with PostgreSQL

[ashokraghu14]

Hi,

I'm moving few data to Redshift on daily basis. The data are copied to Redshift with the help of a shell script which uses PSQL for inserting data into Redshift from a CSV file.

Since it runs every day and takes data from last one week, lot of duplicate data are inserted. So to avoid this I compute hash using MD5, and using the hash, I insert only the new data and ignore the duplicate one. But PSQL is not computing the hash correctly. Means that when I compute row_hash with the same query form SQLWorkbench, it works fine, but now with PSQL.

The shell script which performs the above task is stored in S3.

Code wise everything is fine. Because when I execute the same query from the Workbench, I don't find any problem.

Thanks in advance.