Right double quotes lead to error in editor

Whenever a text with right double quotes is entered into the editor the conversion fails. For certain texts that are entered in the source code view with right double quotes we got an error on the database level. Unfortunately logging to file was disabled and I only have the google searches I did after that so no full stacktrace. And right now I am unable to reproduce the db error right now (also I am hesitant to try to much, since db level is quite critical)
Some of the error messages in the log included:

• "The empty database XYZ" (XYZ some substring of the converted text)
• PSQLException: ERROR: syntax error at or near "&"
• "Failed updating schema while executing query"

(Edit: Same thing seems to hold for right single quotes)