It appears that the Character Collation, which is set in phpmyadmin, causes this problem. Anything ending in general_ci seems to fix almost all problems. Such as latin_general_ci or utf8_general_ci will work.
But, there is 1 user who still has some small problems after that is set. The ticket number is WIE-284351 . First, many characters were showing black boxes with question marks in them. After changing it to anything_general_ci, all of that was fixed. Anyway, atleast 1 page was showing some weird characters just a couple times in it. It was odd that some pages were showing this and not otheres. Will update blog when and if a solution is found for this.
Note that this type of problem is usually caused because of users who copy and paste information into forms or directly into phpmyadmin. Its best to just avoid this type of behaviour all toghethor.