I was Able to find the problem, posting here as it might help others:
When I ran l10n_info() I saw that system.codepage=1252
As windows locale was English(US), change the locale to Israel(Hebrew) fixes the issue.
If you are concerned, Windows default language is still English
Here is how I changed the locale:
Control Panel -> Region -> Administrative -> Change System Locale" -> Hebrew(Israel)