Indeed, it can be count as normal .
Most often the printed char is the pound sign £ but can be any one - no rule here.
The source of the problem is unknown but it's most probably related to power.
You can try:
- another classic power brick or decent switching PSU 9V;
- a good 5V power source attached after the 7905 (i.e. directly to the VCC and GND tracks);
- add pull-up resistor 1k ... 10k (value is not critical) as shown on the pic: