Alfred does have magic but for the largest of times he's been masking it from everyone else.

That's where his super strength comes from, its his magic in disguise.
             《☆》《☆》《☆》

Wanted to do that one for the longest of times.