How do you address a rabbi respectfully?

My father is a Rabbi and people call him Rabbi (Last name). Those who do not know him call him Mr and he does not correct them. Sometimes people who know he is a Rabbi but cannot remember his last name just call him "Rabbi" as in "Good afternoon Rabbi". That is fine too.