I doubt if any of you was expecting to hear four speeches today.
Which of those is correct? Any is the subject and is singular (sub in any one of you to see this is true). You is plural but is part of a prepositional phrase and not actually the subject.
BUT...do subjunctive rules kick in here to make it were, or is was correct?
ETA: okay, if = subjunctive.
What about "I doubt anyone here was/were expecting to hear four speeches today."?
The if is still there (though implied I guess, removed for redundancy). Would it still be were then? That sounds so off.