Are the windows of the White House bullet proof?

Yes. Also, fun fact: the First Family aren't allowed to open the windows because it's too big of a security risk.

Similarly, the President's limo is also armored, and, since Kennedy (for obvious reasons) the President is not allowed to travel in an open-topped vehicle.