The only thing to fear is fear (of a cryptographically relevant quantum computer) itself.
565