New barriers for fast-switching SNS josephson junctions