No, you don't need D port headers. Just make sure the holes in the header flange are bigger than in the head all the way around.
Most race headers for D ports are purposely done this way.
Most race headers for D ports are purposely done this way.