If you're traveling for Memorial Day, you may need to follow that classic advice to "pack your patience."