If you're planning on visiting Death Valley for the day, then the earlier you get started, the better. This will give you plenty of time to see and do as much as possible without worrying about having to rush back.