Prayer is central. It must be our first priority. Prayer should be the constant fabric woven throughout our lives. No matter what we are doing or where we are or whatever our situation is, we should always pray.
Jesus did. While he was on this earth, our Lord prayed at least three times everyday (in accordance with Jewish custom) and often spent hours and sometimes even days in solitude with the Father.
Peter did too. After Pentecost, finding himself bogged down by the administration of the church in Jerusalem, Peter appointed deacons to run the affairs so he and the apostles could be devoted to "prayer and the ministry of the Word" (Acts 6:2).
Moses did as well. Similarly overwhelmed with the administration of the Israelites after the Exodus from Egypt, at the advice of his father-in-law, Jethro, Moses appointed judges to handle temporal affairs so Moses could have his needed time with God (cf. Ex 18:13-24).
Jesus, Peter and Moses were not removed from being lawgivers and the leaders. They still held these roles in a certain fashion. But they reestablished their priorities: prayer first, work second.
We cannot eliminate the "business" or administration from our lives. There are bills to be paid, chores to be completed, responsibilities to be fulfilled. These should not be neglected. But we will be more effective if we pray throughout our day.
One last example from Scripture. When the Israelites fought the Amalekites (cf. Ex 17), the Israelites were only successful in battle when Moses, sitting atop a mountain literally kept his arms raised in prayer. When he lowered his arms, the Israelites retreated. When he kept them raised, they were victorious. Prayer works.
May our only activity on Labor Day not be to simply not work. A true Labor Day would involve prayer.