How can I set the agent configuration for new contact assignments for all services?

Go to Settings > Routings. Here you can set the duration for which a new contact assignment request should be shown to the agents, and set timeouts for all channels — Calls, Chats, and WhatsApp.