The architecture revolves around a central McpServer responsible for managing and registering tools. Transports like StdioTransport and SseTransport handle communication with clients using JSON-RPC over different mediums. The design leverages Rust's async capabilities for concurrent handling of requests. The use of an Arc ensures safe sharing of the server across threads.