You can lock templates, so that the user cannot add other blocks: https://developer.wordpress.org/block-editor/developers/block-api/block-templates/#locking