Can I withdraw an invitation I sent?

Yes. As long as the other store has not answered, the request shows Pending. Open Connection requests → Sent and click Cancel; you see “Request cancelled.”

Cancelling frees a slot in your pending requests, but the invitation still counts toward this month's network requests. The counter resets at the start of the next calendar month.