Do I need to create the customer/project in QBO first in order to link the project in Ressio to QBO?

Always create the customer in QuickBooks Online first. This allows Ressio to link the project to the correct customer and avoids duplication in customers.