After saving the page in the lightning app builder, open a Salesforce record.
Until you save the configuration, Structur will always prompt the settings if you are a Structur admin. If you save a page in production, don't worry! Your users won't see the difference until there are assigned a licence, a permission set and the configuration is saved.
You can also access this panel by clicking "Setup" after saving the configuration.