Is the “Add new item” option for adding Razor components to a Razor page app not available for Blazor applications?

No, but it is in the implementation state and will be available in the upcoming release. Refer to the following issue threads for more information:

• “Add New Item” of Type “Razor Component” to a Razor Pages App
• Razor component item templates