Testing your product

This page covers the process of testing your product before submitting it for review.

Preview and test your product

To see how users will experience your product, preview and test the product. The preview walks you through the process of viewing and deploying your product, as a customer would see it.

To preview and test your product, open it in Partner Portal and then click Preview & test. By default, this previews the product in your public project, which fails due to quota limitations in your public project. You can resolve this by modifying the project parameter in the URL, and changing it from your public project to your development project.

Default URL:

https://console.cloud.google.com/marketplace/details/public-project/solution?preview=public-project%2Fsolution&project=public-project

Modify the URL to:

https://console.cloud.google.com/marketplace/details/public-project/solution?preview=public-project%2Fsolution&project=dev-project

After you have successfully deployed your product and verified that it behaves as you'd expect, you can exit your preview. To delete the preview deployment, open the Cloud Deployment Manager page and delete the deployment. Then, return to Partner Portal.

End-to-end testing

We recommend you test each of your products' end-to-end flows, to ensure a great customer experience.

Before starting testing procedures, verify that all testers have access to the product. If the product image(s) is not in your public project, ensure that each of the testers is added as a viewer to the development project which contains the product image(s). The testers need to be users of Cloud Console, and must be added to the project.

UI test plan

On the Google Cloud Marketplace site, click Explore Marketplace and then search for your product(s). Ensure that the product card is visible in the search results, and that the information on the card is displayed correctly. If you have more than one product, the content of each product must be distinguishable from that of the other products.

  1. Go to the product details page by clicking on your product, and verify the following:
    • The header is displayed with your name, category, estimated costs and Launch button.
    • The product description is displayed with a Learn more link that points to a specific product or service page on your website.
    • The tech stack is displayed, with the product type, version, last updated timestamp, and category ID and components, if applicable.
    • The Pricing section has the price breakdown, as well as working links to pricing and free trial.
      • The pricing details are correct, and the Show more arrow expands properly.
    • The Maintenance & support section clearly specifies whether the support is bundled into the pricing. The section has:
      • A description of available support channels and their hours of service.
      • A link to your support site.
    • The Terms of service section includes a link to your End User License Agreement (EULA).

Deployment flow

  1. Go to the product details page.
  2. Click Launch and fill in all of the applicable input fields to deploy the product. Ensure the following:
    • The product has the same default machine type and disk size as are specified in the pricing table on the product details page.
    • Links work correctly.
    • HTTP and HTTPS ports are checked/unchecked accurately.
  3. Deploy the product on a default machine type, and verify that the product is deployed successfully. Ensure the following:
    • You can SSH into the virtual machine instance.
    • Test the license key in an SSH session:
      curl -H "Metadata-Flavor: Google" http://metadata.google.internal/computeMetadata/v1/instance/licenses/?recursive=true
      
    • Application info is loaded.
      • If the application has admin URL, log into the Admin console with the username/password.
      • Check that the specified ports are opened.
  4. Repeat above steps for different instance sizes (especially large and small) and regions.
    • Repeat the above steps with cloned instances (cloned hard drives).

Post-deployment next steps

If your product has any post-deployment next steps that will be listed in its Getting Started guide, then you must also test these to ensure that the deployment of your product is successfully completed.