Loading...

Grabbing Product Data From Any E-Commerce Website

By Team WayScript

Acquiring relevant datasets is often a tedious task, and not knowing how to code can make it even harder. Wayscript allows you to build complex data sets without all the complex code.

Building your own program to pull datasets on e-commerce products takes less than three minutes and can be done with WayScript's simple "drag and drop" visual programming language.

Building From Scratch

Step One

Drag and drop 'Create Variable' into your recipe.

Call your variable name 'Product URLs' and set it as a 'List of Items' with the type of item as 'Text'.

To allow users to add and remove URLs from the Dashboard, tick the box that says 'Display Dasboard Settings?' and tick the box that says 'Show on Dashboard?'.

Step Two

Drag and drop 'Loop' to your Recipe.

Drag and drop 'Loop' to your Recipe and select 'Product URLs' as the variable to loop over.

Step Three

Within your Loop, add a Diffbot and set it to grab 'Data from any shopping or e-commerce product page'.

Set the input to the variable you created called 'Product URLs' and select the types of outputs you would like. For this example, I have selected all outputs.

Step Four

Within your Loop, add an Excel module after your Diffbot.

Set the Mode to 'Write File' and type in a name for your spreadsheet in the field 'Choose File to Write'. For this example, I set the Write Mode to 'Replace File'. Then, add all the variables you would like to be outputted to your spreadsheet.

To allow users to download the spreadsheet from the Dashboard, tick the box that says 'Display Dasboard Settings?' and tick the box that says 'Show on Dashboard?'.

Done!

You're all set! Your program will also be waiting for you in the Dashboard, where you can edit product URLs and download the spreadsheet with all of your data. You can also run the program straight from the builder by entering the desired product URLs, selecting the outputs you would like and hitting the run button.

Your program will appear in your dashboard

Get Results

Your spreadsheet will contain the:

  • Product URL
  • Product Name
  • Product Brand
  • Product Price
  • SKU Number
  • Description
  • Image URL
  • Product Availability
  • JSON Data