Use Data Miner in Google Chrome

Edited by Djinu, VisiHow, Eng, shannon.decker

You're watching VisiHow. In the previous tutorial, we turned off notifications. In this tutorial, we're going to demonstrate how to gather ("scrape") data from a web site, using the Data Miner extension for Chrome.

Was this helpful? Yes | No| I need help

Steps

  1. 1
    Open Chrome
    .
    Advertisement
    Was this step helpful? Yes | No| I need help
  2. 2
    First, type "data miner chrome" in Google Search
    .
    Click "Scraper - Chrome Web Store".
    Advertisement
    Was this step helpful? Yes | No| I need help
  3. 3
    Alternatively click the direct link
    .
    Was this step helpful? Yes | No| I need help
  4. 4
    Click "ADD TO CHROME"
    .
    Was this step helpful? Yes | No| I need help
  5. 5
    Click "Add extension"
    .
    This will add an icon to the toolbar in the upper-right corner and take you to a tutorial from the web site. You can skip this tutorial.
    Was this step helpful? Yes | No| I need help
  6. 6
    Open the page with the data that you need to "mine"
    .
    In this video, the page has to be reloaded so that the new extension shows up.
    Was this step helpful? Yes | No| I need help
  7. 7
    Highlight the first row of the data
    .
    In this video, the data is "Authorization Granted Via Section 333 Exemptions", a list of all of the companies that can legally fly drones in the United States for commercial purposes.
    Was this step helpful? Yes | No| I need help
  8. 8
    Once you have highlighted the first row of the data, right-click the data
    .
    Was this step helpful? Yes | No| I need help
  9. 9
    Click "DataMiner-Get Similar"
    .
    This will generate a table of all of the data up to ten, because there are only ten items on the page. This list is about 2000 entries long.
    Was this step helpful? Yes | No| I need help
  10. 10
    To get the subsequent pages, click "Next Page Navigation"
    .
    You will need to write a code. If you are not familiar with coding, you can have a developer write your custom recipe for $29 (or the appropriate sum in your local currency).
    Was this step helpful? Yes | No| I need help
  11. 11
    You can try to skip that step by going to the web page first
    .
    Was this step helpful? Yes | No| I need help
  12. 12
    Then, if the table has many pages, look for the function that moves you to the next page
    .
    It is "Next" in this video.
    Was this step helpful? Yes | No| I need help
  13. 13
    Then, right-click the function
    .
    Was this step helpful? Yes | No| I need help
  14. 14
    Click "Inspect"
    .
    Was this step helpful? Yes | No| I need help
  15. 15
    Once you choose "Inspect", copy the "ID" of highlighted element
    .
    In this example, the ID is "auth_granted_next". Double-click to select it.
    Was this step helpful? Yes | No| I need help
  16. 16
    Press "command" + "C" to copy it
    .
    Was this step helpful? Yes | No| I need help
  17. 17
    Highlight the title of the "Next button"
    .
    Was this step helpful? Yes | No| I need help
  18. 18
    Click Notes or any text editor
    .
    In this video, there is a ready code in Notes.
    Was this step helpful? Yes | No| I need help
  19. 19
    So, paste the copied text
    .
    The full code for this example will be
    Was this step helpful? Yes | No| I need help
  20. 20
    Highlight the code and press "command" + "C" to copy it
    .
    Was this step helpful? Yes | No| I need help
  21. 21
    Open the Data Miner window
    .
    Was this step helpful? Yes | No| I need help
  22. 22
    Click "Xpath of next page link"
    .
    Was this step helpful? Yes | No| I need help
  23. 23
    Press "command" + "V" to paste the code
    .
    Was this step helpful? Yes | No| I need help
  24. 24
    Leave "URL or Click" at "Click on Element"
    .
    Was this step helpful? Yes | No| I need help
  25. 25
    Then, click "Go Next"
    .
    Was this step helpful? Yes | No| I need help
  26. 26
    Go back to the web page
    .
    You will see that you will be on the next page that has entries from 11 to 20. It is working.
    Was this step helpful? Yes | No| I need help
  27. 27
    Switch to Data Miner
    .
    Was this step helpful? Yes | No| I need help
  28. 28
    Check "Start Auto Advance"
    .
    Was this step helpful? Yes | No| I need help
  29. 29
    Click "OK"
    .
    At the bottom of the window, Data Miner will show "Accumulated Rows". In this video, there are 20. Data Miner waits for 6 seconds before it advances to the next page; otherwise, the web site may know that you are gathering the data and may prevent you from doing so. It should advance to the end of the project, which would have been 2000 entries in this video.
    Was this step helpful? Yes | No| I need help
  30. 30
    Click "Download" to see how Data Miner works
    .
    It will ask for permission to manage downloads.
    Was this step helpful? Yes | No| I need help
  31. 31
    Click "Allow"
    .
    Was this step helpful? Yes | No| I need help
  32. 32
    Name the file
    .
    Let's call the file "333 exemptions".
    Was this step helpful? Yes | No| I need help
  33. 33
    Then, click "Save"
    .
    Was this step helpful? Yes | No| I need help
  34. 34
    Open up the data in a data sheet program like Excel
    .
    You will see that the list of the exemptions has been copied from the web site.
    Was this step helpful? Yes | No| I need help
  35. 35
    This has been a video tutorial on how to use Data Miner in Google Chrome
    .
    If you have any questions or comments, please leave them in the space below. Thank you for watching VisiHow!
    Was this step helpful? Yes | No| I need help

See more tutorials on Chrome: Disable Facebook Desktop Notifications, Disable Notifications, Mute Tabs, Enable or Disable Flash, Change the Background Image, Enable Click-to-Play Plug-ins, Change the Download Location, Automatically Open Downloads, and Install "Dark Mode".

Was this helpful? Yes | No| I need help

Video: Use Data Miner in Google Chrome

Questions and Answers

How do I add a column to a recipe in data miner?

I'm looking at mine, the mutual connections in a LinkedIn search scrape but I don't see any public recipes with mutual connections. I don't know ANYTHING about coding.. I have tried: Looking at all the recipes available.

Was this helpful? Yes | No| I need help

VisiHow QnA. This section is not written yet. Want to join in? Click EDIT to write this answer.

If you have problems with any of the steps in this article, please ask a question for more help, or post in the comments section below.

Comments

VisiHow welcomes all comments. If you do not want to be anonymous, register or log in. It is free.

Article Info

Categories : Google

Recent edits by: Eng, VisiHow, Djinu

Share this Article:

Thanks to all authors for creating a page that has been read 421 times.

x

Thank Our Volunteer Authors.

Would you like to give back to the community by fixing a spelling mistake? Yes | No