Use Data Miner in Google Chrome

Edited by Djinu, VisiHow, Eng, shannon.decker

4 Parts:
Steps
Video: Use Data Miner in Google Chrome
Questions and Answers
Comments

You're watching VisiHow. In the previous tutorial, we turned off notifications. In this tutorial, we're going to demonstrate how to gather ("scrape") data from a web site, using the Data Miner extension for Chrome.

Was this helpful? Yes | No| I need help
Use Data Miner In Google Chrome.mp4-canvas218 013475.jpg

Steps

  1. 1
    Open Chrome
    .
    Use Data Miner In Google Chrome.mp4-canvas5 140252.jpg
    Was this step helpful? Yes | No| I need help
  2. 2
    First, type "data miner chrome" in Google Search
    .
    Click "Scraper - Chrome Web Store".
    Use Data Miner In Google Chrome.mp4-canvas18 457659.jpg
    Was this step helpful? Yes | No| I need help
  3. 3
    Alternatively click the direct link
    .
    Use Data Miner In Google Chrome.mp4-canvas22 342384.jpg
    Was this step helpful? Yes | No| I need help
  4. 4
    Click "ADD TO CHROME"
    .
    Use Data Miner In Google Chrome.mp4-canvas23 035249.jpg
    Was this step helpful? Yes | No| I need help
  5. 5
    Click "Add extension"
    .
    This will add an icon to the toolbar in the upper-right corner and take you to a tutorial from the web site. You can skip this tutorial.
    Use Data Miner In Google Chrome.mp4-canvas25 743539.jpg
    Was this step helpful? Yes | No| I need help
  6. 6
    Open the page with the data that you need to "mine"
    .
    In this video, the page has to be reloaded so that the new extension shows up.
    Use Data Miner In Google Chrome.mp4-canvas40 82597.jpg
    Was this step helpful? Yes | No| I need help
  7. 7
    Highlight the first row of the data
    .
    In this video, the data is "Authorization Granted Via Section 333 Exemptions", a list of all of the companies that can legally fly drones in the United States for commercial purposes.
    Use Data Miner In Google Chrome.mp4-canvas49 028716.jpg
    Was this step helpful? Yes | No| I need help
  8. 8
    Once you have highlighted the first row of the data, right-click the data
    .
    Use Data Miner In Google Chrome.mp4-canvas67 474876.jpg
    Was this step helpful? Yes | No| I need help
  9. 9
    Click "DataMiner-Get Similar"
    .
    This will generate a table of all of the data up to ten, because there are only ten items on the page. This list is about 2000 entries long.
    Use Data Miner In Google Chrome.mp4-canvas70 03007.jpg
    Was this step helpful? Yes | No| I need help
  10. 10
    To get the subsequent pages, click "Next Page Navigation"
    .
    You will need to write a code. If you are not familiar with coding, you can have a developer write your custom recipe for $29 (or the appropriate sum in your local currency).
    Use Data Miner In Google Chrome.mp4-canvas90 020517.jpg
    Was this step helpful? Yes | No| I need help
  11. 11
    You can try to skip that step by going to the web page first
    .
    Use Data Miner In Google Chrome.mp4-canvas111 928507.jpg
    Was this step helpful? Yes | No| I need help
  12. 12
    Then, if the table has many pages, look for the function that moves you to the next page
    .
    It is "Next" in this video.
    Use Data Miner In Google Chrome.mp4-canvas113 238036.jpg
    Was this step helpful? Yes | No| I need help
  13. 13
    Then, right-click the function
    .
    Use Data Miner In Google Chrome.mp4-canvas116 134096.jpg
    Was this step helpful? Yes | No| I need help
  14. 14
    Click "Inspect"
    .
    Use Data Miner In Google Chrome.mp4-canvas119 767371.jpg
    Was this step helpful? Yes | No| I need help
  15. 15
    Once you choose "Inspect", copy the "ID" of highlighted element
    .
    In this example, the ID is "auth_granted_next". Double-click to select it.
    Use Data Miner In Google Chrome.mp4-canvas131 741538.jpg
    Was this step helpful? Yes | No| I need help
  16. 16
    Press "command" + "C" to copy it
    .
    Use Data Miner In Google Chrome.mp4-canvas135 217816.jpg
    Was this step helpful? Yes | No| I need help
  17. 17
    Highlight the title of the "Next button"
    .
    Use Data Miner In Google Chrome.mp4-canvas133 433752.jpg
    Was this step helpful? Yes | No| I need help
  18. 18
    Click Notes or any text editor
    .
    In this video, there is a ready code in Notes.
    Use Data Miner In Google Chrome.mp4-canvas142 644017.jpg
    Use Data Miner In Google Chrome.mp4-canvas144 782376.jpg
    Was this step helpful? Yes | No| I need help
  19. 19
    So, paste the copied text
    .
    The full code for this example will be
    • //*[@id='auth_granted_next']
      Use Data Miner In Google Chrome.mp4-canvas150 936658.jpg
    Was this step helpful? Yes | No| I need help
  20. 20
    Highlight the code and press "command" + "C" to copy it
    .
    Use Data Miner In Google Chrome.mp4-canvas168 90394.jpg
    Was this step helpful? Yes | No| I need help
  21. 21
    Open the Data Miner window
    .
    Use Data Miner In Google Chrome.mp4-canvas173 346433.jpg
    Was this step helpful? Yes | No| I need help
  22. 22
    Click "Xpath of next page link"
    .
    Use Data Miner In Google Chrome.mp4-canvas174 846433.jpg
    Was this step helpful? Yes | No| I need help
  23. 23
    Press "command" + "V" to paste the code
    .
    Use Data Miner In Google Chrome.mp4-canvas176 76971.jpg
    Was this step helpful? Yes | No| I need help
  24. 24
    Leave "URL or Click" at "Click on Element"
    .
    Use Data Miner In Google Chrome.mp4-canvas180 470812.jpg
    Was this step helpful? Yes | No| I need help
  25. 25
    Then, click "Go Next"
    .
    Use Data Miner In Google Chrome.mp4-canvas194 272616.jpg
    Was this step helpful? Yes | No| I need help
  26. 26
    Go back to the web page
    .
    You will see that you will be on the next page that has entries from 11 to 20. It is working.
    Use Data Miner In Google Chrome.mp4-canvas204 198413.jpg
    Was this step helpful? Yes | No| I need help
  27. 27
    Switch to Data Miner
    .
    Use Data Miner In Google Chrome.mp4-canvas217 125211.jpg
    Was this step helpful? Yes | No| I need help
  28. 28
    Check "Start Auto Advance"
    .
    Use Data Miner In Google Chrome.mp4-canvas218 33185.jpg
    Was this step helpful? Yes | No| I need help
  29. 29
    Click "OK"
    .
    At the bottom of the window, Data Miner will show "Accumulated Rows". In this video, there are 20. Data Miner waits for 6 seconds before it advances to the next page; otherwise, the web site may know that you are gathering the data and may prevent you from doing so. It should advance to the end of the project, which would have been 2000 entries in this video.
    Use Data Miner In Google Chrome.mp4-canvas220 532308.jpg
    Was this step helpful? Yes | No| I need help
  30. 30
    Click "Download" to see how Data Miner works
    .
    It will ask for permission to manage downloads.
    Use Data Miner In Google Chrome.mp4-canvas253 446115.jpg
    Was this step helpful? Yes | No| I need help
  31. 31
    Click "Allow"
    .
    Use Data Miner In Google Chrome.mp4-canvas258 587368.jpg
    Was this step helpful? Yes | No| I need help
  32. 32
    Name the file
    .
    Let's call the file "333 exemptions".
    Use Data Miner In Google Chrome.mp4-canvas266 219764.jpg
    Was this step helpful? Yes | No| I need help
  33. 33
    Then, click "Save"
    .
    Use Data Miner In Google Chrome.mp4-canvas268 336549.jpg
    Was this step helpful? Yes | No| I need help
  34. 34
    Open up the data in a data sheet program like Excel
    .
    You will see that the list of the exemptions has been copied from the web site.
    Use Data Miner In Google Chrome.mp4-canvas272 219155.jpg
    Was this step helpful? Yes | No| I need help
  35. 35
    This has been a video tutorial on how to use Data Miner in Google Chrome
    .
    If you have any questions or comments, please leave them in the space below. Thank you for watching VisiHow!
    Was this step helpful? Yes | No| I need help

See more tutorials on Chrome: Disable Facebook Desktop Notifications, Disable Notifications, Mute Tabs, Enable or Disable Flash, Change the Background Image, Enable Click-to-Play Plug-ins, Change the Download Location, Automatically Open Downloads, and Install "Dark Mode".

Was this helpful? Yes | No| I need help

Video: Use Data Miner in Google Chrome

Questions and Answers

How do I add a column to a recipe in data miner?

I'm looking at mine, the mutual connections in a LinkedIn search scrape but I don't see any public recipes with mutual connections. I don't know ANYTHING about coding.. I have tried: Looking at all the recipes available.

Was this helpful? Yes | No| I need help

VisiHow QnA. This section is not written yet. Want to join in? Click EDIT to write this answer.

If you have problems with any of the steps in this article, please ask a question for more help, or post in the comments section below.

Comments

VisiHow welcomes all comments. If you do not want to be anonymous, register or log in. It is free.

Article Info

Categories : Google

Recent edits by: Eng, VisiHow, Djinu

Share this Article:

Thanks to all authors for creating a page that has been read 740 times.

x

Thank Our Volunteer Authors.

Would you like to give back to the community by fixing a spelling mistake? Yes | No