An Interest In:
Web News this Week
- April 2, 2024
- April 1, 2024
- March 31, 2024
- March 30, 2024
- March 29, 2024
- March 28, 2024
- March 27, 2024
Some of Our Sources
View All Sources
January 17, 2022 03:10 pm GMT
Original Link: https://dev.to/midhunz/simple-web-scraper-that-reads-all-the-links-to-json-files-in-js-51en
Simple web scraper that reads all the links to JSON files in JS
I had to get a list of all links on a webpage for a task I was working on. here I am sharing the snippet of code that I used. Let's discuss how to improve it
var tag = document.querySelectorAll("a");var myarray = []for (var i = 0; i < tag.length; i++) { var nametext = tag[i].textContent; var cleantext = nametext.replace(/\s+/g, ' ').trim(); var cleanlink = tag[i].href; myarray.push([cleantext, cleanlink]);};function generateJson() { var hrefArray = []; for (var i = 0; i < myarray.length; i++) { let t = {} t.n = myarray[i][0]; t.m = myarray[i][1]; hrefArray.push(t); }; var win = window.open("Json"); win.document.write(JSON.stringify(hrefArray));}generateJson()
Steps
- You will need to open the website in your browser to get all links
- Go to the console tab in Inspect element
- Please paste the above code and press enter. A json file will open in a new window
Screenshots
- How to Run
- Result
Please let me know your thoughts after reading
Original Link: https://dev.to/midhunz/simple-web-scraper-that-reads-all-the-links-to-json-files-in-js-51en
Share this article:
Tweet
View Full Article
Dev To
An online community for sharing and discovering great ideas, having debates, and making friendsMore About this Source Visit Dev To