News Aggregator/Web Scraper
I am seeking a skilled developer to create a high-speed web scraper focused on aggregating data from various news websites. The ideal candidate will have experience in web scraping techniques, ensuring efficiency and reliability in data collection. Your work will play a critical role in facilitating timely access to news content, so a strong emphasis on speed is essential. Ideally would be some sort of GUI that would pull in changes/updates on websites (e.g. new articles, new posts, edits/updates to text/numbers on the site, etc.) and simultaneously have the option to open the website in a browser when it pulls in the update. Most websites would be RSS/XML feeds but some will just be standard websites, and a couple have CloudFlare protection. Ultimately though speed is the priority here. If you are interested in further discussing, please reach out, thanks! Apply tot his job