HackerNews Crawler
A web scraping project that displays the stories having votes greater than 99 in descending order from the hacker news website. It displays the link, title, and votes of the story.
Created on 21st November 2020
•
HackerNews Crawler
A web scraping project that displays the stories having votes greater than 99 in descending order from the hacker news website. It displays the link, title, and votes of the story.
The problem HackerNews Crawler solves
Since this project tells us about the tech news from the Hacker News website, it can be used by the user in such a way that the user doesn't always open the Hacker News website every time either execute this project and can get the latest tech news.
The idea behind this project is to make our work easier by saving our time by just executing the project to get the latest news.
Just run the code in any python code editor and get the top-rated news without wasting time by opening the browser getting to the hacker news website every time.
Challenges I ran into
While making this project I have to learn some new libraries in Python and how to work with PyCharm. Working in PyCharm is a little bit tricky I have to download or import some new modules and libraries which is required for this project. At the starting of the project, I cannot make a request to the server for accessing the content to the Hacker News website but with some help with google :), I figured it out. Initially, it is working on only one page but in the end, I have inserted some loops which will ask up to how many pages did the user wants the stories.
Technologies used